Data Engineering Team Lead
IG operates an award-winning trading platform and provides forex trading services, support, and educational resources through IG Academy.
About IG
IG is a trading-services company offering an award-winning trading platform, including forex trading services in the US. Its website highlights instant support and educational resources through IG Academy, and warns users about the risks of leveraged CFD trading.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will lead delivery of batch and real-time data pipelines within a GCP consolidation programme. You will coach and manage data engineers, establish data-quality and engineering standards, translate stakeholder needs into deliverables, run sprint cadences, manage risks, and report reliability and delivery metrics.
Requirements
- GCP data-pipeline design and operations
- BigQuery
- Cloud Composer
- Airflow
- Google Cloud Storage
- Apache Kafka
- Real-time streaming architecture
- Data-engineering leadership or technical mentoring
- Code review
- Design review
- Data contract
- Pipeline observability
- SLA and SLO definition
- Automated alerting and remediation
- SQL
- dbt
- Data ingestion
- Cross-functional communication
- Financial-services regulation
- Sprint cadence
- Change control
- Escalation
Responsibilities
- Lead delivery of batch and real-time data pipelines
- Manage squad commitments end to end
- Coach, develop, and performance-manage data engineers
- Embed data contracts, observability, and SLA monitoring
- Translate stakeholder requirements into engineering deliverables
- Run sprint cadences and manage delivery commitments
- Escalate delivery risks early
- Report pipeline SLOs, data freshness, and engineering metrics
Benefits
- Extra time off for volunteering and community work
