Data Loop Pipeline Engineer
Merlin is a Boston-based aerospace and defense technology company developing AI-powered, aircraft-agnostic autonomy software for fixed-wing aircraft.
About Merlin
Merlin’s Merlin Pilot combines hardware and software intended to perform takeoff-to-touchdown flight functions for military and civil aircraft, supporting reduced-crew and autonomous operations. The operating business began as Apollo Flight Research in 2018, became Merlin Labs in 2020, and is now operated under public parent Merlin, Inc.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will build and operate ingestion pipelines for flight, simulation, and operational data. You will normalize formats, align time across sources, validate quality, curate and version datasets, and maintain full lineage. You will automate anomaly mining and labeling workflows, instrument deployed behavior for future training cycles, and monitor pipeline health, coverage, drift, and gaps.
Requirements
- Degree in Computer Science, Artificial Intelligence, Data Science, Computer Engineering, Applied Math, or a related subject
- 3+ years of data engineering experience with production ML-training pipelines
- Strong Python and SQL skills
- Knowledge of data modeling, storage formats, and processing frameworks
- Experience with dataset versioning and lineage tooling
- Experience with high-volume time-series and multimodal sensor data
Responsibilities
- Build and operate ingestion pipelines for flight test, simulation, and operational data
- Normalize data formats, align time across sources, and validate data quality
- Implement dataset curation, versioning, and lineage
- Automate mining and triage of anomalies and near-boundary events
- Own labeling workflows, quality control, and inter-annotator agreement
- Instrument deployed-system behavior for future training cycles
- Define logging and instrumentation requirements with Flight Test and Operations
- Monitor pipeline health and dataset coverage for drift, gaps, and silent breakage
Benefits
- Equity grants
- Catered lunches
- Snacks and beverages
- Health insurance
- Dental insurance
- Life insurance
- Unlimited vacation
- 401k matching