Member of Technical Staff - Engineering Lead Data Ingestion
Reflection is an AI research lab building open frontier models and a full AI stack for developers, enterprises, and public-sector users.
Funding history
About Reflection
Reflection develops open-weight AI models, open-source software for customizing and running agents, AI-factory infrastructure, and related solutions. Its current research emphasizes large language models, reinforcement learning, and agentic reasoning.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will lead, mentor, and grow data ingestion engineers while remaining hands-on with the technical stack. You will prioritize work, run acquisition campaigns, guide architecture across crawling, pipelines, and data lakes, and connect ingestion decisions to measurable model impact.
Requirements
- Experience building, mentoring, and growing data or infrastructure engineering teams
- Experience building web-scale data acquisition or ingestion systems
- Experience owning production pipelines at multi-terabyte to petabyte scale
- Strong coding ability
- Expertise in web crawling, data ingestion pipelines, or data lakes
- Experience with Ray, Beam, Spark, Airflow, Prefect, Parquet, JSONL, WARC, and data-lake architectures
- Familiarity with LLM training and evaluation
- Ability to guide strategy and execution across concurrent data campaigns
Responsibilities
- Build, mentor, and grow a team of data ingestion engineers
- Lead web crawling, ingestion pipelines, and data lake delivery
- Make targeted individual-contributor technical contributions
- Prioritize team work and run data acquisition campaigns
- Guide technical and architectural decisions
- Run experiments on crawling strategies, extraction methods, and ingestion tradeoffs
- Partner with research, data quality, vendors, and legal stakeholders
- Onboard new sources within legal, licensing, and robots.txt constraints
Benefits
- Stock options
- Medical, dental, vision, and life insurance
- Annual wellness allowance
- Daily office lunch and dinner
- 22 weeks of paid parental leave
- Unlimited paid time off in the U.S.
- 30 vacation days in the U.K.
- Visa sponsorship support
- Regular off-sites, happy hours, and team celebrations