Member of Technical Staff - Data Ingestion Engineer
Reflection is an AI research lab building open frontier models and a full AI stack for developers, enterprises, and public-sector users.
Funding history
About Reflection
Reflection develops open-weight AI models, open-source software for customizing and running agents, AI-factory infrastructure, and related solutions. Its current research emphasizes large language models, reinforcement learning, and agentic reasoning.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will build and operate systems that acquire, extract, normalize, version, and deliver large-scale data for pre-training. You will run experiments on crawling and extraction strategies, analyze data quality and coverage, develop specialized crawlers, and improve ingestion infrastructure through code review and production debugging.
Requirements
- Experience building web crawling, data ingestion, or large-scale data acquisition systems
- Experience with Ray, Beam, Spark, or similar technologies
- Familiarity with LLM training and evaluation
- Experience working with multi-terabyte to petabyte-scale datasets
- Ability to design experiments and use data to improve systems
- Communication skills
Responsibilities
- Build and operate large-scale data ingestion systems for pre-training
- Run experiments on crawling strategies, extraction methods, and ingestion tradeoffs
- Analyze ingested data to identify gaps, redundancy, and improvements
- Build reliable ingestion pipelines for large data campaigns
- Develop specialized crawlers for high-priority data sources
- Review code, debug production issues, and improve ingestion infrastructure
Benefits
- Stock options
- Medical, dental, vision, and life insurance
- Annual wellness allowance
- Daily office lunch and dinner
- 22 weeks of paid parental leave
- Unlimited paid time off in the U.S.
- 30 vacation days in the U.K.
- Visa sponsorship support
- Regular off-sites, happy hours, and team celebrations