Pre training Data Infrastructure Engineer
2 months agoLeadSalary: 500000 - 850000 USD / yearSan Francisco, USAHybridData ScienceJobs by Anthropic
AnthropicVisit Anthropic website
AI safety and research company building reliable, interpretable, and steerable AI systems, including the Claude product family and developer platform.
Series F+Recently funded59 current maintainers55 active leads23 new active leads26 lead step-downs8 early lead departures
San Francisco, United States
Funding history
About Anthropic
Anthropic PBC develops frontier AI systems and deploys them through Claude products and the Claude Platform, with a stated focus on safety, interpretability, and steerability.
Skills
Candidate Availability
About the Role
You will design and operate high-performance, reproducible data-processing infrastructure for language-model training. You will develop processing primitives, build data-quality systems, collaborate on new architectures, and operate pipelines that transform web-scale corpora into training-ready datasets.
Requirements
- 5+ years of experience outside internships
- Software engineering experience
- High-throughput fault-tolerant distributed-systems experience
- Apache Spark experience
- Language-model training infrastructure experience
- Data infrastructure, MLOps, or ML infrastructure background
Responsibilities
- Design and implement data-processing infrastructure for language-model training
- Develop and maintain tokenization, deduplication, and chunking primitives
- Build data-quality assurance and validation systems
- Collaborate with research teams on data-processing architectures
- Build and operate pipelines from web-scale corpora to training-ready datasets
Benefits
- Optional equity donation matching
- Generous vacation
- Parental leave
- Flexible working hours
