We launched recruiters.rip, let your AI apply for you. First month free with code onemonthfree

Pre training Data Infrastructure Engineer

2 months agoLeadSalary: 500000 - 850000 USD / yearSan Francisco, USAHybridData ScienceJobs by Anthropic

AI safety and research company building reliable, interpretable, and steerable AI systems, including the Claude product family and developer platform.

Series F+Recently funded59 current maintainers55 active leads23 new active leads26 lead step-downs8 early lead departures
San Francisco, United States
About Anthropic

Anthropic PBC develops frontier AI systems and deploys them through Claude products and the Claude Platform, with a stated focus on safety, interpretability, and steerability.

View jobs by Anthropic

Skills

Candidate Availability

About the Role

You will design and operate high-performance, reproducible data-processing infrastructure for language-model training. You will develop processing primitives, build data-quality systems, collaborate on new architectures, and operate pipelines that transform web-scale corpora into training-ready datasets.

Requirements

  • 5+ years of experience outside internships
  • Software engineering experience
  • High-throughput fault-tolerant distributed-systems experience
  • Apache Spark experience
  • Language-model training infrastructure experience
  • Data infrastructure, MLOps, or ML infrastructure background

Responsibilities

  • Design and implement data-processing infrastructure for language-model training
  • Develop and maintain tokenization, deduplication, and chunking primitives
  • Build data-quality assurance and validation systems
  • Collaborate with research teams on data-processing architectures
  • Build and operate pipelines from web-scale corpora to training-ready datasets

Benefits

  • Optional equity donation matching
  • Generous vacation
  • Parental leave
  • Flexible working hours