Senior Software Engineer, Inference

AI safety and research company building reliable, interpretable, and steerable AI systems, including the Claude product family and developer platform.

Series F+Recently funded0 current maintainers0 active leadsTeam intelligence

Maintainer signals as of 9/25/2026

San Francisco, United States
About Anthropic

Anthropic PBC develops frontier AI systems and deploys them through Claude products and the Claude Platform, with a stated focus on safety, interpretability, and steerability.

View jobs by Anthropic

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will build and maintain systems that serve AI models at scale. You will design request routing and fleet orchestration, optimize inference efficiency, support deployments across accelerator platforms and cloud environments, improve observability and performance, and manage multi-region inference systems.

Requirements

  • Significant software engineering experience
  • Experience with distributed systems
  • Knowledge of machine learning systems and infrastructure
  • Ability to work in fast-moving environments

Responsibilities

  • Design intelligent request-routing algorithms
  • Autoscale compute fleets for production and research workloads
  • Build deployment pipelines for model releases
  • Integrate new AI accelerator platforms
  • Develop inference features such as structured sampling and prompt caching
  • Support new model architectures
  • Analyze observability data to tune production performance
  • Manage multi-region deployments and geographic routing

Benefits

  • Optional equity donation matching
  • Generous vacation
  • Parental leave
  • Flexible working hours