Staff Software Engineer Inference
AnthropicVisit Anthropic website
AI safety and research company building reliable, interpretable, and steerable AI systems, including the Claude product family and developer platform.
Maintainer signals as of 9/23/2026
San Francisco, United States
Funding history
About Anthropic
Anthropic PBC develops frontier AI systems and deploys them through Claude products and the Claude Platform, with a stated focus on safety, interpretability, and steerability.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, build, and maintain distributed systems that serve models at scale. You will develop request routing, load balancing, autoscaling, orchestration, deployment pipelines, and accelerator integrations while improving inference performance and reliability.
Requirements
- Python or Rust proficiency
- Production distributed-systems engineering experience
- Containerized infrastructure knowledge
- Kubernetes knowledge
- AWS, GCP, or Azure knowledge
Responsibilities
- Design, build, and maintain distributed inference systems
- Develop resilient systems that adapt to real-world events
- Develop request routing, load balancing, and traffic management systems
- Maximize fleet compute efficiency through autoscaling and orchestration
- Build and operate production deployment pipelines
- Provide high-performance inference infrastructure
- Integrate AI accelerator platforms and support new model architectures
Benefits
- Optional equity donation matching
- Generous vacation
- Parental leave
- Flexible working hours
