Staff Software Engineer Inference

AI safety and research company building reliable, interpretable, and steerable AI systems, including the Claude product family and developer platform.

Series F+Recently funded0 current maintainers0 active leadsTeam intelligence

Maintainer signals as of 9/23/2026

San Francisco, United States
About Anthropic

Anthropic PBC develops frontier AI systems and deploys them through Claude products and the Claude Platform, with a stated focus on safety, interpretability, and steerability.

View jobs by Anthropic

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will identify and remove infrastructure blockers across inference systems. You will optimize distributed services, request routing, orchestration, accelerator deployments, scaling, model releases, observability, and multi-region traffic management for production and research workloads.

Requirements

  • Significant software engineering experience with distributed systems.
  • Familiarity with performance optimization, large-scale service orchestration, and intelligent request routing.

Responsibilities

  • Identify and address infrastructure blockers for model inference systems.
  • Design intelligent routing algorithms across AI accelerators.
  • Autoscale compute fleets for production, research, and experimental workloads.
  • Build deployment pipelines for releasing models.
  • Integrate AI accelerator platforms.
  • Contribute inference features such as structured sampling and prompt caching.
  • Analyze observability data to tune production performance.
  • Manage multi-region deployments and geographic routing.

Benefits

  • Optional equity donation matching.
  • Generous vacation.
  • Parental leave.
  • Flexible working hours.
Staff Software Engineer Inference at Anthropic | JobStash