We launched recruiters.rip, let your AI apply for you. First month free with code onemonthfree

Software Engineer, Developer Productivity - Inference Runtime

AI research and deployment company building and deploying frontier AI products, including ChatGPT, Codex, and its API platform.

49 current maintainers29 active leads5 new active leads117 lead step-downs16 early lead departures
San Francisco, United States
About OpenAI

OpenAI’s mission is to ensure artificial general intelligence benefits all of humanity. It consists of the nonprofit OpenAI Foundation and OpenAI Group, a public benefit corporation governed by the Foundation.

View jobs by OpenAI

Skills

About the Role

You will improve deploy gate systems that ensure inference engine releases are correct and performant. You will harden CI and validation infrastructure, reduce flaky failures, build automation for triage and escalation, and partner with inference and infrastructure teams to improve release quality and rollout safety.

Requirements

  • Strong experience with CI/CD, testing infrastructure, release tooling or large-scale build and validation systems
  • Comfortable in Python-heavy environments and debugging distributed systems
  • Ability to operate in ambiguous areas
  • Prior inference experience not required

Responsibilities

  • Improve deploy gate validation tooling for inference engine releases
  • Bring rigor to release, validation, branching and deployment processes
  • Improve canary, async and large-scale validation workflows
  • Harden CI, testing and validation infrastructure
  • Reduce flaky failures from infrastructure instability, GPU scheduling or test environments
  • Build automation for failure triage, ownership detection, debugging and escalation
  • Partner with inference, research developer productivity, engine acceleration and infrastructure teams
  • Reduce developer friction in testing, debugging and release workflows

Benefits

  • Equity
  • Medical, dental, and vision insurance with HSA employer contributions
  • Health FSA, Dependent Care FSA, and commuter pre-tax accounts
  • 401(k) with employer match
  • Paid parental leave, medical and caregiver leave
  • Flexible PTO
  • 13+ paid company holidays and company office closures
  • Mental health and wellness support
  • Employer-paid life and disability coverage
  • Annual learning and development stipend
  • Daily meals in offices and meal delivery credits
  • Relocation support
  • Charitable donation matching and wellness stipends
Software Engineer, Developer Productivity - Inference Runtime at OpenAI | JobStash