Software Engineer, API Multicloud

Skills

About the Role

You will design, build, and operate the systems that run OpenAI's API across cloud service provider platforms. You will stand up model-serving environments with inference engineers, plan capacity, improve caching and utilization, create repeatable release processes, and work directly with CSP engineers to resolve integration issues and build reusable infrastructure.

Requirements

• 7+ years of experience leading cloud infrastructure or distributed systems projects from architecture through launch and production ownership
• Strong distributed systems fundamentals
• Hands-on experience building and operating services on a major CSP, including deployment systems, networking, storage, and cloud-native integrations
• Strong production coding and debugging skills
• Experience with capacity planning, performance optimization, or operational tooling at scale
• Sound technical judgment
• Clear technical communication and cross-team experience
• Curiosity about model serving and AI infrastructure; model deployment experience is a plus

Responsibilities

• Design and build cloud infrastructure and distributed services that connect API requests, routing, and model-serving deployments
• Stand up and operate model-serving environments with inference engineers
• Plan and manage cloud capacity, improving utilization, caching, request performance, and cost efficiency
• Create repeatable build, release, and validation processes that catch regressions before launch
• Develop reusable infrastructure abstractions that run consistently across CSPs
• Partner with internal teams and CSP engineers to bring up the API serving stack on new platforms
• Own production health through observability, incident diagnosis, reliability improvements, and automation

Benefits

• Equity
• Performance-related bonus
• Medical, dental, and vision insurance with employer HSA contributions
• Pre-tax Health FSA, Dependent Care FSA, and commuter accounts
• 401(k) with employer match
• Paid parental leave (up to 24 weeks birth parents, 20 weeks non-birthing parents)
• Paid medical and caregiver leave (up to 8 weeks)
• Flexible PTO for exempt employees; up to 15 days for non-exempt
• 13+ paid company holidays and company office closures
• Paid sick or safe time
• Mental health and wellness support
• Employer-paid basic life and disability coverage
• Annual learning and development stipend
• Daily meals in offices and meal delivery credits
• Relocation support for eligible employees
• Charitable donation matching and wellness stipends