Engineering Manager ChatGPT Search Infrastructure

Skills

About the Role

You will set technical strategy and architecture for ChatGPT Search Infrastructure. You will lead engineers, build reusable platforms and guardrails, partner across model, inference, indexing, and retrieval teams, and uphold availability, latency, scalability, and operational standards.

Requirements

• Experience managing senior engineers and teams responsible for high-scale infrastructure, online serving, or distributed systems
• Technical depth in backend infrastructure, platform engineering, API, low-latency serving, experimentation platforms, or AI-powered product development
• Knowledge of models, prompts, inference systems, search orchestration, indexing, retrieval, and infrastructure
• Experience partnering with research or Post-Training teams on model launches, experiments, evaluations, or prompt optimization
• Experience building shared platforms with reliability, scalability, quality, and performance guardrails
• Experience shaping architecture for demanding availability, latency, and scale requirements
• People management and organizational leadership skills

Responsibilities

• Define and drive the technical strategy, architecture, and roadmap for ChatGPT Search Infrastructure
• Lead and develop experienced engineers
• Partner on model launches, A/B experiments, search-behavior evaluation, and prompt optimization
• Build reusable platforms and automated guardrails for product teams
• Partner with Inference, Indexing, and Retrieval teams on end-to-end architecture
• Uphold 99.9% availability, latency, and scalability objectives
• Establish engineering practices for system design, testability, observability, experimentation, capacity planning, rollout safety, and incident prevention
• Lead complex workstreams and remove technical and organizational bottlenecks

Benefits

• Medical, dental, and vision insurance with employer Health Savings Account contributions
• Health FSA, Dependent Care FSA, and commuter pre-tax accounts
• 401(k) retirement plan with employer match
• Paid parental, medical, and caregiver leave
• Flexible PTO or up to 15 days of annual PTO, depending on exemption status
• Paid holidays, office closures, and sick or safe time
• Mental health and wellness support
• Employer-paid life and disability coverage
• Annual learning and development stipend
• Daily office meals and eligible meal-delivery credits
• Relocation support for eligible employees
• Charitable donation matching and wellness stipends may be provided