Software Engineer, TPU Compilers

2 hours agoSalary: 380K - 500KSan Francisco, USAOnsiteAiJobs by OpenAI

AI research and deployment company building and deploying frontier AI products, including ChatGPT, Codex, and its API platform.

41 current maintainers27 active leads7 new active leads120 lead step-downs17 early lead departures
San Francisco, United States
About OpenAI

OpenAI’s mission is to ensure artificial general intelligence benefits all of humanity. It consists of the nonprofit OpenAI Foundation and OpenAI Group, a public benefit corporation governed by the Foundation.

View jobs by OpenAI

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will lead optimization of frontier models on TPUs, owning performance across the full forward pass from model code through kernels to hardware. You will profile workloads, find bottlenecks, develop kernels, explore quantization, and build benchmarks while partnering with researchers and engineers.

Requirements

  • Practical experience optimizing machine learning workloads on TPUs
  • Understanding of modern model architectures and accelerator hardware mapping
  • Strong software engineering skills and systematic profiling and debugging
  • Experience with quantization or attention kernels is especially useful

Responsibilities

  • Optimize model execution on TPUs across the complete forward pass
  • Profile workloads and improve latency, throughput, and hardware utilization
  • Develop and optimize kernels
  • Explore techniques such as quantization
  • Build benchmarks and tools to measure performance and validate correctness
  • Partner with researchers and engineers to support new model architectures

Benefits

  • Equity
  • Performance-related bonus
  • Medical, dental, and vision insurance with HSA employer contributions
  • Health FSA, Dependent Care FSA, and commuter pre-tax accounts
  • 401(k) with employer match
  • Paid parental leave up to 24 weeks for birth parents and 20 weeks for non-birthing parents
  • Paid medical and caregiver leave up to 8 weeks
  • Flexible PTO for exempt employees
  • 13+ paid company holidays and company office closures
  • Paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend
  • Daily meals in offices and meal delivery credits
  • Relocation support
  • Charitable donation matching and wellness stipends