Data Scientist Core Experimentation
OpenAIVisit OpenAI website
AI research and deployment company building and deploying frontier AI products, including ChatGPT, Codex, and its API platform.
Recently funded151 current maintainers88 active leads20 new active leads99 lead step-downs12 early lead departures
San Francisco, United States
Projects
About OpenAI
OpenAI’s mission is to ensure artificial general intelligence benefits all of humanity. It consists of the nonprofit OpenAI Foundation and OpenAI Group, a public benefit corporation governed by the Foundation.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will lead statistical strategy for experimentation, improve methodology and platform reliability, build scalable analytical systems, investigate measurement anomalies, and establish experimentation governance and best practices.
Requirements
- Experience building, scaling, or operating experimentation platforms at a large technology company
- Expertise in statistics, causal inference, and online experimentation methodology
- Experience with variance reduction, CUPED, sequential testing, sample ratio mismatch detection, metric design, or heterogeneous effects
- Strong Python and large-scale data-processing skills, including Spark
- Experience designing analytical data models and scalable experimentation pipelines
- Experience communicating statistical concepts to technical and non-technical audiences
- Experience in large-scale product, machine-learning, ranking, marketplace, or similar experimentation domains
Responsibilities
- Drive the statistical direction and technical strategy for the experimentation platform
- Design and improve experimentation methodologies
- Build pragmatic solutions for experimentation challenges
- Improve experiment reliability by detecting and preventing bias, logging issues, and data-quality failures
- Develop scalable analytical systems and pipelines in Python and distributed compute environments
- Improve experiment design, metric quality, and decision-making practices with engineering and product teams
- Lead investigations into experimentation anomalies and measurement failures
- Establish experimentation governance and statistical best practices
- Mentor data scientists
Benefits
- Medical, dental, and vision insurance with employer Health Savings Account contributions
- Health FSA, Dependent Care FSA, and commuter pre-tax accounts
- 401(k) retirement plan with employer match
- Paid parental, medical, and caregiver leave
- Flexible PTO or up to 15 days annually, depending on employee classification
- 13+ paid company holidays, coordinated office closures, and paid sick or safe time
- Mental health and wellness support
- Employer-paid basic life and disability coverage
- Annual learning and development stipend
- Daily office meals and eligible meal-delivery credits
- Relocation support for eligible employees
- Charitable donation matching and wellness stipends may be provided
