Model Policy Manager, Emerging AI Misuse
OpenAIVisit OpenAI website
AI research and deployment company building and deploying frontier AI products, including ChatGPT, Codex, and its API platform.
105 current maintainers70 active leads37 new active leads111 lead step-downs12 early lead departures
San Francisco, United States
Projects
About OpenAI
OpenAI’s mission is to ensure artificial general intelligence benefits all of humanity. It consists of the nonprofit OpenAI Foundation and OpenAI Group, a public benefit corporation governed by the Foundation.
Skills
Candidate Availability
About the Role
You will build threat models for how people could misuse AI in digital and physical settings, assess what AI access changes in practice, and use that evidence to define how models should respond. You will partner with research, engineering, security and product teams.
Requirements
- Hands-on experience building, testing, or assessing dual-use technologies, or a track record of threat modeling
- Deep practical experience in one relevant domain
- Ability to translate technical evidence and uncertainty into policy boundaries and measurable evaluation criteria
- Experience analyzing gold sets, evaluation results and training data
- Comfort working hands-on with model data and evaluation results
Responsibilities
- Build and update threat models as capabilities evolve
- Define when models should help, limit assistance, or refuse
- Turn expert safety judgment into instructions, training examples and evaluations
- Turn threat models into evaluation scenarios and grading guidance and analyze model outputs, red-team findings and deployment data
- Partner with research, engineering, security and product teams to apply findings to training, deployment and monitoring
Benefits
- Equity
- Medical, dental, and vision insurance with employer HSA contributions
- Health FSA, Dependent Care FSA, and commuter pre-tax accounts
- 401(k) with employer match
- Paid parental leave, medical and caregiver leave
- Flexible PTO
- 13+ paid company holidays and company office closures
- Mental health and wellness support
- Employer-paid basic life and disability coverage
- Learning and development stipend
- Daily meals in offices and meal delivery credits
- Relocation support
- Optional work from home Thursdays and Fridays
- Charitable donation matching and wellness stipends
