Researcher, Frontier Cybersecurity Risks
OpenAIVisit OpenAI website
AI research and deployment company building and deploying frontier AI products, including ChatGPT, Codex, and its API platform.
49 current maintainers29 active leads5 new active leads117 lead step-downs16 early lead departures
San Francisco, United States
Projects
About OpenAI
OpenAI’s mission is to ensure artificial general intelligence benefits all of humanity. It consists of the nonprofit OpenAI Foundation and OpenAI Group, a public benefit corporation governed by the Foundation.
Skills
Candidate Availability
About the Role
You will help design and implement an end-to-end mitigation stack that reduces severe cyber misuse across OpenAI's products. You will build prevention, monitoring, detection and enforcement components, partner with product and engineering teams to integrate safeguards, weigh technical trade-offs, and run rigorous testing and red-teaming to iterate on findings.
Requirements
- Passion for AI safety
- Demonstrated experience in deep learning and transformer models
- Proficiency with PyTorch or TensorFlow
- Strong foundation in data structures, algorithms, and software engineering
- Familiarity with training and fine-tuning large language models, including distillation, supervised fine-tuning, and policy optimization
- Experience working with cross-functional teams
- Significant experience designing and deploying technical safeguards for abuse prevention, detection, and enforcement at scale
- Nice to have: background in cybersecurity
Responsibilities
- Design and implement mitigation components for model-enabled cybersecurity misuse spanning prevention, monitoring, detection, and enforcement
- Integrate safeguards across product surfaces with product and engineering teams
- Evaluate technical trade-offs such as coverage, latency, model utility, and user privacy
- Collaborate with risk and threat modeling partners to align mitigations with anticipated attacker behaviors
- Execute testing and red-teaming workflows to stress-test the mitigation stack and iterate on findings
Benefits
- Equity
- Medical, dental, and vision insurance with employer HSA contributions
- Pre-tax Health FSA, Dependent Care FSA, and commuter accounts
- 401(k) with employer match
- Paid parental leave up to 24 weeks for birth parents and 20 weeks for non-birthing parents
- Paid medical and caregiver leave up to 8 weeks
- Flexible PTO
- 13+ paid company holidays and company office closures
- Paid sick or safe time
- Mental health and wellness support
- Employer-paid basic life and disability coverage
- Annual learning and development stipend
- Daily meals in offices and meal delivery credits
- Relocation support
- Charitable donation matching and wellness stipends
- Performance-related bonus
