Machine Learning Engineer, Multimodal Perception and Authentication
AI research and deployment company building and deploying frontier AI products, including ChatGPT, Codex, and its API platform.
Projects
About OpenAI
OpenAI’s mission is to ensure artificial general intelligence benefits all of humanity. It consists of the nonprofit OpenAI Foundation and OpenAI Group, a public benefit corporation governed by the Foundation.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will help shape how future AI systems understand the physical world and the people in it. You will research and build multimodal perception and authentication methods using cameras, microphones and other sensors, explore how specialized perception models and larger multimodal models work together, design data, training and evaluation approaches, and partner with hardware, firmware, software and product teams to turn research into working systems.
Requirements
- Strong background in computer vision, audio or speech machine learning, multimodal learning, or sensing
- Experience developing specialized machine learning models, larger multimodal models, or both
- Experience bringing research ideas into practical systems, prototypes or products
- Ability to design experiments, build evaluations and investigate model behavior
- Experience with sensing hardware, real-time systems or other deployment constraints
- Proficiency in Python and PyTorch and comfort with C++ or systems integration
- Experience with authentication, biometrics or other privacy-sensitive applications
Responsibilities
- Research and develop multimodal perception and authentication methods across visual, audio and other sensing signals
- Explore how specialized perception models and larger multimodal models can work together
- Design data, training and evaluation approaches that improve real-world performance
- Study model behavior, robustness and failure modes across sensing, data and deployment environments
- Integrate and validate new capabilities in real-time or resource-constrained systems
- Work with hardware, firmware, software and product teams to turn research into working systems
Benefits
- Equity
- Medical, dental and vision insurance with employer HSA contributions
- Pre-tax Health FSA, Dependent Care FSA and commuter accounts
- 401(k) with employer match
- Paid parental leave (up to 24 weeks for birth parents, 20 weeks for non-birthing parents)
- Paid medical and caregiver leave (up to 8 weeks)
- Flexible PTO for exempt employees
- 13+ paid company holidays and coordinated office closures
- Paid sick or safe time
- Mental health and wellness support
- Employer-paid basic life and disability coverage
- Annual learning and development stipend
- Daily meals in offices and meal delivery credits
- Relocation assistance
- Charitable donation matching and wellness stipends
- Performance-related bonus
