Machine Learning Engineer, Multimodal Perception and Authentication

13 hours agoSalary: 342K - 399KSan Francisco, USAHybridAiJobs by OpenAI

AI research and deployment company building and deploying frontier AI products, including ChatGPT, Codex, and its API platform.

41 current maintainers27 active leads7 new active leads120 lead step-downs17 early lead departures
San Francisco, United States
About OpenAI

OpenAI’s mission is to ensure artificial general intelligence benefits all of humanity. It consists of the nonprofit OpenAI Foundation and OpenAI Group, a public benefit corporation governed by the Foundation.

View jobs by OpenAI

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will help shape how future AI systems understand the physical world and the people in it. You will research and build multimodal perception and authentication methods using cameras, microphones and other sensors, explore how specialized perception models and larger multimodal models work together, design data, training and evaluation approaches, and partner with hardware, firmware, software and product teams to turn research into working systems.

Requirements

  • Strong background in computer vision, audio or speech machine learning, multimodal learning, or sensing
  • Experience developing specialized machine learning models, larger multimodal models, or both
  • Experience bringing research ideas into practical systems, prototypes or products
  • Ability to design experiments, build evaluations and investigate model behavior
  • Experience with sensing hardware, real-time systems or other deployment constraints
  • Proficiency in Python and PyTorch and comfort with C++ or systems integration
  • Experience with authentication, biometrics or other privacy-sensitive applications

Responsibilities

  • Research and develop multimodal perception and authentication methods across visual, audio and other sensing signals
  • Explore how specialized perception models and larger multimodal models can work together
  • Design data, training and evaluation approaches that improve real-world performance
  • Study model behavior, robustness and failure modes across sensing, data and deployment environments
  • Integrate and validate new capabilities in real-time or resource-constrained systems
  • Work with hardware, firmware, software and product teams to turn research into working systems

Benefits

  • Equity
  • Medical, dental and vision insurance with employer HSA contributions
  • Pre-tax Health FSA, Dependent Care FSA and commuter accounts
  • 401(k) with employer match
  • Paid parental leave (up to 24 weeks for birth parents, 20 weeks for non-birthing parents)
  • Paid medical and caregiver leave (up to 8 weeks)
  • Flexible PTO for exempt employees
  • 13+ paid company holidays and coordinated office closures
  • Paid sick or safe time
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend
  • Daily meals in offices and meal delivery credits
  • Relocation assistance
  • Charitable donation matching and wellness stipends
  • Performance-related bonus