Research Program Manager Model Evaluations and Safety

Reflection is an AI research lab building open frontier models and a full AI stack for developers, enterprises, and public-sector users.

New York, United States
About Reflection

Reflection develops open-weight AI models, open-source software for customizing and running agents, AI-factory infrastructure, and related solutions. Its current research emphasizes large language models, reinforcement learning, and agentic reasoning.

View jobs by Reflection

Skills

About the Role

You will establish model evaluation and safety operations from the ground up. You will define evaluation frameworks and workflows, embed safety checkpoints into development, prioritize investments, coordinate external safety engagement, report model risks, and improve processes through post-mortems.

Requirements

  • 7+ years of experience in technical program management, research operations, or ML engineering
  • Experience establishing new functions, teams, or programs
  • Knowledge of model evaluation, AI safety, red-teaming, alignment research, and safety regulation
  • Knowledge of model behavior, evaluation design, data pipelines, and safety-critical system architecture
  • Experience creating programs with ownership, measurable outcomes, and durable processes
  • Technical stakeholder and external partner management

Responsibilities

  • Build infrastructure for model evaluations and safety
  • Define evaluation frameworks, tooling requirements, and operational processes
  • Establish model safety workflows, review cadences, and decision frameworks
  • Embed safety and evaluation checkpoints in model development and release processes
  • Prioritize evaluation science and infrastructure investments
  • Coordinate third-party assessments, academic partnerships, and industry safety frameworks
  • Report model safety status, evaluation coverage, and open risks
  • Champion blameless post-mortems and continuous learning

Benefits

  • Equity
  • Stock options
  • Medical insurance
  • Dental insurance
  • Vision insurance
  • Life insurance
  • Annual wellness allowance
  • Daily office lunch and dinner
  • 22 weeks of paid parental leave
  • Unlimited paid time off in the U.S.
  • 30 days of vacation in the U.K.
  • Visa sponsorship support
  • Regular off-sites, happy hours, and team celebrations
Research Program Manager Model Evaluations and Safety at Reflection | JobStash