Research Program Manager Model Evaluations and Safety
ReflectionVisit Reflection website
Reflection is an AI research lab building open frontier models and a full AI stack for developers, enterprises, and public-sector users.
New York, United States
Funding history
About Reflection
Reflection develops open-weight AI models, open-source software for customizing and running agents, AI-factory infrastructure, and related solutions. Its current research emphasizes large language models, reinforcement learning, and agentic reasoning.
Skills
About the Role
You will establish model evaluation and safety operations from the ground up. You will define evaluation frameworks and workflows, embed safety checkpoints into development, prioritize investments, coordinate external safety engagement, report model risks, and improve processes through post-mortems.
Requirements
- 7+ years of experience in technical program management, research operations, or ML engineering
- Experience establishing new functions, teams, or programs
- Knowledge of model evaluation, AI safety, red-teaming, alignment research, and safety regulation
- Knowledge of model behavior, evaluation design, data pipelines, and safety-critical system architecture
- Experience creating programs with ownership, measurable outcomes, and durable processes
- Technical stakeholder and external partner management
Responsibilities
- Build infrastructure for model evaluations and safety
- Define evaluation frameworks, tooling requirements, and operational processes
- Establish model safety workflows, review cadences, and decision frameworks
- Embed safety and evaluation checkpoints in model development and release processes
- Prioritize evaluation science and infrastructure investments
- Coordinate third-party assessments, academic partnerships, and industry safety frameworks
- Report model safety status, evaluation coverage, and open risks
- Champion blameless post-mortems and continuous learning
Benefits
- Equity
- Stock options
- Medical insurance
- Dental insurance
- Vision insurance
- Life insurance
- Annual wellness allowance
- Daily office lunch and dinner
- 22 weeks of paid parental leave
- Unlimited paid time off in the U.S.
- 30 days of vacation in the U.K.
- Visa sponsorship support
- Regular off-sites, happy hours, and team celebrations
