Agent Post-Training Frontier Evals and Environments Research

Skills

About the Role

You will create ambitious RL environments that measure frontier model capabilities, skills, and behaviors. You will develop automated model-behavior exploration methods, study evaluation measurement quality, support major training runs, design continuous-evaluation systems, and build self-improvement loops for model understanding.

Requirements

• Machine learning
• Software engineering
• Systems
• Statistics
• LLMs
• RL
• RLHF/RLAIF
• Post-training
• Evaluations
• Graders
• Synthetic data
• Model training
• Coding agents
• Tool-using agents
• Production ML systems

Responsibilities

• Create RL environments to test model capabilities, skills, and behaviors
• Develop methodologies for automatically exploring model behavior
• Study scalability, reliability, and variance in evaluation methodology
• Help steer large training runs
• Design systems and processes for continuous evaluation
• Build self-improvement loops to automate model understanding

Benefits

• Medical, dental, and vision insurance with employer Health Savings Account contributions
• Pre-tax Health FSA, Dependent Care FSA, and commuter accounts
• 401(k) retirement plan with employer match
• Paid parental, medical, and caregiver leave
• Flexible PTO or up to 15 days of annual PTO, depending on exemption status
• 13+ paid holidays, coordinated office closures, and paid sick or safe time
• Mental health and wellness support
• Employer-paid basic life and disability coverage
• Annual learning and development stipend
• Daily office meals and eligible meal-delivery credits
• Relocation support for eligible employees
• Charitable donation matching and wellness stipends may be provided
• Equity
• Performance-related bonuses for eligible employees