Research Scientist - RL Environments
BasetenVisit Baseten website
Baseten is an AI inference platform for deploying, optimizing, and scaling custom, open-source, and fine-tuned models in production.
San Francisco, United States
Funding history
About Baseten
Baseten provides model runtimes, inference infrastructure, developer workflows, and deployment options including managed cloud, self-hosted, and hybrid environments.
Skills
Candidate Availability
About the Role
You will create open RL environments and study how models learn from them. You will design tasks, rewards and verifiers, build methods to generate and calibrate environments at scale, and run RL experiments comparing curricula, task mixtures and reward designs. You will develop robust evaluation methods, work with safety researchers on reward hacking, and release environments, datasets and recipes for others to use.
Requirements
- Depth in reinforcement learning, model evaluation, agent systems, synthetic data, or experimental methodology
- Comfortable writing code to build environments, run experiments and inspect failures
- Evidence of research ability such as a paper, open-source project or strong experimental investigation
- Experience with LLM training is valuable
Responsibilities
- Identify capabilities and failure modes worth studying
- Design task distributions, interactions, rewards and verifiers
- Build methods that scale environment creation while keeping quality
- Run RL experiments to measure learning and transfer
- Develop evaluation methods that separate capability differences from noise and grader errors
- Work with safety researchers on environments that reveal reward hacking and misalignment
- Release environments, datasets, training recipes and research findings
Benefits
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy
- Paid parental leave
- Fertility and family-building stipend through Carrot
- (U.S. only) Company-facilitated 401(k)
