We launched recruiters.rip, let your AI apply for you. First month free with code onemonthfree

Research Scientist - RL Environments

Baseten is an AI inference platform for deploying, optimizing, and scaling custom, open-source, and fine-tuned models in production.

Series F+Recently funded0 current maintainers0 active leads
San Francisco, United States
About Baseten

Baseten provides model runtimes, inference infrastructure, developer workflows, and deployment options including managed cloud, self-hosted, and hybrid environments.

View jobs by Baseten

Skills

Candidate Availability

About the Role

You will create open RL environments and study how models learn from them. You will design tasks, rewards and verifiers, build methods to generate and calibrate environments at scale, and run RL experiments comparing curricula, task mixtures and reward designs. You will develop robust evaluation methods, work with safety researchers on reward hacking, and release environments, datasets and recipes for others to use.

Requirements

  • Depth in reinforcement learning, model evaluation, agent systems, synthetic data, or experimental methodology
  • Comfortable writing code to build environments, run experiments and inspect failures
  • Evidence of research ability such as a paper, open-source project or strong experimental investigation
  • Experience with LLM training is valuable

Responsibilities

  • Identify capabilities and failure modes worth studying
  • Design task distributions, interactions, rewards and verifiers
  • Build methods that scale environment creation while keeping quality
  • Run RL experiments to measure learning and transfer
  • Develop evaluation methods that separate capability differences from noise and grader errors
  • Work with safety researchers on environments that reveal reward hacking and misalignment
  • Release environments, datasets, training recipes and research findings

Benefits

  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)