Software Engineer Training Infrastructure

Baseten is an AI inference platform for deploying, optimizing, and scaling custom, open-source, and fine-tuned models in production.

San Francisco, United States
About Baseten

Baseten provides model runtimes, inference infrastructure, developer workflows, and deployment options including managed cloud, self-hosted, and hybrid environments.

View jobs by Baseten

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will architect and develop infrastructure for ML training workloads. You will own scheduling, storage, networking, reliability, and observability; develop training schedulers and continuous-learning systems; collaborate with research engineers and SRE teams; make architectural decisions; mentor junior engineers; and shape the infrastructure roadmap.

Requirements

  • Bachelor's degree or higher in Computer Science or a related field
  • 5+ years of experience
  • Proficiency in Go
  • Deep expertise with Kubernetes in production
  • Advanced understanding of distributed systems and performance tuning
  • Experience designing observability systems
  • Experience with ML or AI workloads and MLOps platforms

Responsibilities

  • Design scalable ML training infrastructure
  • Translate training requirements into technical solutions
  • Design a global training scheduler
  • Design reinforcement learning systems and continuous learning pipelines
  • Improve system reliability and development velocity
  • Partner with SRE and capacity teams
  • Make architectural decisions balancing performance and reliability
  • Lead technical discussions and mentor junior engineers
  • Contribute to technical strategy and the infrastructure roadmap

Benefits

  • Meaningful equity
  • 100% medical, dental, and vision insurance coverage for U.S. employees and dependents
  • Flexible PTO
  • Company-wide Winter Break
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • Company-facilitated 401(k) for U.S. employees
Software Engineer Training Infrastructure at Baseten | JobStash