We launched recruiters.rip, let your AI apply for you. First month free with code onemonthfree

Software Engineer, Cloud Platform

Baseten is an AI inference platform for deploying, optimizing, and scaling custom, open-source, and fine-tuned models in production.

Series F+Recently funded
San Francisco, United States
About Baseten

Baseten provides model runtimes, inference infrastructure, developer workflows, and deployment options including managed cloud, self-hosted, and hybrid environments.

View jobs by Baseten

Skills

About the Role

You'll own the Kubernetes fleet that runs production AI workloads, turning manual cluster operations into reliable, repeatable systems. You'll build APIs, controllers, and automation, bring new cloud and GPU providers online, and roll out configuration and upgrades safely, owning projects from design through production.

Requirements

  • Experience building and owning production infrastructure software or distributed systems
  • Strong programming skills in Go or another systems or backend language
  • Deep experience with Kubernetes infrastructure, including developing controllers or operators
  • Practical experience with infrastructure as code and GitOps tools such as Terraform and Flux or Argo CD
  • Strong Linux, networking, and debugging fundamentals
  • Ability to turn ambiguous operational problems into maintainable software and communicate design tradeoffs clearly

Responsibilities

  • Design, build, and operate services, APIs, and Kubernetes controllers that automate cluster lifecycle management
  • Develop reusable Terraform modules and GitOps configuration across cloud and GPU infrastructure providers
  • Make infrastructure changes safe through validation, staged rollouts, clear ownership boundaries, and tested recovery paths
  • Build observability into automation so engineers can understand progress, diagnose failures, and retry operations safely
  • Partner with infrastructure and workload teams to define platform interfaces and resolve operational pain points

Benefits

  • Equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
Software Engineer, Cloud Platform at Baseten | JobStash