Senior Software Engineer Together Cloud Infrastructure

Together AI operates an AI-native cloud platform for open and custom AI models.

San Francisco, United States
About Together AI

Together AI provides production AI infrastructure spanning inference, accelerated compute, model training and fine-tuning, and secure code sandboxes for AI development.

View jobs by Together AI

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will build and maintain secure, highly available backend services and operators that automate data-center hardware management. You will develop IaaS, GPU scheduling, management-plane, storage, and observability systems. You will create tools, documentation, and testing frameworks while researching decentralized AI workloads and supporting reliable production infrastructure.

Requirements

  • 5+ years of professional software development experience
  • Proficiency in a backend programming language, preferably Golang
  • Experience delivering high-performance, well-tested production code and owning large-scale projects
  • Experience building and operating distributed microservice architectures on AWS, Azure, or GCP
  • Systems knowledge across compute, networking, storage, concurrency, memory management, and I/O
  • Experience with Terraform, Ansible, Prometheus, Grafana, CI/CD, GitHub Actions, or ArgoCD

Responsibilities

  • Design, build, and maintain backend services and operators for hardware management
  • Build IaaS software for GB200 data centers
  • Build distributed GPU scheduling and a global management plane
  • Develop infrastructure for inference, reinforcement learning, fine-tuning, and cloud customers
  • Build capacity-scaling and capacity-onboarding systems
  • Work on high-performance object storage
  • Build observability and automated node-lifecycle systems
  • Perform architecture and research work for decentralized AI workloads
  • Create services, tools, developer documentation, and testing frameworks

Benefits

  • Startup equity
  • Health insurance
  • Remote-work flexibility
Senior Software Engineer Together Cloud Infrastructure at Together AI | JobStash