Senior Software Engineer Together Cloud Infrastructure
Together AIVisit Together AI website
Together AI operates an AI-native cloud platform for open and custom AI models.
San Francisco, United States
About Together AI
Together AI provides production AI infrastructure spanning inference, accelerated compute, model training and fine-tuning, and secure code sandboxes for AI development.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will build and maintain secure, highly available backend services and operators that automate data-center hardware management. You will develop IaaS, GPU scheduling, management-plane, storage, and observability systems. You will create tools, documentation, and testing frameworks while researching decentralized AI workloads and supporting reliable production infrastructure.
Requirements
- 5+ years of professional software development experience
- Proficiency in a backend programming language, preferably Golang
- Experience delivering high-performance, well-tested production code and owning large-scale projects
- Experience building and operating distributed microservice architectures on AWS, Azure, or GCP
- Systems knowledge across compute, networking, storage, concurrency, memory management, and I/O
- Experience with Terraform, Ansible, Prometheus, Grafana, CI/CD, GitHub Actions, or ArgoCD
Responsibilities
- Design, build, and maintain backend services and operators for hardware management
- Build IaaS software for GB200 data centers
- Build distributed GPU scheduling and a global management plane
- Develop infrastructure for inference, reinforcement learning, fine-tuning, and cloud customers
- Build capacity-scaling and capacity-onboarding systems
- Work on high-performance object storage
- Build observability and automated node-lifecycle systems
- Perform architecture and research work for decentralized AI workloads
- Create services, tools, developer documentation, and testing frameworks
Benefits
- Startup equity
- Health insurance
- Remote-work flexibility
