Senior Software Engineer Together Cloud Infrastructure
Together AIVisit Together AI website
Together AI operates an AI-native cloud platform for open and custom AI models.
San Francisco, United States
About Together AI
Together AI provides production AI infrastructure spanning inference, accelerated compute, model training and fine-tuning, and secure code sandboxes for AI development.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will build and maintain secure, highly available backend services and operators for data-center hardware management. You will develop IaaS and storage systems, observability stacks, node lifecycle automation, tools, documentation, and fault-tolerance testing. You will also perform architecture and research work for decentralized AI workloads.
Requirements
- 5+ years of professional software development experience
- Proficiency in a backend programming language, preferably Golang
- 5+ years of experience writing high-performance, well-tested production code
- Experience building and operating distributed microservice architectures on AWS, Azure, or GCP
- Systems knowledge across compute, networking, storage, concurrency, memory management, and I/O
- Experience with Terraform, Ansible, Prometheus, Grafana, GitHub Actions, and ArgoCD
Responsibilities
- Design, build, and maintain backend services and operators for hardware management
- Build IaaS software for GB200 data centers
- Work on high-performance object storage for pretraining datasets
- Build observability stacks and automated node-lifecycle management
- Perform architecture and research work for decentralized AI workloads
- Work on the core open-source platform
- Create services, tools, developer documentation, and testing frameworks
Benefits
- Hybrid working with two days per week in the Amsterdam office