Staff Software Engineer AI Compute
Together AIVisit Together AI website
Together AI operates an AI-native cloud platform for open and custom AI models.
Series CRecently funded
San Francisco, United States
About Together AI
Together AI provides production AI infrastructure spanning inference, accelerated compute, model training and fine-tuning, and secure code sandboxes for AI development.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will set the technical direction and build core components of a global AI cloud platform. You will own GPU and network virtualization, architect IaaS services and distributed control planes, improve fault tolerance, lead cross-team design decisions, and mentor engineers.
Requirements
- 7+ years of professional software development experience
- Expert proficiency in at least one backend language
- Experience architecting large distributed systems from inception to production
- Experience building and operating globally distributed microservice architectures
- Systems knowledge across compute, networking, and storage
- Technical leadership, mentoring, and design-review experience
- Infrastructure automation with Terraform and Ansible
- Observability with Prometheus and Grafana
- CI/CD with GitHub Actions and ArgoCD
Responsibilities
- Own the GPU and network virtualization stack
- Architect and roadmap in-data-center IaaS services
- Design GPU scheduling and the global management plane
- Architect monitoring and automated remediation for fault tolerance
- Set technical direction across teams
- Mentor senior and junior engineers
- Create testing frameworks, tools, and developer documentation