Senior Software Engineer Infra Agent Systems
Together AIVisit Together AI website
Together AI operates an AI-native cloud platform for open and custom AI models.
San Francisco, United States
About Together AI
Together AI provides production AI infrastructure spanning inference, accelerated compute, model training and fine-tuning, and secure code sandboxes for AI development.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will build production AI agents that diagnose hardware failures, investigate incidents, gather live-system evidence, and assist with remediation. You will also develop the distributed platform behind them, including knowledge graphs, retrieval, orchestration, evaluation, APIs, and operational tooling. You will own services through design, deployment, observability, and production support.
Requirements
- 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms
- Systems design experience and ownership of significant systems through production
- Experience with AI agent systems, knowledge graphs, or search and retrieval systems
- Backend engineering experience with API design, service boundaries, data modeling, and integrations
- Experience with Kubernetes, GitOps, infrastructure as code, and cloud platforms
- Experience with Go, TypeScript, Python, or Rust
Responsibilities
- Design and build production AI agent systems for infrastructure diagnosis, investigation, and remediation
- Build distributed services, orchestration frameworks, knowledge graphs, and retrieval systems
- Develop fleet intelligence systems using telemetry, infrastructure state, operational knowledge, and incident history
- Integrate with observability, incident management, ticketing, inventory, source control, chat, and internal systems through APIs
- Own services from architecture through production operations
- Improve agent performance through evaluations, retrieval improvements, tools, and production feedback
- Turn production learning into reviewed software and automation
Benefits
- Remote work in the UK
