Senior Network Engineer
Together AI operates an AI-native cloud platform for open and custom AI models.
About Together AI
Together AI provides production AI infrastructure spanning inference, accelerated compute, model training and fine-tuning, and secure code sandboxes for AI development.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, deploy, operate, and maintain global multi-vendor, multi-protocol networks for high-performance AI compute infrastructure. You will troubleshoot network and application connectivity issues, analyze telemetry and packet captures, develop automation, evaluate technologies, establish operational standards, lead technical projects, and partner across infrastructure, systems, security, and application domains.
Requirements
- 8+ years of professional experience designing, building, and supporting large-scale production data center, cloud, service-provider, or high-performance computing networks
- Deep understanding of TCP/IP
- Experience with BGP, OSPF, VXLAN, EVPN, ECMP, and QoS
- Experience with multi-tenant network environments, VRFs, VLANs, overlays, and policy-based segmentation
- Hands-on experience with Arista, Cisco, Juniper, and NVIDIA network platforms
- Troubleshooting experience with Wireshark, tcpdump, MTR, curl, nmap, and Linux networking utilities
- Experience with network automation using Python or Ansible
- Experience with a Git-based software development lifecycle and CI/CD
- Working knowledge of Kubernetes networking
- Foundational knowledge of RDMA networking, RoCE, or InfiniBand
- Experience with cloud networking in AWS, GCP, or Azure
- Strong Linux administration and troubleshooting skills
Responsibilities
- Design, deploy, operate, and maintain global multi-vendor multi-protocol networks supporting high-performance AI compute infrastructure
- Troubleshoot complex network and application-connectivity issues and drive them through resolution
- Analyze telemetry, packet captures, logs, and performance data to identify degradation, congestion, packet loss, and capacity constraints
- Participate in architecture and design reviews
- Develop and maintain automation, validation, and operational tooling
- Evaluate network hardware, software, optics, and emerging technologies
- Establish standards and operational best practices for network design, deployment, monitoring, change management, and incident response
- Lead projects addressing complex technical challenges
- Partner with infrastructure, systems, security, and application teams to troubleshoot cross-domain issues
Benefits
- Startup equity
- Health insurance