Software Engineer Infrastructure
Anyscale is an AI compute platform built by Ray’s creators for distributed data processing, model training, inference, and related production AI workloads.
About Anyscale
Anyscale provides a managed, multi-cloud platform for building, running, and governing distributed AI workloads with Ray, including data processing, training, and model serving.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, build, and scale services that orchestrate Ray clusters across cloud and on-premises environments. You will optimize control-plane components, build scheduling and resource-management systems, improve workload reliability and observability, support accelerator integration, and help troubleshoot infrastructure issues.
Requirements
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
- 3+ years of experience writing production code
- Experience building highly available, scalable, and performant distributed systems
- Expertise in AWS, Azure, GCP, and Kubernetes deployments
- Understanding of cloud networking, security, and authentication
- Familiarity with Prometheus and Grafana
- Proficiency in Go and Python
- Knowledge of Linux kernel, file systems, and containers
Responsibilities
- Design, build, and scale services that orchestrate Ray clusters
- Optimize control-plane components for distributed AI and ML workloads
- Build scheduling and resource-management systems for heterogeneous compute clusters
- Improve workload reliability, performance, scalability, and observability
- Support accelerator integration
- Manage container images and dependencies for distributed workloads
- Participate in code reviews and architecture discussions
- Provide on-call support and troubleshoot infrastructure issues
Benefits
- Stock options
- Healthcare plans with 99% of premiums covered
- 401k retirement plan
- Wellness and education stipend
- Paid parental leave
- Fertility benefits
- Paid time off
- Commute reimbursement
- In-office meals covered