Site Reliability Engineer Platform Infrastructure Foundations
Anyscale is an AI compute platform built by Ray’s creators for distributed data processing, model training, inference, and related production AI workloads.
About Anyscale
Anyscale provides a managed, multi-cloud platform for building, running, and governing distributed AI workloads with Ray, including data processing, training, and model serving.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, build, and scale services that orchestrate Ray clusters across cloud and on-premises environments. You will optimize control-plane components, scheduling, resource management, reliability, performance, observability, accelerator integration, and container image management. You will also provide on-call support and participate in technical reviews.
Requirements
- 3+ years of experience writing production code.
- Experience building and maintaining highly available, scalable, performant distributed systems.
- Experience with AWS, Azure, GCP, and Kubernetes deployments.
- Knowledge of cloud networking, security, and authentication mechanisms.
- Experience with Prometheus and Grafana.
- Proficiency in Go and Python.
- Knowledge of Linux kernel, file systems, and containers.
Responsibilities
- Design, build, and scale services that orchestrate Ray clusters across cloud and on-premises environments.
- Optimize control-plane components for large-scale distributed AI and ML workloads.
- Build scheduling and resource-management systems for heterogeneous compute clusters.
- Develop reliability, performance, scalability, and observability features for Ray workloads.
- Support and optimize GPU and TPU integration.
- Manage container images and dependency resolution for distributed workloads.
- Participate in code reviews, design discussions, and architecture discussions.
- Provide on-call support and troubleshoot infrastructure issues with customer and field teams.
Benefits
- Stock options
- Healthcare plans with 95% of premiums covered by Anyscale
- 401k Retirement Plan
- Wellness & Education Stipend
- Paid Parental Leave
- Fertility Benefits
- Paid Time Off
- Commute reimbursement
- In-office lunch