Staff Software Engineer Platform Infrastructure Foundations
Anyscale is an AI compute platform built by Ray’s creators for distributed data processing, model training, inference, and related production AI workloads.
About Anyscale
Anyscale provides a managed, multi-cloud platform for building, running, and governing distributed AI workloads with Ray, including data processing, training, and model serving.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will define the infrastructure roadmap, optimize control-plane components, and establish reliability, scalability, and observability standards. You will lead accelerator and container-management strategy, resolve technical debt, mentor engineers, and partner with ML and customer-facing teams on infrastructure foundations.
Requirements
- 5+ years of experience writing production code and leading complex distributed systems projects
- Experience designing and maintaining highly available, scalable, secure cloud-native platforms
- Deep Kubernetes deployment and container-orchestration expertise
- Advanced knowledge of Linux kernel, networking, and operating system foundations
- Mastery of Go and Python
- Experience mentoring senior engineers and navigating technical trade-offs
Responsibilities
- Define and drive the technical roadmap for Ray-cluster orchestration services
- Lead design and optimization of control-plane components
- Establish reliability, scalability, and observability standards
- Direct accelerator integration and container-management strategy
- Lead architecture discussions and resolve technical debt
- Mentor engineers and influence technical direction
- Partner with ML experts and customer-facing teams
Benefits
- Stock options
- Healthcare plans with 99% of premiums covered by Anyscale
- 401k retirement plan
- Wellness and education stipend
- Paid parental leave
- Fertility benefits
- Paid time off
- Commute reimbursement
- In-office meals covered
- Health, dental, and vision coverage
- Flexible time off
- Mental health support