Staff Software Engineer Ray Data
AnyscaleVisit Anyscale website
Anyscale is an AI compute platform built by Ray’s creators for distributed data processing, model training, inference, and related production AI workloads.
San Francisco, United States
About Anyscale
Anyscale provides a managed, multi-cloud platform for building, running, and governing distributed AI workloads with Ray, including data processing, training, and model serving.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design and improve Ray Data systems for performance, scalability, and reliability. You will optimize distributed pipeline execution, build production data-loading and processing solutions, make system-level architecture decisions, and help customers scale AI workloads.
Requirements
- 6+ years building production-grade software, infrastructure, or developer-facing systems
- Strong Python engineering experience
- 6+ years owning core architectural decisions in a distributed data or compute engine
- Experience with distributed systems internals
- Experience reasoning through system-level architectural trade-offs
- Experience with large-scale AI infrastructure
Responsibilities
- Design, build, and improve Ray Data core systems
- Optimize distributed execution across data-pipeline stages
- Build data-loading and processing solutions for training and inference
- Solve distributed execution, scheduling, resource-management, data-partitioning, fault-tolerance, and performance problems
- Make system-level architectural decisions
- Work with customers to solve AI-workload scaling challenges
Benefits
- Stock options
- Healthcare plans with 99% of premiums covered by Anyscale
- 401k retirement plan
- Wellness and education stipend
- Paid parental leave
- Fertility benefits
- Paid time off
- Commute reimbursement
- In-office meals covered
- Health, dental, and vision coverage
- Flexible time off
- Mental health support