Software Engineer ML Developer Experience

35 minutes agoLeadSalary: 226K - 283KSan Francisco, USA Hybrid Full Time Engineering Jobs by Anyscale

Anyscale

Anyscale is an AI compute platform built by Ray’s creators for distributed data processing, model training, inference, and related production AI workloads.

Series C Company intelligence

San Francisco, United States

Funding history

Series C (additional financing) ($99M)Series C ($100M)Series B ($40M)

Investors

NEA 11.2 Capital Addition The House Fund Amplify Partners

About Anyscale

Anyscale provides a managed, multi-cloud platform for building, running, and governing distributed AI workloads with Ray, including data processing, training, and model serving.

View jobs by Anyscale

Skills

Api Authentication Cli Cloud Infrastructure Data Catalog Debugging Distributed System Experiment Tracking Lineage Machine Learning Mcp Mlflow Mlops Observability Opentelemetry Production Serving Pytorch Ray Sdk

Candidate Availability

Hybrid · San Francisco · Required

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will build developer tooling and MLOps capabilities across CLI, SDK, API, MCP, cloud infrastructure, and the Ray runtime. You will improve distributed execution, debugging, observability, production serving, and highly available backend services while working with users to scope and iterate on solutions.

Requirements

Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
5+ years of experience writing production code
Knowledge of algorithms, data structures, and system design
Experience with PyTorch, MLflow, data catalogs, or similar machine learning tooling
Experience building and operating highly available production services
Experience shipping developer-facing tools

Responsibilities

Build developer tooling and MLOps capabilities on Ray
Develop CLI, SDK, API, and MCP interfaces
Improve distributed execution, dependency management, authentication, workload submission, and debugging
Build tools for data preparation, fine-tuning, evaluation, serving, experiment tracking, and lineage
Build model registration, deployment workflows, benchmarking, and service metrics
Surface observability across user and agent-facing interfaces
Design integrations using OpenAI-compatible APIs and OpenTelemetry
Design and operate highly available backend services

Benefits

Stock options
Healthcare plans with 99% of premiums covered
401k retirement plan
Wellness and education stipend
Paid parental leave
Fertility benefits
Paid time off
Commute reimbursement
In-office meals covered