Member of Technical Staff ML Platform
RunwayVisit Runway website
Runway is an AI company building generative media, developer, and robotics products on top of its real-world intelligence and general world models.
Distributed
Funding history
About Runway
Runway provides a cloud creative suite for generating and editing video, images, and audio; an API platform for developers; and a robotics toolkit for policy inference, simulation, and synthetic data generation powered by its GWM-1 general world model.
Skills
About the Role
You will build systems for generating, annotating, scoring, tracking, and reporting model evaluations. You will define reliable evaluation standards, work with research teams, develop internal tools and data systems, and support adoption across model training and production serving.
Requirements
- 5+ years of experience building production ML infrastructure or data platforms
- Experience with evaluation, experimentation, or benchmarking systems
- Strong Python and PyTorch skills
- Experience running batch GPU workloads on Kubernetes
- Experience with data pipelines and storage for media or model outputs
- Knowledge of versioning and reproducibility
- Knowledge of experimental statistics
- Experience building internal tools from command line to browser
- Knowledge of the model development lifecycle
Responsibilities
- Own the model-evaluation platform end to end
- Build systems to generate, annotate, review, and adapt evaluations at scale
- Define evaluation CLIs, APIs, GUIs, and storage layers
- Gather measurement needs from research teams and generalize solutions into the platform
- Set standards for reproducibility, metrics, reporting, and decision readiness
- Support platform adoption across training and production model serving
- Contribute to ML Platform tools and systems