Engineering Manager Runtime Fabric

Baseten is an AI inference platform for deploying, optimizing, and scaling custom, open-source, and fine-tuned models in production.

San Francisco, United States
About Baseten

Baseten provides model runtimes, inference infrastructure, developer workflows, and deployment options including managed cloud, self-hosted, and hybrid environments.

View jobs by Baseten

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will lead systems engineers and set the technical direction for container runtime and storage infrastructure. You will guide work on containerd, runc, GPU-aware isolation, caching and model delivery, contribute to open source, and coordinate infrastructure priorities with stakeholders.

Requirements

  • Engineering management
  • Linux
  • containerd
  • runc
  • OCI Runtime Spec
  • Linux namespace
  • cgroup
  • Go
  • C++
  • Distributed storage
  • Content-addressable storage
  • Caching
  • Container image
  • Technical communication

Responsibilities

  • Recruit, hire, coach, and develop systems engineers
  • Define the long-term vision and roadmap for container runtime and storage infrastructure
  • Guide extensions to containerd, runc, and OCI projects for AI inference
  • Oversee the architecture and evolution of the Baseten Delivery Network
  • Expand delivery infrastructure to images, checkpoints, and deployment artifacts
  • Provide technical oversight for GPU-aware isolation mechanisms
  • Maintain end-to-end ownership of container startup performance
  • Champion contributions to the open-source containerd ecosystem
  • Advocate for Runtime Fabric and communicate technical trade-offs to leadership

Benefits

  • Meaningful equity
  • Medical, dental, and vision insurance for U.S. employees and dependents
  • Flexible PTO
  • Company-wide winter break
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • Company-facilitated 401(k) for U.S. employees
Engineering Manager Runtime Fabric at Baseten | JobStash