Staff Software Engineer - AI Gateway
Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.
Funding history
Investors
About Databricks
Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.
Skills
Candidate Availability
About the Role
You will build the control plane that every AI request passes through, including the routing layer that selects the best model for each request based on quality, cost, latency, availability and remaining budget. You will improve the reliability, latency and efficiency of distributed AI workloads and collaborate with research, platform, infra and AI/ML teams.
Requirements
- 8+ years of experience in backend or infrastructure engineering
- Strong programming skills in Scala or Go
- Experience with distributed systems, high-throughput APIs, or cloud-native infrastructure
- Familiarity with service-oriented architecture, deployment pipelines, and system observability
- Strong product and ownership mindset
Responsibilities
- Build the routing layer that picks the right model for each request across quality, cost, latency, availability, and remaining budget
- Improve reliability, latency, and efficiency of distributed AI workloads
- Collaborate with research, platform, infra, and AI/ML teams to deliver end-to-end experiences
- Shape how developers and data scientists build and interact with AI on Databricks
Benefits
- Annual performance bonus eligibility
- Equity eligibility
