We launched recruiters.rip, let your AI apply for you. First month free with code onemonthfree

Sr. Software Engineer - AI Gateway

Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.

Series F+0 current maintainers0 active leads
160 Spear Street, Suite 1300, San Francisco, CA 94105, United States
About Databricks

Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.

View jobs by Databricks

Skills

Candidate Availability

About the Role

You will build infrastructure that powers flagship AI offerings like MLflow, AI Gateway, Databricks Apps, Agent Framework, Agent Bricks and Foundation Model APIs. You will improve reliability, latency and efficiency of distributed AI workloads and collaborate with platform, infra and ML teams.

Requirements

  • 5+ years of backend or infrastructure engineering experience
  • Strong programming skills in Scala, Go or Python
  • Experience with distributed systems, scalable APIs or cloud-native infrastructure
  • Familiarity with service-oriented architecture, deployment pipelines and observability
  • Strong product and ownership mindset

Responsibilities

  • Build infrastructure powering MLflow, AI Gateway, Databricks Apps, Agent Framework, Agent Bricks and Foundation Model APIs
  • Improve reliability, latency and efficiency of distributed AI workloads
  • Collaborate with platform, infra and ML teams to deliver end-to-end experiences
  • Shape how developers and data scientists build and interact with AI on Databricks

Benefits

  • Annual performance bonus eligibility
  • Equity
Sr. Software Engineer - AI Gateway at Databricks | JobStash