Staff Backend Software Engineer (AI Platform)
Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.
Funding history
Investors
About Databricks
Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will shape the product experience and foundational infrastructure of Databricks Model Serving. You will design and build high-throughput, low-latency inference systems across CPU and GPU workloads, define the technical roadmap with leadership, drive architectural decisions, contribute to serving components such as container builds, deployment, routing, caching, observability and autoscaling, and mentor engineers.
Requirements
- 10+ years building and operating large-scale distributed systems
- Deep expertise in model serving, inference systems, and related infrastructure
- Strong foundation in algorithms, data structures, and system design
- Proven ability to deliver complex high-impact initiatives
- Experience leading architecture for large-scale CPU/GPU inference systems
- Strong communication skills
- Strategic and product-oriented mindset
- Passion for mentoring engineers
Responsibilities
- Design and implement core systems and APIs for Databricks Model Serving
- Partner with leadership to define the technical roadmap and long-term architecture
- Drive architectural decisions to optimize performance, throughput, autoscaling, and efficiency for CPU and GPU workloads
- Contribute to serving infrastructure components including routing, caching, observability, and autoscaling
- Collaborate cross-functionally to translate customer needs into reliable systems
- Lead initiatives improving latency, availability, and cost-effectiveness
- Establish best practices for code quality, testing, and operational readiness and mentor engineers
- Represent the team in cross-organizational technical discussions
Benefits
- Annual performance bonus eligibility
- Equity eligibility