Senior Staff Software Engineer AI Runtime
Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.
Funding history
Investors
About Databricks
Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will drive architecture and long-term technical direction for AI training infrastructure. You will define reliability and observability strategy, solve multi-node training problems, improve training efficiency, and shape the developer experience. You will work with research, product, and customers on technical decisions, mentor engineers, and raise engineering standards.
Requirements
- 15+ years of experience in large-scale distributed systems with depth in GPU training, high-performance computing, or ML systems
- Train large models with FSDP, DeepSpeed, or Megatron and use parallelism strategies
- Understand GPU performance, accelerator architecture, high-speed interconnects, and kernels
- Understand checkpointing, failure detection, and automatic recovery
- Have experience building and running multi-tenant cloud platforms as products
- Set technical direction across teams and deliver business impact
- Have a BS in Computer Science or a related field; MS or PhD preferred
Responsibilities
- Drive architecture and long-term technical direction for AI training infrastructure
- Define reliability and observability strategy
- Shape the developer experience for AI training
- Solve multi-node training problems including orchestration, GPU scheduling, data loading, and checkpointing
- Improve training efficiency across model architectures and GPU accelerators
- Work with research, product, and customers on technical decisions
- Champion engineering excellence and mentor engineers
Benefits
- Annual performance bonus eligibility
- Equity eligibility