Senior Staff Software Engineer Lakeflow Pipelines Datasets
Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.
Maintainer signals as of 9/23/2026
Funding history
Investors
About Databricks
Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will set the technical direction for how data pipelines are defined, optimized, executed, and operated. You will architect scalable declarative pipeline and materialized-view systems, diagnose and optimize production clusters, translate research into production systems, and lead complex cross-team technical initiatives.
Requirements
- 10+ years of experience building, operating, and evolving large-scale distributed systems in production
- Expertise in database internals, storage systems, distributed computing, streaming systems, language or API design, or performance engineering
- Experience executing a multi-year technical vision through incremental milestones
- Algorithmic foundations
- Experience building alignment across teams and driving initiatives through customer adoption
- BS, MS, or PhD in Computer Science or a related field, or equivalent experience
Responsibilities
- Architect and deliver a scalable, fault-tolerant platform for declarative pipelines and materialized views
- Turn large-scale technical challenges into incremental execution plans
- Bring research and development ideas into production systems
- Diagnose, debug, and optimize large production clusters
- Shape technical strategy from design through delivery
- Drive complex multi-team technical initiatives
Benefits
- Annual performance bonus eligibility
- Equity eligibility