Staff Software Engineer Streaming
Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.
Funding history
Investors
About Databricks
Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will set the technical vision for Spark Structured Streaming across open-source and platform components. You will design core engine capabilities, improve latency and throughput, guide architecture and technical-debt decisions, raise production quality, drive adoption, and mentor engineers.
Requirements
- BS or higher degree in Computer Science or a related technical field, or equivalent practical experience.
- 8+ years building related systems, including big-data ecosystems, Apache Spark, or database internals.
- Knowledge of database systems, storage systems, distributed systems, language design, or performance optimization.
- Experience delivering features with operational excellence and engineering quality.
- Ability to work cross-functionally with product management and customers.
Responsibilities
- Set and drive the technical vision for Spark Structured Streaming.
- Design and build core engine capabilities, including state management and new operators.
- Improve engine architecture, latency, throughput, and production operability.
- Drive stream-processing adoption across the product portfolio.
- Guide long-term architecture and technical-debt decisions.
- Mentor and technically lead engineers.
Benefits
- Annual performance bonus eligibility.
- Equity eligibility.