Senior Software Engineer Database Engine Internals

Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.

160 Spear Street, Suite 1300, San Francisco, CA 94105, United States
About Databricks

Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.

View jobs by Databricks

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will design and implement next-generation query engine and structured storage systems. You will work on query compilation and optimization, distributed execution and scheduling, vectorized execution, security, resource management, transaction coordination, storage structures, and physical data optimization.

Requirements

  • Knowledge of database systems, storage systems, distributed systems, language design, or performance optimization
  • Experience working toward a multi-year vision with incremental deliverables
  • Focus on delivering customer value and impact
  • 5+ years of experience working in a related system is preferred
  • PhD in databases or distributed systems is optional

Responsibilities

  • Design and implement next-generation query engine and structured storage systems
  • Develop query compilation and optimization capabilities
  • Develop distributed query execution and scheduling
  • Build vectorized execution engine capabilities
  • Improve data security, resource management, and transaction coordination
  • Develop efficient storage structures and automatic physical data optimization
Senior Software Engineer Database Engine Internals at Databricks | JobStash