Senior Software Engineer Data Platform

Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.

Series F+0 current maintainers0 active leads
160 Spear Street, Suite 1300, San Francisco, CA 94105, United States
About Databricks

Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.

View jobs by Databricks

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

You will build and operate data-platform tools, including metrics stores, ETL frameworks, pipelines, governance platforms, and telemetry APIs. You will improve infrastructure management and data quality, partner on product direction, and help deliver reliable multi-cloud data systems.

Requirements

  • 6+ years of industry experience
  • 4+ years of technical leadership on large projects involving ETL frameworks, metrics stores, infrastructure management, or data security
  • Experience building, shipping, and operating reliable multi-geo data pipelines at scale
  • Experience with workflow or orchestration frameworks such as Airflow and DBT
  • Experience with large-scale messaging systems such as Kafka or RabbitMQ
  • Cross-functional communication and consensus-building skills
  • Experience with data infrastructure

Responsibilities

  • Design and operate the metrics store
  • Design and operate the cross-company Data Intelligence Platform
  • Develop infrastructure-management tooling across clouds and geographies
  • Design the base ETL framework
  • Build reliable data pipelines
  • Create and evolve APIs for telemetry, debug, feature, and audit event data
  • Partner with engineering teams on long-term product vision and requirements
  • Represent the organization at academic and industrial conferences and events
Senior Software Engineer Data Platform at Databricks | JobStash