Senior Software Engineer Data AI Observability
Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.
Funding history
Investors
About Databricks
Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will lead the technical development of observability product milestones from requirements through operation and iteration. You will build data infrastructure that processes large volumes of workload data, improve pipeline scalability and cost, integrate with data warehousing tools, and mentor engineers.
Requirements
- 6+ years of production-level experience with Java, Scala, Python, C++, or a similar language
- Experience with AWS, Azure, GCP, Docker, or Kubernetes
- Proven experience architecting, developing, deploying, and operating large-scale distributed systems
- Software engineering maturity in security, correctness, engineering excellence, and operational excellence
- Experience building platforms for software teams
- Cross-functional skills
Responsibilities
- Develop reliable and timely observability systems
- Enable framework teams to publish data to customers
- Lead observability roadmap milestones
- Contribute to product vision and requirements
- Mentor engineers
- Optimize large data pipeline scalability and cost
- Drive integrations with data warehousing tools and services