Senior Software Engineer Ingestion Core Team
Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.
Funding history
Investors
About Databricks
Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will build distributed platform systems that ingest high-volume structured and unstructured data from cloud storage, databases, and file sources. You will optimize streaming workloads for throughput, cost, latency, reliability, and scale; build ingestion observability; apply ML techniques; and collaborate on RAG, AI-agent, and Agentic SDK capabilities.
Requirements
- 5+ years of production coding experience in Java, Scala, Go, C++, or Python
- Experience architecting, developing, and deploying large-scale distributed and asynchronous systems
- Experience with distributed systems, streaming, Spark, databases, data processing, or change data capture
- Experience operating systems where scale, throughput, latency, reliability, and cost matter
- Experience using AI tools and defining effective evaluations
Responsibilities
- Build distributed infrastructure for streaming ingestion, incremental processing, and replication
- Reduce ingestion latency and cost while increasing throughput
- Design and optimize streaming and distributed workloads
- Apply ML techniques to optimize streaming workloads
- Build customer-facing and internal monitoring and observability capabilities
- Collaborate on RAG and AI-agent use cases
- Build Agentic SDKs with strong evaluations
Benefits
- Annual performance bonus eligibility
- Equity eligibility