Senior Software Engineer, Infrastructure
Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.
Funding history
Investors
About Databricks
Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will own and evolve core infrastructure and observability platforms on the IT Infrastructure team. You will design production-grade AWS infrastructure as code, manage containerized workloads, build CI/CD pipelines, create observable-by-default frameworks, build internal tools and AI plugins, collaborate cross-functionally, and mentor junior engineers.
Requirements
- 5+ years of production-level experience with strong Python proficiency
- Expert-level Terraform or Pulumi
- Hands-on experience with AWS (or Azure/GCP), Kubernetes, Docker
- Experience building and troubleshooting integrations between infrastructure, data pipelines and observability platforms
- Advanced knowledge of GitHub Actions and runners
- Observability experience with Datadog, Prometheus or ELK
- Proficiency with Kafka or messaging queues
- Ability to operate independently with minimal guidance
Responsibilities
- Design and deploy production-grade infrastructure on AWS using Terraform or Pulumi
- Manage and scale containerized workloads using AKS or EKS
- Architect deployment pipelines using GitHub Actions with hosted and self-hosted runners
- Create infrastructure so internal applications have logging and metrics enabled by default
- Build internal CLI tools, AI plugins and automation scripts
- Collaborate with Security, Engineering, Infrastructure and Support stakeholders
- Participate in code reviews, document solutions and failure triage playbooks, and mentor junior engineers
Benefits
- Annual performance bonus eligibility
- Equity eligibility