Senior Designated Support Engineer Apache Spark
Databricks is a data and AI platform that lets organizations build analytics, AI agents, and applications on a unified, governed lakehouse.
Funding history
Investors
About Databricks
Data engineers, analysts, and AI teams use Databricks to process large datasets, build reliable pipelines, and train models on a single governed platform. Users can run SQL analytics, serve ML predictions in real time, and deploy AI agents grounded in enterprise data. Its open lakehouse architecture provides consistent security and governance across analytical and operational workloads.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will provide high-touch support to strategic customers, investigate complex Apache Spark and data engineering issues, and manage critical support cases through resolution. You will advise on data engineering practices, coordinate with internal stakeholders, identify optimization opportunities, and help customers effectively use support tools and processes.
Requirements
- Data engineering
- Data pipeline
- Python
- Java
- Scala
- Apache Spark
- Spark UI
- Thread dump
- Driver
- Executor
- Memory management
- DAG
- Catalyst Optimizer
- Tungsten
- Troubleshooting
- Data skew
- Out-of-memory error
- Serialization
- Broadcast join
- Project management
- Distributed computing
- Big data
- Customer support
- Technical account management
Responsibilities
- Manage strategic accounts and provide high-touch support
- Investigate complex Apache Spark and data engineering issues
- Analyze Spark UI thread dumps and driver and executor logs
- Advise customers on ETL and ELT optimization data modeling and Lakehouse architecture
- Project-manage open support cases through closure
- Coordinate customer escalations with engineering product subject-matter experts and account teams
- Engage on business-impacting situations and restore customer functionality
- Review customer cases for trends and optimization opportunities
- Advocate for customers and lead stakeholder roundtables
- Help customers use support processes and tools effectively