Senior Software Engineer, Data Platform
Skills
About the Role
You will build and operate highly reliable data services that integrate with multiple blockchains, develop complex ETL pipelines to process petabyte-scale structured and unstructured data in real time, and design data models optimized for sub-second query latency. You will deploy, monitor, and tune large database clusters for performance and high availability, automate scaling and operational tasks, and create observability and monitoring solutions. You will collaborate with data scientists, backend engineers, and product managers to implement data models and pipelines that power product features and analytics.
Requirements
- Bachelor's degree or equivalent in Computer Science or related field
- 5+ years of hands-on experience architecting distributed systems and shipping production services
- Strong programming skills in Python
- Proficiency with SQL or SparkSQL
- Experience with data stores such as Iceberg, Trino, BigQuery, StarRocks, and Citus
- Familiarity with orchestration tools like Airflow and DBT
- Experience with data processing and streaming technologies such as Spark, Kafka, and Flink
- Experience deploying and monitoring infrastructure on public cloud using Docker, Terraform, Kubernetes, and Datadog
- Proven ability to load, query, and transform very large datasets
Responsibilities
- Build reliable data services to integrate with multiple blockchains
- Develop complex ETL pipelines that process petabyte-scale structured and unstructured data in real time
- Design and architect data models for optimal storage and sub-second retrieval
- Deploy, monitor, and tune large database clusters for performance and high availability
- Automate operational tasks and scaling workflows
- Collaborate with data scientists, backend engineers, and product managers to implement data models and pipelines
- Create observability dashboards and monitoring for data systems
- Optimize pipelines and systems for faster iteration and reduced operational dependency
Benefits
- Eligibility to participate in TRM’s equity plan