Senior Data Engineer - Application
Skills
About the Role
You will design and build robust data pipelines on cloud environments. You will design and develop microservices in Java that run on Kubernetes and AWS. You will develop end to end ETL workflows including data ingestion and transformation across multiple data sources. You will enrich financial data through third party data integrations FIX CSV JSON and other formats including market data and reference data. You will pursue an AI first solution approach and may code using AI agents such as Claude in accordance with architectural and coding conventions. You will plan and communicate data integrations to enable insights. You will address data duplication velocity schema adherence and versioning high availability data governance and more.
Requirements
- BSc in Computer Sciences
- 3+ years of experience with Java
- 5+ years in data engineering and data pipeline development on high-volume low-latency production environments
- Experience with monitoring systems Prometheus Grafana
- Experience with data engineering cloud technologies including Apache Airflow Kubernetes ClickHouse Snowflake Redis caching technologies and Kafka
- Experience with relational non relational and time series databases proficient in SQL and query optimization
- Experience designing infrastructure at scale to maintain high availability SLAs
- Curiosity ability to work independently and proactively identify solutions
- Excellent verbal and written communication skills in a remote environment and ability to work cross functionally
- Experience in fintech crypto or trading industries and familiarity with FIX and market data is a plus
Responsibilities
- Design and implement customer facing integrations of various asset types into the data pipelines
- Design and develop the data team micro services Java services running on Kubernetes and in AWS
- Develop design and maintain end to end ETL workflows including data ingestion and transformation logic across multiple data sources
- Enrich financial data through third party data integrations FIX CSV JSON and other formats including market data and reference data
- Adopt an AI first solution approach and code using AI agents such as Claude in accordance with architectural and coding conventions
- Plan and communicate integrations with other teams that consume the data and use it to create insights
- Collaborate with product and customer facing teams
- Tackle data duplication velocity schema adherence and schema versioning high availability data governance and more