Senior Software Engineer (Streaming Data Pipeline)
Skills
About the Role
You will design and own a high throughput streaming data pipeline that ingests on chain events with strong delivery guarantees. You will build stateful streaming jobs and operate distributed messaging at scale. You will transform raw node output into a canonical on chain data model for APIs and analytics and integrate external data where needed. You will embed robust observability and automated recovery so systems self heal under load. You will deploy containerized microservices via modern CI CD and infrastructure automation in managed cloud environments. You will contribute through design and code reviews and you will ship secure scalable software.
Requirements
- Bachelor’s degree in CS or related field or equivalent experience
- 5+ years in backend data infra engineering including multi year experience running real time streaming systems
- Deep experience with distributed streaming and pub sub platforms with strong grasp of watermarking checkpointing back pressure and event vs processing time
- Proficiency in a statically typed systems language plus strong SQL and API design skills with proven pipeline design and CDC data sink experience
- Strength in observability SLOs and performance tuning including latency scalability availability and efficiency
- Familiarity with blockchain data lifecycles token standards event ingestion traces common data schemas market data pipelines and modern analytical databases
Responsibilities
- Design and own a high throughput ingestion pipeline for on chain events with strong delivery guarantees
- Build stateful streaming jobs and operate distributed messaging at scale including partitioning replication and retention
- Transform raw node output into a canonical on chain data model for APIs and analytics and integrate external data where needed
- Embed robust observability and automated recovery so systems self heal under load
- Deploy containerized microservices via modern CI CD and infrastructure automation in managed cloud environments
- Contribute through design and code reviews and ship secure scalable software