Senior Data Platform Engineer
Skills
About the Role
You will develop and maintain data pipelines and backend services for blockchain data processing. You will integrate blockchains, AMM protocols, and bridges into the platform, design and implement end-to-end features, and continuously write, debug, test, and deliver improvements. You will integrate new technologies into processes and tools and provide code reviews and assistance to other engineers.
Requirements
- 8+ years of experience in software engineering developing backend services, APIs, or data pipelines
- Strong knowledge and experience with Python
- Advanced knowledge of SQL with ability to write, understand, and debug complex queries
- Strong database architecture principles
- Strong experience with data lakes, data warehouses, relational and analytical databases
- POSIX/Unix/Linux ecosystem knowledge
- Blockchain technology knowledge or willingness to learn
- Experience with unit testing principles
- Experience with Docker containers and proven ability to migrate existing services
- Independent and autonomous way of working
- Team-oriented work and good communication skills
- Practical experience with big data frameworks such as Kafka, Spark, Dask, or Flink (preferred)
- Experience with Kubernetes and Infrastructure as Code tools such as Terraform and Ansible (preferred)
- Experience with API frameworks such as Flask or FastAPI (preferred)
- Experience with distributed systems (preferred)
- Experience with Java or willingness to learn (preferred)
Responsibilities
- Develop and maintain data pipelines and backend services
- Integrate blockchains, AMM protocols, and bridges into the platform
- Integrate new technologies into processes and tools
- Design and implement end-to-end features
- Write, debug, test, and deliver features and improvements continuously
- Provide code reviews and assistance for other team members