Senior Data Engineer
Adyen is a Dutch financial technology company providing global payment acceptance.
Projects
About Adyen
Adyen N.V. operates a unified financial technology platform for businesses. Its services cover online, in-person, and in-app payments; acquiring; payment methods; risk and authentication; platforms and marketplaces; payouts; card issuing; business accounts; capital; and liquidity management.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, deploy, and operate production ELT pipelines and data architectures. You will integrate data from diverse sources, ensure quality through testing and monitoring, improve pipeline and query performance, establish data practices, and collaborate with stakeholders to deliver understandable integration insights.
Requirements
- 6+ years of data engineering experience
- Python
- PySpark
- Airflow
- Hadoop
- Spark
- Kafka
- SQL
- Git
- Pytest
- Data validation
- Data governance
Responsibilities
- Engage stakeholders to understand requirements and craft solutions
- Design, develop, deploy, and operate production ELT pipelines and data architectures
- Integrate data from multiple sources and formats
- Establish data-performance, code-quality, validation, governance, and discoverability practices
- Implement testing, monitoring, and validation protocols for code and data
- Identify and resolve data-pipeline and system performance bottlenecks
- Improve query performance and resource utilization
Benefits
- RSUs