Senior Big Data Engineer

Skills

About the Role

YOU will design and implement scalable data pipelines that process petabytes of data and power analytics. YOU will write performant, clean, and well tested code and contribute to a high performance distributed system. YOU will work with modern data processing frameworks and DevOps practices to deliver reliable data products in a fast paced environment. YOU will collaborate with cross functional teams to ensure data quality and reliability.

Requirements

• 8+ years of hands on coding and software design experience
• Fluent in at least two programming languages and deep expertise with either Java Scala Go or Python
• Experience in implementing scalable and reliable services using big data processing frameworks and tools like Hadoop EMR Pig Hive Databricks and equivalents
• Experience with designing and managing data workflows using orchestration tools such as Airflow Luigi Dagster and similar technologies
• Experience working in stream processing frameworks such as Flink or Storm
• Experience in establishing and promoting high standards in pipeline monitoring data validation testing
• Knowledge of creating efficient data models for analytical operational use
• Passionate about big data problems distributed systems and an appetite for learning and growing
• Experience with the DevOps mindset infrastructure as code Continuous Delivery and TDD
• Hands on experience with AWS cloud native architectures Kubernetes Docker etc
• Bachelor’s master’s or doctorate degree in a related field or an intriguing reason for not having one
• Excellent communication skills

Responsibilities

• Working on interesting and complex technical challenges
• Designing end to end solutions that process and store petabytes of data
• Writing performant clean and well tested code
• Using Continuous Delivery practices and DevOps tools to deliver software
• Defining big data best practices and guidelines
• Working in a collaborative and fast paced environment
• Enjoying a high degree of autonomy contributing to ideas and shaping architecture
• Working on a high performance distributed system

Benefits

• Competitive Salary including very attractive stock options package
• Employee benefits including healthcare (medical dental vision) and 401k
• Unparalleled opportunities to help build a category defining company
• 100% remote