Search...

Data Engineer

PayPay logo
PayPay

Stealth

Distributed
View jobs by PayPay

Skills

About the Role

You will design, build, and operate scalable data ingestion, processing, integration, governance, and lakehouse platforms. You will improve performance, cost efficiency, reliability, observability, and security while collaborating with product, analytics, risk, security, and compliance stakeholders. You will automate infrastructure and delivery workflows and ensure operations meet financial-sector privacy, regulatory, and audit requirements.

Requirements

  • 4+ years of professional experience as a Data Engineer, Data Platform Engineer, or in a related role
  • Experience designing, building, and operating data lakes, data warehouses, or data lakehouse platforms
  • Experience processing large-scale datasets with Databricks, Delta Lake, or Apache Spark
  • Development experience with Python, PySpark, SQL, or related technologies
  • Experience with Airflow, Dagster, or Prefect
  • Experience developing and operating cloud-based systems on AWS
  • Experience building and managing infrastructure with Terraform or other IaC tools
  • Experience designing and improving large-scale data pipelines for performance, reliability, availability, and operational excellence
  • Business-level Japanese proficiency equivalent to JLPT N1 or N2

Responsibilities

  • Design, develop, and operate scalable data ingestion pipelines using Databricks, AWS DMS, and Terraform
  • Develop large-scale data processing workflows using Spark, Python, and SQL
  • Design and build data integration platforms for banking services, payment systems, business applications, and external data sources
  • Optimize data pipelines using CDC, streaming, and batch architectures
  • Build and maintain data lakehouse and data catalog platforms using Databricks Lakehouse and Unity Catalog
  • Design and operate data governance capabilities, including data quality, metadata, lineage, access control, and audit logging
  • Improve performance, cost efficiency, and reliability in large-scale data processing environments
  • Implement SRE and observability practices, including monitoring, alerting, dashboards, and incident response
  • Build, automate, and standardize data infrastructure using Terraform and other IaC technologies
  • Develop and maintain shared frameworks, tools, templates, and CI/CD pipelines
  • Partner with product, analytics, risk, security, compliance, and group-company stakeholders to drive data utilization
  • Operate and enhance data platforms in compliance with security, privacy, regulatory, and internal-control requirements

Benefits

  • Hybrid workstyle
  • Super flex time with no core hours
  • Annual leave of up to 14 days in the first year
  • Personal leave of 5 days per year
  • Social insurance
  • 401K
  • Translation and interpretation support
  • Visa sponsorship
  • Relocation support
Data Engineer at PayPay | JobStash