Senior Data Engineer

Alpaca provides developer APIs for stock, options, and crypto trading, enabling businesses and developers to build trading applications and automate investment strategies.

Maintainer signals as of 8/29/2026

20 North San Mateo Drive, San Mateo, California, United States
About Alpaca

Alpaca helps developers and businesses access financial markets through API-first infrastructure for stock, options, and cryptocurrency trading. Users can build algorithmic trading strategies, create investing applications, and integrate brokerage services into their platforms.

View jobs by Alpaca

Skills

Candidate Availability

Required and preferred rules are kept separate and reflect the wording in the original posting.

About the Role

Design, build, and evolve core data-platform infrastructure, lakehouse deployments, and batch, streaming, and CDC ingestion pipelines. Improve BI access, enforce reliability practices such as monitoring and incident response, and collaborate with DevOps and analytics engineering on data infrastructure needs.

Requirements

  • 5+ years of data engineering experience.
  • 2+ years building and operating scalable low-latency data platforms handling more than 100 million events daily.
  • Experience running data infrastructure on Kubernetes with Docker and Helm.
  • Production experience with Terraform, Ansible, and ArgoCD or equivalents.
  • Knowledge of distributed systems and open-source query engines such as Trino or Presto.
  • Experience with object storage and Apache Iceberg.
  • Experience with Kafka, Redpanda, and Debezium.
  • Experience with Airflow and Airbyte.
  • Python and SQL skills.
  • Experience with GCP data services or related cloud services.

Responsibilities

  • Design, build, and evolve the core data platform infrastructure.
  • Manage lakehouse infrastructure as code using Terraform and Ansible on Kubernetes.
  • Build and maintain streaming, CDC, and batch ingestion pipelines into Iceberg.
  • Scale BI access to lakehouse data.
  • Implement monitoring, alerting, on-call rotations, incident response, runbooks, and SLAs.
  • Partner with DevOps and analytics engineering to address infrastructure needs.

Benefits

  • Stock options
  • Health benefits
  • One-time USD $500 new-hire home-office setup
  • USD $150 monthly stipend via a Brex Card