Senior Data Engineer

Alpaca is a brokerage infrastructure company providing developer APIs for stocks, options, fixed income, and crypto trading, plus tokenization infrastructure for TradFi–DeFi markets.

San Mateo, California, United States
About Alpaca

Alpaca provides API-first brokerage infrastructure for fintechs, institutions, algorithmic traders, and developers. Its offerings include Broker API, Trading API, market data, self-clearing brokerage services, crypto services, and the Instant Tokenization Network for in-kind minting and redemption of tokenized assets.

View jobs by Alpaca

Skills

About the Role

You will design, build, and evolve core data-platform infrastructure, including query engines, orchestration, warehousing, and cataloging. You will manage lakehouse infrastructure as code, build streaming, CDC, and batch ingestion pipelines, scale BI access, and maintain reliability through monitoring, incident response, runbooks, and SLAs.

Requirements

  • 5+ years of data engineering experience, including 2+ years building and operating scalable low-latency data platforms handling more than 100 million events per day
  • Data infrastructure experience on Kubernetes
  • Docker
  • Helm
  • Terraform
  • Ansible
  • ArgoCD or equivalent infrastructure-as-code tooling
  • Distributed systems knowledge, including storage, transactions, and query processing
  • Trino or Presto
  • Object storage
  • Apache Iceberg
  • Kafka
  • Redpanda
  • Debezium
  • Airflow
  • Airbyte
  • Python
  • SQL
  • Google Cloud Platform and data services such as GCS, Cloud Build, Cloud SQL, and Dataproc

Responsibilities

  • Design, build, and evolve core data-platform infrastructure
  • Manage lakehouse infrastructure as code using Terraform and Ansible on Kubernetes
  • Build and maintain low-latency streaming, CDC, and batch ingestion pipelines landing in Iceberg
  • Develop and scale self-service BI access to lakehouse data
  • Enforce reliability practices including monitoring, alerting, on-call rotations, incident response, maintenance windows, runbooks, and SLAs
  • Partner with DevOps and Analytics Engineering to address infrastructure gaps and data requirements

Benefits

  • Stock options
  • Health benefits
  • One-time USD 500 new-hire home-office setup
  • USD 150 monthly stipend via a Brex Card