Member of Technical Staff Software Engineer Data Platform
38 minutes agoLeadSalary: 220K - 405KSan Francisco; New York City; Palo AltoFull TimeData ScienceJobs by Perplexity
PerplexityVisit Perplexity website
Perplexity is an AI-powered answer engine that provides real-time, cited answers and research capabilities.
San Francisco, United States
Funding history
About Perplexity
Private AI company founded in 2022. Its products combine conversational search and research with cited web sources; it also offers developer-facing Search, Agent, Router, and Embeddings APIs.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, operate, and improve large-scale batch and streaming data pipelines that support product features, AI workflows, analytics, and experimentation. You will lead data orchestration architecture, establish data reliability standards, build self-service platform capabilities, guide architectural decisions, and mentor engineers.
Requirements
- 5+ years of software engineering experience for Senior level or 8+ years for Staff level
- Experience building production data infrastructure systems
- Experience with large-scale batch or streaming data processing
- Familiarity with data orchestration systems such as Airflow or Dagster
- Proficiency in Python and an additional backend language
- Experience supporting ML or AI workflows, training pipelines, or evaluation systems
- Familiarity with data quality, lineage, observability, and governance tooling
- Experience owning internal platforms used by multiple teams
Responsibilities
- Design and operate large-scale batch and streaming data pipelines
- Build event-driven systems for real-time data ingestion, transformation, and delivery
- Lead data orchestration architecture and observability
- Establish guarantees for data correctness, freshness, lineage, and recoverability
- Build self-service data platforms
- Improve data-platform developer experience, modeling, testing, validation, and deployment standards
- Drive architectural decisions across storage, compute, orchestration, and data APIs
- Mentor engineers and review designs
Benefits
- Equity
- Health insurance
- Dental insurance
- Vision insurance
- Retirement benefits
- Fitness benefits
- Commuter account
- Dependent care account
