Member of Technical Staff Search Crawler Analyst
PerplexityVisit Perplexity website
Perplexity is an AI-powered answer engine that provides real-time, cited answers and research capabilities.
San Francisco, United States
Funding history
About Perplexity
Private AI company founded in 2022. Its products combine conversational search and research with cited web sources; it also offers developer-facing Search, Agent, Router, and Embeddings APIs.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will diagnose quality issues in the crawling pipeline and improve page selection for indexing. You will design metrics and experiments, build training datasets and LLM-as-a-judge labeling pipelines, and train small production models that improve search and answer-system quality.
Requirements
- 4+ years of data analyst, ML engineer, or related experience
- Production-grade coding skills comparable to a mid-level backend engineer
- Experience designing metrics from scratch
- Experience training production ML models with measurable metric improvements
Responsibilities
- Find and diagnose crawling-pipeline quality issues
- Train models that optimize pipeline components
- Build model-training datasets and LLM-as-a-judge labeling pipelines
- Improve page-selection algorithms for indexing
- Design and analyze experiments to validate improvements