Senior Member of Technical Staff Web Data
Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.
About Cohere
Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will develop and maintain large-scale web-data pipelines for pretraining. You will extract, parse, deduplicate, filter, and score web documents; analyze dataset composition and quality; assess downstream model impact; and work with research, data, and evaluation colleagues to improve training corpora.
Requirements
- Software engineering proficiency in Python
- Experience building data pipelines
- Familiarity with Apache Spark, Apache Beam, Pandas, or similar data-processing tools
- Experience working with large-scale web datasets
- Knowledge of data-quality assessment and experimentation with data mixtures
Responsibilities
- Maintain large-scale web-corpora processing pipelines
- Build filtering and quality-scoring systems for web documents
- Analyze web-data composition across domains, languages, and time periods
- Develop and maintain deduplication pipelines
- Collaborate with researchers and engineers to meet language-model data requirements
Benefits
- Equity
- Weekly lunch stipend of $75/£75 or equivalent local currency
- Health and dental benefits
- Mental health budget
- RRSP matching, 401K, and pension scheme
- Parental leave top-up for up to 6 months
- Arts, culture, fitness, wellness, quality-time, and workspace-improvement benefits
- Education and learning stipend
- 6 weeks of paid vacation
- Remote travel budget and annual company offsite
- Co-working benefit
- $500 home office stipend