Member of Technical Staff Pre Training Data
47 minutes agoSalary: 250K - 535KToronto; London; Montreal; New York; Paris; San FranciscoRemoteFull TimeAiJobs by Cohere
CohereVisit Cohere website
Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.
Toronto, Canada
About Cohere
Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.
Skills
About the Role
You will develop data pipelines for pre-training language models. You will conduct data ablations, build and evaluate data mixtures, apply data curation and modeling techniques, and collaborate with researchers and engineers to improve training efficiency and model performance.
Requirements
- Software engineering skills
- Python
- Data pipeline development
- Curriculum learning
- Data mixing
- Data attribution
- Apache Spark
- Apache Beam
- Pandas
- Large-scale dataset experience
- Web data
- Code data
- Multilingual corpora
- Data quality assessment
- Data mixture experimentation
Responsibilities
- Conduct data ablations to assess data quality and improve data mixtures.
- Develop data modeling techniques for efficient model training.
- Research and implement data curation methods.
- Collaborate with researchers and engineers on data pipelines for language models.
Benefits
- Equity
- Weekly lunch stipend of $75/£75 or equivalent local currency
- Health and dental benefits
- Mental health budget
- RRSP matching, 401K, and Pension Scheme
- 100% parental leave top-up for up to 6 months
- Annual enrichment benefits
- Education and learning stipend
- 6 weeks of paid vacation
- Budget for travel to other offices for remote employees
- Annual company offsite
- Daily lunch program for office employees
- Snacks
- Community and social events
- Co-working benefit
- $500 home office stipend