Member of Technical Staff Data Analysis and Evaluation
1 hour agoSalary: 250K - 535KLondon; Montreal; New York; Paris; San Francisco; TorontoRemoteFull TimeData ScienceJobs by Cohere
CohereVisit Cohere website
Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.
Toronto, Canada
About Cohere
Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design and oversee data-collection tasks, support human annotators, and evaluate dataset quality. You will apply statistical methods, assess model robustness and generalisability, train and fine-tune language models, and run experiments to improve model performance.
Requirements
- Software engineering
- Data collection
- Human annotation
- Statistics
- Experimental design
- Dataset analysis
- Data quality
- Bias analysis
- Machine learning
- Language model training
- Distributed training
- Python
- PyTorch
- TensorFlow
- JAX
- Communication
- Research publication
Responsibilities
- Design and oversee data-collection tasks
- Support human annotators and ensure data quality
- Apply statistical methods to evaluate dataset quality and reliability
- Assess machine-learning system robustness and generalisability
- Improve dataset quality and model performance with cross-functional teams
- Train and fine-tune language models on distributed infrastructure
- Conduct experiments to evaluate model performance
Benefits
- Weekly lunch stipend of $75/£75 or local-currency equivalent
- Health and dental benefits
- Mental health budget
- RRSP matching
- 401K
- Pension Scheme
- Parental leave top-up for up to six months
- Arts and culture benefit
- Fitness and wellness benefit
- Workspace improvement credit
- Education and learning stipend
- Six weeks of paid vacation
- Remote travel budget to other offices
- Annual company offsite
- Daily lunch program for office-based employees
- Snacks for office-based employees
- Community and social events for office-based employees
- Co-working benefit
- $500 home office stipend