Data Annotation Specialist Safety
Toronto-founded enterprise AI company building foundation models, agentic AI, enterprise search, and private deployment products.
About Cohere
Cohere provides enterprise-focused AI models and end-to-end products, including North for agentic workplace AI, Compass for enterprise search, and models for generation and retrieval. It supports private, VPC, and on-premises deployment options.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will label, rank, audit, and refine human- and model-generated text to improve model safety, quality, and policy alignment. You will assess outputs against safety guidelines, create prompts and adversarial test cases, identify annotation issues, and provide feedback on model failures. This role involves independent, detail-oriented annotation work and potential exposure to explicit, violent, or psychologically disturbing content.
Requirements
- 1+ years of experience in content moderation, trust and safety, AI data annotation, LLM evaluation, or a related analytical role.
- Experience applying detailed guidelines to complex and sensitive content.
- Comfort working with unsafe, explicit, toxic, sexual, violent, or psychologically disturbing content.
- Excellent written English and ability to justify content evaluations.
- Attention to detail, accuracy, and consistency in high-volume tasks.
- Time management, new-tool proficiency, and ability to work independently in a remote environment.
Responsibilities
- Label, rank, audit, and refine human- and model-generated text.
- Assess model outputs against safety guidelines, rubrics, and style standards.
- Create prompts, user scenarios, and adversarial safety test cases.
- Identify annotation inconsistencies and unclear guidelines.
- Provide feedback on edge cases, model failures, and data-quality improvements.
- Complete annotation tasks independently with precision.
Hiring Process
Initial screening with resume and writing-sample review → virtual annotation test → video screen with Operations → independent contractor offer.