Data Annotation Specialist, Generalist
Cohere · Canada · Calgary · Winnipeg · Vancouver · Halifax · Edmonton · Toronto · Victoria · Montreal
CHECKED 2H AGO
Frontier labremote$44k
At a glance
Highlights
- Evaluate and rank LLM outputs for accuracy, helpfulness, tone and safety.
- Stress-test frontier models adversarially to surface failures and safety gaps.
- Build training datasets and rubrics across text, image and structured data.
Ideal candidate
Analytical generalist with 1+ years in annotation or evaluation who loves probing models, spotting nuance, and justifying judgments clearly. Comfortable with ambiguity, detail-obsessed, and motivated by improving frontier AI.
Requirements
- 1+ years in AI data annotation, LLM evaluation, content moderation, research or related analytical role
- Experience applying detailed guidelines to complex ambiguous content with sociocultural judgment
- Comfort with ambiguity and evolving experimental tasks
- Sharp eye for inconsistencies and model failure modes like hallucination and instruction-following gaps
- Excellent written English and reading comprehension with clear justifications
- Strong attention to detail and consistency across high-volume tasks
- Comfort with annotation platforms and JSON, CSV/TSV, Markdown, XML, YAML
- Strong time management and independent execution in remote async team
- remote policy
- Remote within Canada only
- hiring process
- Initial screening, multiple-choice assessment, comprehensive expertise assessment, video screen with Operations Team, Independent Contractor Agreement
Lab profile
About Cohere
Security-first enterprise AI company building frontier foundation models for business applications.
What they build
- Command foundation models
- Embed models
- Rerank models
Known for
- Security-first enterprise AI
- Frontier model training and deployment
- Business-focused end-to-end products
Key facts
- Founded in 2019
- Headquartered in Toronto, Canada