Cohere

Data Annotation Specialist, Data Science

Canada, Remote. Posted 4 months ago

The role

This person will evaluate data science and coding tasks by reviewing code, analyzing model trajectories, and assessing data visualization. The work contributes to model development and the logic models apply when completing task requests.

What you will do

  • Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools.
  • Assess agent trajectories and model capabilities for code generation, tabular and graphic manipulation, and debugging requests.
  • Prompt models to complete complex data science tasks and review the accuracy of generated responses.
  • Label, proofread, and improve machine-written and human-written software engineering-related outputs.
  • Report quality and performance trends related to model/agent behaviour and project assignments.

Required qualifications

  • Exceptional data analysis and visualization skills.
  • 3+ years of relevant industry experience working on real-world data science problems and pipelines.
  • Proficient knowledge and understanding of Python and industry-standard data science packages (numpy, pandas, matplotlib, sqlite, or others).
  • Strong understanding of SQL syntax writing and workflows.
  • Deep familiarity with file/data formats, such as markdown, JSON, XML, YAML, and HTML.
  • Prior experience re-writing, proofreading, and delivering feedback on code.
  • Bring Your Own Device (laptop).

Nice to have

  • Familiarity with code agents (OpenCode, Claude Code, Codex) or evaluating agent trajectories

Before you apply

  • Must be able to work within Canada.
  • Role involves exposure to not safe for work (NSFW) text content including explicit, offensive, or other inappropriate material.
  • Initial Screening: Talent Team review.
  • First Assessment: Multiple-choice assessment by email.
  • Second Assessment: Comprehensive assessment focused on area of expertise.

About the company

Cohere is a security-first enterprise AI company that builds foundation AI models and end-to-end products. It is a global technology company headquartered in Toronto.