Labeler/Annotator – AI Response Evaluation (French)

Blueprint Technologies

Completely RemoteFull TimeInformation Technology
Posted Yesterday

Job description

Responsibilities

  • Perform side-by-side (SBS) comparisons of AI-generated responses
  • Evaluate outputs based on accuracy, relevance, clarity, and instruction-following
  • Identify nuances in tone, meaning, and cultural context across French
  • Apply detailed, scenario-specific annotation guidelines
  • Maintain consistency and high-quality evaluations

Requirements

  • Native or professional fluency in French
  • Strong English reading comprehension
  • Prior experience with side-by-side (SBS) labeling or annotation
  • Excellent analytical thinking and attention to detail
  • Ability to quickly understand and apply structured evaluation frameworks

Preferred Qualifications

  • Background in linguistics, translation, or localization
  • Experience in AI evaluation or data annotation
  • Experience in search relevance or content quality analysis

Benefits

  • Statutory benefits including paid vacation and aguinaldo
  • Social security and healthcare contributions (IMSS)
  • Locally compliant benefits via Employer of Record

About the Company

Blueprint Technologies is a technology solutions firm that uses technology as a bridge between strategy and execution, helping organizations grow, transform, and innovate.

Skills & tools

AIData annotationFrenchLLMGenerative AIPyTorchAngularSnowflakeDatabricksMySQLRAGNLPGenAILangChainKotlin

What the team is looking for

Use this list as a quick fit check before you apply.

  1. 01Native or professional fluency in French
  2. 02Strong English reading comprehension
  3. 03Prior SBS labeling or annotation experience
  4. 04Analytical thinking skills
ScoutJobsAd

Wake up to a shortlist, not a search results page.

ScoutJobs scores every new listing against your CV, salary floor and visa. A handful of real matches by morning.

Get your daily matches