Labeler/Annotator – AI Response Evaluation (French)

Blueprint Technologies

Completely RemoteFull TimeInformation Technology
Posted Yesterday

Job description

Responsibilities

  • Perform side-by-side (SBS) comparisons of AI-generated responses
  • Evaluate outputs based on accuracy, relevance, clarity, and instruction-following
  • Identify nuances in tone, meaning, and cultural context across French
  • Apply detailed, scenario-specific annotation guidelines
  • Maintain consistency and high-quality evaluations

Requirements

  • Native or professional fluency in French
  • Strong English reading comprehension
  • Prior experience with side-by-side (SBS) labeling or annotation
  • Excellent analytical thinking and attention to detail
  • Ability to quickly understand and apply structured evaluation frameworks

Preferred Qualifications

  • Background in linguistics, translation, or localization
  • Experience in AI evaluation or data annotation
  • Experience in search relevance or content quality analysis

About the Company

Blueprint Technologies is a technology solutions firm headquartered in Bellevue, Washington, that uses technology as a bridge between strategy and execution to help organizations grow, transform, and innovate.

Skills & tools

AIData annotationFrenchLLMGenerative AIPyTorchAngularSnowflakeDatabricksMySQLRAGNLPGenAILangChainKotlin

What the team is looking for

Use this list as a quick fit check before you apply.

  1. 01Native or professional fluency in French
  2. 02Strong English reading comprehension
  3. 03Prior SBS labeling or annotation experience
  4. 04Analytical thinking
  5. 05Attention to detail
ScoutJobsAd

Wake up to a shortlist, not a search results page.

ScoutJobs scores every new listing against your CV, salary floor and visa. A handful of real matches by morning.

Get your daily matches