AI Evaluation Specialist

Responsibilities

• Evaluate and compare AI-generated responses in French
• Perform side-by-side analysis of outputs from different AI systems
• Assess responses for accuracy, relevance, clarity, and instruction-following
• Identify nuances in meaning, tone, and cultural context
• Apply structured annotation guidelines consistently
• Work with datasets of real user queries

Requirements

• Native or professional fluency in French
• Strong English reading comprehension
• Analytical thinking and attention to detail

Preferred Qualifications

• Background in linguistics, translation, or localization
• Experience with data annotation, AI evaluation, or search relevance

Benefits

• Medical, dental, and vision coverage
• Flexible Spending Account
• 401k program
• Competitive PTO offerings
• Parental Leave
• Opportunities for professional growth and development

About the Company

Blueprint is a technology solutions firm headquartered in Bellevue, Washington. The company helps organizations unlock value from existing assets by leveraging cutting-edge technology to create additional revenue streams and new lines of business.