Italian Audio Evaluations Specialist

Responsibilities

• Create and execute complex, role-play-based evaluation scenarios simulating realistic customer service interactions
• Evaluate AI model performance across qualitative and quantitative metrics, focusing on task completion and naturalness
• Assess model programming literacy, including JSON structures and reasoning about structured data
• Contribute to the development of diverse, high-quality audio datasets

Requirements

• Native or bilingual proficiency in Italian
• Professional expertise in customer support, technical troubleshooting, or conversational AI evaluation
• Basic computer programming literacy (JSON, functions, methods, and simple logic)
• Access to a high-quality microphone for clean audio input
• Meticulous attention to detail with structured prompts and evaluation rubrics

About the Company

This project focuses on assessing advanced agentic audio models to optimize performance in real-world customer support scenarios like flight bookings, financial services, and telecommunications.