Data Labeler

About the Company

White Circle is an AI Safety company building the safety, reliability, and optimization layer for AI systems. We use natural-language policies to automatically test, enforce, and improve AI models at scale.

Responsibilities

• Review and evaluate AI conversations and model outputs
• Assess responses for safety, quality, accuracy, policy compliance, and user intent
• Identify harmful, unsafe, misleading, or low-quality behavior
• Label and categorize model outputs according to internal evaluation frameworks
• Moderate sensitive content and identify policy violations
• Compare, rank, and score model responses
• Investigate edge cases and ambiguous situations
• Provide structured feedback to researchers and engineers
• Help improve evaluation guidelines and annotation processes
• Contribute to the datasets used to train and evaluate AI systems

Requirements

• Exceptional attention to detail
• Ability to make consistent decisions across large volumes of data
• Strong written English skills
• Ability to communicate reasoning clearly
• Comfort reviewing sensitive or disturbing content (offensive, violent, or sexual)

Preferred Qualifications

• Experience with content moderation, trust & safety, or quality assurance
• Experience in data annotation, AI evaluation, RLHF, or model assessment
• Extensive experience working with AI tools