AI Model Rater

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Participate in voice-based interactions with AI models, including recorded sessions
• Submit deliverables such as write-ups, ratings, screenshots, or recordings in specified formats
• Assess AI capabilities, safety, and helpfulness to inform model development

Requirements

• Native or expert-level fluency in both Japanese and Korean (South Korean dialect)
• Strong English reading, writing, and communication skills
• Hands-on experience using AI models or large language models
• Ability to pass a language proficiency assessment and AI evaluation task
• Possession of a smartphone, computer, and reliable internet
• Comfortable with both written and voice-based conversation
• 18 years of age or older

About the Company

Productive Playhouse (PPH) is a global data company specializing in transcription, translation, linguistic analysis, and AI evaluation. The company's mission is to keep language and culture alive through high-quality data services.