Japanese AI Model Rater

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Participate in voice-based interactions with AI models, including recorded sessions
• Submit deliverables such as write-ups, ratings, screenshots, or recordings in specified formats
• Assess AI capabilities, safety, and helpfulness to inform model development

Requirements

• Native or expert-level fluency in Japanese (as spoken in Japan)
• Strong English reading, writing, and communication skills
• Hands-on experience using AI models or large language models
• Ability to pass a language proficiency assessment and AI evaluation task
• Possession of a smartphone, computer, and reliable internet
• 18 years of age or older

About the Company

Productive Playhouse is a global data and language services company that provides transcription, translation, linguistic analysis, and AI evaluation services to clients worldwide.