Computer Science Expert

About the Company

Prolific is building the biggest pool of quality human data in the world. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

Responsibilities

• Working through complex problems and tasks while narrating your reasoning process out loud
• Screen-recording your approach to problems and tasks
• Reviewing and evaluating AI-generated responses to technical problems, rating them for accuracy, depth, and reasoning quality
• Comparing multiple model answers and selecting/justifying the best response
• Writing improved exemplars, rationales, or structured feedback when models fall short

Requirements

• PhD or PhD candidacy in Computer Science or a related discipline
• Strong subject matter expertise in technical problems
• Willingness to narrate thinking process out loud
• Strong attention to detail
• Reliable, fast internet connection and access to a computer
• A PayPal account for payments

Preferred Qualifications

• Experience with or a strong interest in AI and machine learning