Computer Science Expert

Responsibilities

• Work through complex problems and tasks while narrating your reasoning process out loud
• Screen-record your approach to problems and tasks
• Review and evaluate AI-generated responses to technical problems, rating them for accuracy, depth, and reasoning quality
• Compare multiple model answers and select or justify the best response
• Write improved exemplars, rationales, or structured feedback when models fall short

Requirements

• PhD or PhD candidacy in Computer Science or a related discipline
• Strong subject matter expertise in technical problem solving
• Willingness to narrate thinking processes out loud
• Strong attention to detail
• Reliable, fast internet connection and access to a computer
• PayPal account for receiving payments

Preferred Qualifications

• Experience with or a strong interest in AI and machine learning

About the Company

Prolific is building the world's largest pool of quality human data, connecting researchers and organizations with a global pool of participants to develop more accurate and aligned AI systems.