Computer Science Specialist

About the Company

Prolific is building the world's largest pool of quality human data. Over 35,000 AI developers, researchers, and organizations use Prolific to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

Responsibilities

• AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety
• Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity
• Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings
• RLHF (Reinforcement Learning from Human Feedback): providing the human "ground truth" to help models align with professional standards
• Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness

Requirements

• BSc in Computer Science or a closely related technical field
• Ability to interpret research papers and understand complex algorithms
• Ability to review code logic
• High level of cognitive competency and analytical mindset
• Valid LinkedIn profile for professional verification
• PayPal account for receiving payments
• Ability to complete tasks requiring one hour of uninterrupted work

Preferred Qualifications

• Background in CS research or technical analysis