Senior Python Developer

Responsibilities

• Evaluate AI-generated Python code for functional correctness and adherence to best practices
• Validate logic and reasoning in AI-provided step-by-step algorithmic explanations
• Conduct execution testing of model-generated scripts to verify performance and output
• Annotate model performance by identifying inefficient solutions, deprecated syntax, or hallucinations
• Provide structured feedback on model reasoning regarding backend architecture, data pipelines, and API design

Requirements

• BSc or higher in Computer Science, Software Engineering, or a related technical field
• Professional experience as a Senior Software Engineer specializing in Python
• Ability to solve LeetCode Medium to Hard-level problems independently
• Expert understanding of GIL, decorators, generators, memory management, and asyncio
• High standard for clean code following PEP 8 and PEP 20
• Proficiency with Django, FastAPI, or Flask
• Experience with pytest, unittest, coverage.py, and tox

About the Company

Prolific is building the world's largest pool of quality human data to help train and evaluate cutting-edge AI models. We connect researchers and organizations with a global pool of participants to collect high-quality, ethically sourced human behavioral data.