Expert Talent Pool, Data Operations (Expert, 5+ Years)

Responsibilities

• Lead data sourcing and collection programs, setting specifications, acceptance criteria and yield tracking
• Manage media capture and document contribution at scale, then curate and validate datasets
• Design synthetic data generation pipelines and validation checks
• Review annotations, adjudicate disagreements, run calibration and audit rounds
• Write and maintain labelling guidelines, incorporating new edge cases
• Coach annotators and reviewers, reporting agreement and error rates

Requirements

• At least 5 years in data operations, annotation QA or data quality
• Experience leading or reviewing others' work as QA lead, guideline owner or team lead
• Experience running data sourcing or collection programs
• Proficiency with annotation tools such as Label Studio, Labelbox or CVAT
• Spreadsheet and SQL skills for quality analysis
• Clear written communication of data quality issues

Preferred Qualifications

• Synthetic data validation experience
• Large-scale media capture or dataset curation experience
• Annotator coaching experience

Benefits

• Pay of $45 to $90 per hour depending on project, field and level, based on hours worked
• Fully remote, with projects from one week to several months

About the Company

• A flexible expert network matching experienced data operations professionals with project work based on their backgrounds.