Domain Advisor Consultant

Agency

Completely RemoteContractInformation Technology
Posted Today

Job description

Responsibilities

  • Review and advise on quality criteria used to evaluate AI outputs
  • Create, edit, or certify "Golden Tasks" to serve as ground truth for model training
  • Analyze model failures such as hallucinations and logical fallacies
  • Provide technical breakdowns of model errors and expert-level approaches
  • Consult on the complexity and nuance of specific prompts to ensure rigorous testing

Requirements

  • Elite domain mastery via advanced degrees (PhD, MD, JD) or equivalent industry-recognized status
  • Current status as an independent consultant, freelancer, or academic leader
  • Ability to articulate complex reasoning processes clearly in writing
  • Proper registration to operate as an independent contractor in your country of residence

About the Company

We partner with elite Subject Matter Experts to define the "ground truth" for Generative AI, architecting the rubrics that teach Large Language Models how to think like industry experts.

Skills & tools

Generative AILLM

What the team is looking for

Use this list as a quick fit check before you apply.

  1. 01Advanced degrees (PhD, MD, JD) or equivalent industry status
  2. 02Independent contractor status
  3. 03Strong written reasoning skills
ScoutJobsAd

Wake up to a shortlist, not a search results page.

ScoutJobs scores every new listing against your CV, salary floor and visa. A handful of real matches by morning.

Get your daily matches