AI QA Trainer
Agency
WorldwideFully remoteContractMid Level, SeniorInformation Technology
USD 6–65 an hourPosted 3 months ago3mo agoApply link checked 4 hours ago
Why we think you can apply
- Hiring model
- Open worldwide · the employer states no country restriction
- Work from
- Anywhere, the UAE included
Posted 3 months ago · apply link checked 4 hours ago
About the role
Responsibilities
- Converse with models on real-world scenarios and evaluation prompts
- Verify factual accuracy and logical soundness
- Design and run test plans and regression suites
- Build clear rubrics and pass/fail criteria
- Capture reproducible error traces with root-cause hypotheses
- Suggest improvements to prompt engineering, guardrails, and evaluation metrics
- Partner on adversarial red-teaming, automation, and quality dashboarding
Requirements
- Experience in model evaluation, LLM safety, and prompt robustness
- Expertise in hallucination detection and factual consistency
- Knowledge of prompt-injection and jailbreak resistance
- Ability to perform bias/fairness audits and grounding verification
- Proficiency in test automation using Python or SQL
- Strong metacognitive communication skills for high-signal bug reporting
Preferred Qualifications
- Bachelor’s, Master’s, or PhD in Computer Science, Data Science, Computational Linguistics, or Statistics
- Experience shipping QA for ML/AI systems
- Experience with test automation frameworks like PyTest
- Hands-on work with LLM eval tooling such as OpenAI Evals, RAG evaluators, or W&B
About the Company
We are seeking AI QA experts to help harden model reasoning and reliability, ensuring large-scale language models evolve into enterprise-grade, safe, and reliable platforms.
What we look for
- LLM evaluation expertise
- LLM safety and red-teaming
- Python or SQL proficiency
- Data quality assurance
PythonSQLLLM
SponsorWake up to a shortlist, not a search results page.
NeverApply scores every new listing against your CV, salary floor and visa. A handful of real matches by morning.
Get your daily matchesSimilar jobsbased on title, category and scope
Agency
SponsorWake up to a shortlist, not a search results page.
NeverApply scores every new listing against your CV, salary floor and visa. A handful of real matches by morning.
Get your daily matchesAI QA TrainerAgency · free account, 30 seconds