Technical AI Evaluator

Mindrift

Completely RemotePart TimeInformation Technology
Posted Yesterday

Job description

Responsibilities

  • Build realistic developer environments including codebases, infrastructure, and context
  • Design challenging tasks from intermediate environment states and define success criteria
  • Write functional and integration tests to verify AI agent solutions
  • Iterate on tasks and tests based on QA feedback to ensure robust evaluation

Requirements

  • 5+ years of experience in software development
  • Proficiency in Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, and Redis
  • Experience writing functional and integration tests
  • English proficiency at B2 level or higher

About the Company

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.

Skills & tools

PythonDockerTypeScript

What the team is looking for

Use this list as a quick fit check before you apply.

  1. 015+ years software development experience
  2. 02Python (FastAPI)
  3. 03JavaScript/TypeScript (React)
  4. 04Docker
  5. 05Postgres
  6. 06Kafka
  7. 07Redis
  8. 08English B2+
NeverApplyAd

Wake up to a shortlist, not a search results page.

NeverApply scores every new listing against your CV, salary floor and visa. A handful of real matches by morning.

Get your daily matches