Forward Deployed Machine Learning Engineer

About the Company

Protege is building a platform to solve the biggest unmet need in AI: access to high-quality training data. The platform facilitates the secure, efficient, and privacy-centric exchange of AI training data, helping model builders understand performance and identify data improvements.

Responsibilities

• Partner with the GM and early customers to define strong evaluations across different domains
• Work with researchers to design and build benchmarks and processing standards for different modalities
• Build backend infrastructure including data pipelines, execution environments, storage, and orchestration
• Stand up sandboxed environments for agentic evaluations involving tool use and code execution
• Identify repeatable evaluation patterns and product opportunities from live customer engagements
• Partner with the research team on domain-specific data and research questions

Requirements

• 4+ years of engineering experience
• Hands-on experience with machine learning model evaluation
• Proven experience owning backend and infrastructure
• High ambiguity tolerance and a strong bias to action
• Ability to work with urgency to meet market demands
• Strong written communication skills

Preferred Qualifications

• Experience building benchmarks, evaluations, or human data pipelines for LLMs
• Experience at a frontier AI lab, research organization, or evaluation-focused team
• Early engineer experience at a fast-moving startup
• Familiarity with agentic systems, RL environments, code-execution sandboxes, or TEE/TREs