Legal & Compliance AI Rater/Evaluator

Responsibilities

• Evaluate AI outputs related to legal and compliance content
• Perform structured scoring, comparison, classification, and judgment tasks
• Assess accuracy, relevance, completeness, risk, and alignment with legal norms
• Identify hallucinations, ambiguity, unsafe guidance, or misleading outputs
• Apply domain-specific guidelines consistently across tasks

Requirements

• Legal practitioner, compliance professional, legal analyst, or policy specialist
• Experience interpreting statutes, regulations, contracts, policies, or legal guidance
• Strong attention to detail and comfort working with structured evaluation criteria

Preferred Qualifications

• Senior legal professional, compliance lead, regulatory specialist, or legal SME
• Experience defining standards, reviewing complex edge cases, or advising on risk
• Comfort explaining nuanced legal reasoning clearly and precisely

Benefits

About the Company

LILT is building a global network of domain experts to support high-quality AI evaluation across training, benchmarking, red-teaming, and ongoing model optimization. We are seeking legal and compliance professionals to contribute expert judgment to human-in-the-loop AI evaluation workflows used by leading enterprises and governments.

This role is designed for professionals who understand how legal and regulatory language is used in real-world contexts and who can apply that expertise to evaluate, assess, and improve multilingual AI systems.

Your contribution of expertise will directly influence our multilingual AI model’s quality, safety, and deployment readiness.

This role includes two distinct expert tracks, based on experience level and scope of responsibility.