Lawyer | Remote

Legal Expert AI Response Evaluator

Contract | Remote

Pay: $70/hour

Time Commitment: Flexible / Self-scheduled

Role Snapshot

Evaluate and provide structured written feedback on responses generated by LLMs, contributing to high-impact research projects that improve the quality and reliability of AI systems.

Core Responsibilities

• Review and assess outputs from LLMs against structured evaluation guidelines, identifying errors, gaps in reasoning, and areas for improvement
• Write clear, precise, and well-evidenced written rationales that go beyond surface-level observations
• Apply consistent, honest judgment including critical assessments when evaluating model-generated content
• Follow detailed task guidelines with strict attention to detail and accurate, reproducible scoring

Ideal Candidate Profile

• Strong experience in legal analysis, critical reading, or structured written evaluation within a professional or academic context
• Strong experience in identifying nuance, implicit meaning, and logical gaps across complex written material
• Strong experience producing high-quality written work independently, without reliance on AI writing tools
• Native English fluency required; bachelor's degree from a globally ranked institution preferred

Easy Apply to proceed.