Content Evaluator – Customer Support & LLM Benchmarking

About the Role

We are seeking detail-oriented Content Evaluators to test, review, and benchmark AI-generated customer support interactions across major platforms .

In this role, you will evaluate AI model outputs against strict evaluation rubrics and authoritative business knowledge bases to help improve the quality, accuracy, and natural tone of next-generation customer support LLMs.

Key Responsibilities

• Evaluate AI Outputs: Review and score AI-generated customer support conversations for accuracy, tone, compliance, faithfulness, and correct agent handoff.
• Fact-Checking & Verification: Verify customer intents and factual responses against business FAQs, product catalogs, SOPs, and official documentation to detect hallucinations or errors.
• Quality & Alignment: Participate in dual-review sessions and daily calibration audits to maintain high scoring consistency.
• Timely Delivery: Complete assigned evaluations accurately within the project's required turnaround time (TAT).

Qualifications & Skills

• Education: Minimum of a Bachelor's Degree in any discipline.
• Language Proficiency: Native or Professional Proficiency in Spanish/Portuguese/Arabic, along with excellent written English skills.

Assessment Process

To be considered for onboarding, candidates must complete two pre-onboarding assessments specific to this project to evaluate rubric alignment and attention to detail.

"Please note that the organization follows a strict no-fee recruitment policy and does not request any payment from candidates at any stage of the hiring process, including through third-party agencies or consultants. Candidates are advised to immediately report any such payment requests in connection with employment opportunities, as they are unauthorized and fraudulent."