Job Title : Content Evaluator
Location : Flexible work arrangement.
Work Schedule : 9am-4pm BRT.
We are seeking a highly skilled professional to evaluate and rate various types of content, including text, audio, video, and photos. The successful candidate will be responsible for reviewing and rating user-generated and AI-created content based on predefined policies and guidelines.
Responsibilities :
- Evaluate and rate different content types, ensuring accuracy, factuality, relevance, helpfulness, language usage, and alignment with user intent.
- Conduct research and fact-checking by comparing AI-generated responses with other generally available sources.
- Conduct side-by-side comparisons and identify key differences between responses.
- Rate and stack rank responses while providing clear reasoning and adhering to guidelines.
- Ensure consistency in rating decisions.
- Support internal training and quality assurance initiatives.
- Attend customer calls, calibration sessions, and meetings as required.
- Re-write prompts or responses as needed.
Requirements & Qualifications :
Native English speaker or fluent in English (B1 / B2 level).University degree preferred.1 year of relevant experience in journalism, literature, writing, or comparable fields.Basic computer skills, typing speed of 25-30 words per minute, and comfort with G Suite, especially Google Sheets.Excellent verbal and written communication skills.Understanding of AI models and their capabilities.Knowledge of established guidelines and best practices for content evaluation.Experience evaluating and comparing content from different sources.Detail-oriented, analytical skills to assess content factuality, relevance, and alignment with user intent.Research skills to evaluate content accuracy and identify trustworthy sources.Critical thinking skills to identify biases, inconsistencies, and limitations in AI-generated responses.Key Skills : Content evaluation, AI-generated responses, research, fact-checking, critical thinking, attention to detail.
This role requires a high level of expertise in content evaluation and analysis. If you have a passion for evaluating content and a strong understanding of AI-generated responses, we encourage you to apply.