Talent.com
Multimodal AI Evaluation Analyst

Multimodal AI Evaluation Analyst

iMerit Technologymontes claros, Brazil
Há 22 horas
Descrição da vaga

Job Description : Multimodal AI Evaluation Analyst

Target Language : English

Company : iMerit Scholars

Position Type : - Remote; Contract ($5 / hour); ~10-40 hours per week

Position Overview :

iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems.

This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs.

As a Multimodal AI Evaluation Analyst, you’ll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world.

Compensation & Work Structure

  • Rate : $5 / hour
  • Phase 1 : ~12-hour paid pilot project (completed within a few days)
  • Phase 2 : Ongoing contract work (typically 15–40 hours / week) for top performers

What You’ll Do

  • Evaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts)
  • Assess quality, correctness, coherence, style, and cultural alignment
  • Identify subtle issues like hallucinations, logical gaps, or bias
  • Provide detailed written feedback and apply complex evaluation guidelines consistently
  • Collaborate with Quality Leads and Project Managers to ensure reliability and accuracy
  • What You Bring

  • Excellent critical reading and evaluation skills across multiple modalities
  • Strong English comprehension (CEFR B2 or above)
  • Familiarity with LLMs, generative AI, and multimodal systems
  • Exceptional attention to detail and consistency
  • Comfort with iterative feedback, evolving workflows, and nuanced judgments
  • Prior experience in data annotation, AI evaluation, or related work (preferred)
  • Preferred Qualifications

  • BA degree (preferred) or comparable experience
  • Experience working with annotation tools or AI data platforms
  • Understanding of multimodal communication (text-to-image, video narratives, etc.)
  • Comfort with fast-paced projects and evolving quality standards
  • Awareness that incidental exposure to sensitive or NSFW content may occur
  • Why Join iMerit Scholars

  • Help shape how cutting-edge AI systems understand the world
  • Work remotely on projects at the forefront of multimodal AI
  • Gain hands-on experience in applied AI evaluation
  • Collaborate with a global, expert community of AI trainers
  • Next Steps

  • Start by taking the 30-minute skill assessment
  • Qualified applicants will be invited by email to a paid 12-hour pilot project (includes 2 hours paid training)
  • Strong results in the pilot may lead to ongoing, flexible remote work (15–40 hrs / week) with iMerit Scholars.
  • Criar um alerta de emprego para esta pesquisa

    Analyst • montes claros, Brazil

    Vagas relacionadas
    • Promovida
    • Nova!
    Sênior Gen AI Engineer - Inglês avançado / fluente

    Sênior Gen AI Engineer - Inglês avançado / fluente

    Haysmontes claros, Brazil
    Contratação PJ - valor em reais.Cliente internacional - pode haver necessidade de atuar em outro fuso horário.Você é apaixonado por Inteligência Artificial Generativa e quer trabalhar com tecnologi...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    • Nova!
    AI Team Lead

    AI Team Lead

    International Digital Partnersmontes claros, Brazil
    Our client is looking for an experienced.AI services within a SaaS environment.This professional will guide a multidisciplinary team to architect and deploy intelligent, data-driven solutions that ...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    DevOps Analyst Senior – Focus on.NET – Advanced / Fluent English

    DevOps Analyst Senior – Focus on.NET – Advanced / Fluent English

    Dexian BrasilMontes Claros, Minas Gerais, Brazil
    DevOps Analyst Senior – Focus on.NET – Advanced / Fluent English • • •About Us DEXIAN, launched in 2023, has a global presence and brings with it almost 30 years of experience through its legacy compa...Mostre maisÚltima atualização: 4 dias atrás
    • Promovida
    • Nova!
    AI Engineer (NLP)

    AI Engineer (NLP)

    Prosiglieremontes claros, Brazil
    We're looking for a Senior ML / AI Engineer to own and evolve our LLM-powered user experience.You'll work directly with our technical co-founder to build, optimize, and monitor agent systems that par...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    • Nova!
    ML Data Pipeline Engineer

    ML Data Pipeline Engineer

    Prosiglieremontes claros, Brazil
    We're seeking a Data Pipeline Engineer to own and evolve our exercise recognition training data infrastructure.You'll manage the end-to-end pipeline that collects, synchronizes, validates, and prep...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    • Nova!
    Data Modeler

    Data Modeler

    TurnKey Tech StaffingMontes Claros, Minas Gerais, Brazil
    About the Product : For more than 30 years, Carnegie has been a leader and innovator in higher education marketing and enrollment strategy, offering groundbreaking services in the areas of Research,...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    • Nova!
    Data Engineer (Relocation to Portugal)

    Data Engineer (Relocation to Portugal)

    Affinitymontes claros, Brazil
    A Job? Or a Lifetime Experience? Start Yours Here!.Our mission is to be a meaningful part of our people's careers.As we grow, so does our determination to offer the best experience to our employees...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    • Nova!
    Senior Data Product Analyst

    Senior Data Product Analyst

    GlobalSource ITmontes claros, Brazil
    Job Title : Senior Data Product Analyst (Remote, US Central Time Zone Hours).We are seeking a highly skilled Senior Data Analyst to join our dynamic team. In this role, you will collaborate with the ...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    • Nova!
    Generative AI Engineer

    Generative AI Engineer

    AnswerThis (YC F25)montes claros, Brazil
    Remote (Applications open worldwide).Semantic Search, Vector Databases, Prompt Engineering, GenAI Frameworks, React Agents, Graph Agents, Document Parsing, Python, Scalable APIs.AnswerThis is an AI...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    • Nova!
    Senior Market Research Analyst

    Senior Market Research Analyst

    Worldpanelmontes claros, Brazil
    Já pensou em trabalhar em uma empresa líder global em dados, insights e consultoria, que contribui para o sucesso e crescimento das principais organizações do mundo? Então essa é a sua chance!.A Wo...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    KYC Analyst(remote)

    KYC Analyst(remote)

    GateMontes Claros, Minas Gerais, Brazil
    Responsibilities : Conduct international verification case reviews, including individual and corporate verifications.Review and confirm the results of Anti-Money Laundering (AML) and economic sanct...Mostre maisÚltima atualização: 13 dias atrás
    • Promovida
    • Nova!
    Engenheiro Machine Learning

    Engenheiro Machine Learning

    Runtalentmontes claros, Brazil
    Experiência sólida com engenharia de software aplicada a dados e machine learning.Proficiência em Python e frameworks como PySpark, Pandas, Scikit-learn ou similares. Experiência com ferramentas e s...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    • Nova!
    AI / ML Specialist

    AI / ML Specialist

    GFT Technologies Brasilmontes claros, Brazil
    Com mais de 35 anos de mercado e localizada em 16 países, a GFT emprega mais de 12.Aqui, a diversidade, a igualdade e a inclusão estão no centro e garantir um ambiente de trabalho seguro para todas...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    Software Developer (Mobile / AI-Enabled Workflow)

    Software Developer (Mobile / AI-Enabled Workflow)

    Earned Media ProductionsMontes Claros, Minas Gerais, Brazil
    Software Developer (Mobile / AI-Enabled Workflow) We are looking for a talented software developer with strong mobile app development experience to join our team. The ideal candidate will be comfo...Mostre maisÚltima atualização: há mais de 30 dias
    • Promovida
    • Nova!
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Astra AImontes claros, Brazil
    Location : San Francisco, CA - Remote (LATAM preferred).We’re partnering with a confidential, high-growth technology company in Silicon Valley that’s building AI-powered platforms.This team moves fa...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    • Nova!
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Adopt AImontes claros, Brazil
    We’re looking for a full-stack engineer who loves building.You’ll work across the stack—from React front-ends to Python-based agent frameworks—bringing new AI capabilities to life inside real appli...Mostre maisÚltima atualização: 22 horas atrás
    • Promovida
    • Nova!
    Machine Learning Engineer

    Machine Learning Engineer

    Flatiron Softwaremontes claros, Brazil
    Flatiron is a global remote software development company with engineers located around the world.We unite experts from diverse backgrounds and experiences in a collaborative culture to deliver exce...Mostre maisÚltima atualização: 18 horas atrás
    • Promovida
    • Nova!
    Lead Engineer – Agentic AI

    Lead Engineer – Agentic AI

    Tata Consultancy Servicesmontes claros, Brazil
    Join one of the biggest IT Services companies in the world! Here you can transform your career!.Why join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of...Mostre maisÚltima atualização: 22 horas atrás