Talent.com
Multimodal AI Evaluation Analyst
Multimodal AI Evaluation AnalystiMerit Technology • maringá, Brasil
As candidaturas não são mais aceitas
Multimodal AI Evaluation Analyst

Multimodal AI Evaluation Analyst

iMerit Technology • maringá, Brasil
Há 7 dias
Descrição da vaga

Job Description : Multimodal AI Evaluation Analyst

Target Language : English

Company : iMerit Scholars

Position Type : - Remote; Contract ($5 / hour); ~10-40 hours per week

Position Overview :

iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems.

This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs.

As a Multimodal AI Evaluation Analyst, you’ll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world.

Compensation & Work Structure

  • Rate : $5 / hour
  • Phase 1 : ~12-hour paid pilot project (completed within a few days)
  • Phase 2 : Ongoing contract work (typically 15–40 hours / week) for top performers

What You’ll Do

  • Evaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts)
  • Assess quality, correctness, coherence, style, and cultural alignment
  • Identify subtle issues like hallucinations, logical gaps, or bias
  • Provide detailed written feedback and apply complex evaluation guidelines consistently
  • Collaborate with Quality Leads and Project Managers to ensure reliability and accuracy
  • What You Bring

  • Excellent critical reading and evaluation skills across multiple modalities
  • Strong English comprehension (CEFR B2 or above)
  • Familiarity with LLMs, generative AI, and multimodal systems
  • Exceptional attention to detail and consistency
  • Comfort with iterative feedback, evolving workflows, and nuanced judgments
  • Prior experience in data annotation, AI evaluation, or related work (preferred)
  • Preferred Qualifications

  • BA degree (preferred) or comparable experience
  • Experience working with annotation tools or AI data platforms
  • Understanding of multimodal communication (text-to-image, video narratives, etc.)
  • Comfort with fast-paced projects and evolving quality standards
  • Awareness that incidental exposure to sensitive or NSFW content may occur
  • Why Join iMerit Scholars

  • Help shape how cutting-edge AI systems understand the world
  • Work remotely on projects at the forefront of multimodal AI
  • Gain hands-on experience in applied AI evaluation
  • Collaborate with a global, expert community of AI trainers
  • Next Steps

  • Start by taking the 30-minute skill assessment
  • Qualified applicants will be invited by email to a paid 12-hour pilot project (includes 2 hours paid training)
  • Strong results in the pilot may lead to ongoing, flexible remote work (15–40 hrs / week) with iMerit Scholars.
  • Criar um alerta de emprego para esta pesquisa

    Analyst • maringá, Brasil

    Vagas relacionadas
    Generative AI Engineer

    Generative AI Engineer

    AnswerThis (YC F25) • Maringá, Paraná, Brazil
    Location : Remote (Applications open worldwide) Compensation : $20,000 – 40,000 / year (based on experience and scope of ownership) Skills : Semantic Search, Vector Databases, Prompt Engineering, G...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    Senior Data Analyst / Modeler – Snowflake / Power BI

    Senior Data Analyst / Modeler – Snowflake / Power BI

    Rapida Solutions • Maringá, Paraná, Brazil
    About Us Rapida Solutions is an international data consultancy with teams across Thailand, Australia, and Brazil.We help global organizations unlock value from their data through modern cloud plat...Mostre mais
    Última atualização: 2 dias atrás • Promovida
    ServiceNOW AI trainner (Remote | PJ)

    ServiceNOW AI trainner (Remote | PJ)

    Hays • Maringá, Brasil
    Contractor / PJ (no medical / paid leave) 100% remote Project Time : .Full-time (40 hours / week) Time Zone Overlap : .We are seeking experienced professionals with. ServiceNow products , including.Customer...Mostre mais
    Última atualização: 1 dia atrás • Promovida
    Senior Business Intelligence Analyst

    Senior Business Intelligence Analyst

    Tata Consultancy Services • Maringá, Brasil
    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre mais
    Última atualização: 23 dias atrás • Promovida
    AI Consultant (Lead) ID35730

    AI Consultant (Lead) ID35730

    AgileEngine • Maringá, PR, br
    Quick Apply
    US and a top-3 ranked dev shop according to Clutch.We create award-winning custom software solutions that help companies across 15+ industries change the lives of millions.If you like a challenging...Mostre mais
    Última atualização: há mais de 30 dias
    Talent Data Analyst - Remote

    Talent Data Analyst - Remote

    INDI Staffing Services • Maringá, Paraná, Brazil
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    Data Analyst

    Data Analyst

    InterEx Group • Maringá, Paraná, Brazil
    Data Analyst (Remote – LATAM) Contract | 6-Months (Extension Likely) Industry : Global Logistics & Supply Chain Location : Remote – Latin America About the Role We are recruiting experienced Data A...Mostre mais
    Última atualização: 1 dia atrás • Promovida
    Atlassian Consultant

    Atlassian Consultant

    Atlas Bench • Maringá, Paraná, Brazil
    Company Description At Atlas Bench, we are committed to transforming teamwork across industries through innovative Atlassian services. Our global team, proficient in DevOps and ITSM, specializes in ...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    AI Engineer | Agents

    AI Engineer | Agents

    Bren • Maringá, Brasil
    Engenheiro(a) de IA Generativa (Generative AI Engineer).Na Bren, não construímos chatbots genéricos.Nosso produto é uma plataforma avançada de múltiplos agentes (vendas, suporte, insights) que orqu...Mostre mais
    Última atualização: 1 dia atrás • Promovida
    Gen AI Developer

    Gen AI Developer

    Tata Consultancy Services • Maringá, Brasil
    Come to one of the biggest IT Services companies in the world!! Here you can transform your career!.Why to join TCS? Here at TCS we believe that people make the difference, that's why we live a cul...Mostre mais
    Última atualização: 14 horas atrás • Promovida • Nova!
    Data Scientist - Remote

    Data Scientist - Remote

    INDI Staffing Services • Maringá, Paraná, Brazil
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    AI / ML Specialist

    AI / ML Specialist

    GFT Technologies Brasil • Maringá, Brazil
    Já conhece a GFT? Com mais de 35 anos de mercado e localizada em 16 países, a GFT emprega mais de 12.Aqui, a diversidade, a igualdade e a inclusão estão no centro e garantir um ambiente de trabalho...Mostre mais
    Última atualização: 9 dias atrás • Promovida
    Machine Learning Engineer

    Machine Learning Engineer

    UST España & Latam • Maringá, Paraná, Brazil
    We are still looking for talent… and we would love for you to join our team! For over 25 years, UST has worked alongside the world’s best companies to make a real impact through business transfor...Mostre mais
    Última atualização: 1 dia atrás • Promovida
    Senior Ai / Ml Engineer

    Senior Ai / Ml Engineer

    Linkedinbrazil • Maringá, Paraná, Brasil
    DashLX is an innovative technology company specializing in advanced AI solutions, focused on developing intelligent systems that leverage knowledge bases, multi-context processing, and custom auton...Mostre mais
    Última atualização: 1 dia atrás • Promovida
    AI Gateway Engineer

    AI Gateway Engineer

    AVM Consulting Inc • Maringá, Paraná, Brazil
    AI Gateway Engineer We are seeking a skilled AI Gateway Engineer to join our team.The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend develo...Mostre mais
    Última atualização: há mais de 30 dias • Promovida
    Senior Data Analyst / Modeler - Snowflake / Power BI

    Senior Data Analyst / Modeler - Snowflake / Power BI

    Rapida Solutions • Maringá, Paraná, Brazil
    About Us Rapida Solutions is an international data consultancy with teams across Thailand, Australia, and Brazil.We help global organizations unlock value from their data through modern cloud pla...Mostre mais
    Última atualização: 1 dia atrás • Promovida
    Data Quality Analyst

    Data Quality Analyst

    Microtalent is becoming INSPYR Global Solutions • Maringá, Brasil
    Data Quality Analyst Purpose : The Data Quality Analyst is responsible for auditing and testing enterprise applications with a focus on backend. ETL (Extract, Transform & Load).This role also involve...Mostre mais
    Última atualização: 9 dias atrás • Promovida
    Software Developer (Mobile / AI-Enabled Workflow)

    Software Developer (Mobile / AI-Enabled Workflow)

    Earned Media Productions • Maringá, Paraná, Brazil
    Software Developer (Mobile / AI-Enabled Workflow) We are looking for a talented software developer with strong mobile app development experience to join our team. The ideal candidate will be comfo...Mostre mais
    Última atualização: há mais de 30 dias • Promovida