Talent.com
A vaga não está disponível no seu país.
QA / Red Teaming Expert

QA / Red Teaming Expert

Innodata Inc.manaus, estado do amazonas, br
Há 2 dias
Descrição da vaga

Job Description :

We are seeking highly analytical and detail-oriented professionals with hands-on experience in Red Teaming, Prompt Evaluation , and AI / LLM Quality Assurance . The ideal candidate will help us rigorously test and evaluate AI-generated content to identify vulnerabilities, assess risks, and ensure compliance with safety, ethical, and quality standards.

Job Title : - Red Teaming, Prompt Evaluation, or AI / LLM Quality Assurance Expert

Key Responsibilities :

  • Conduct Red Teaming exercises to identify adversarial, harmful, or unsafe outputs from large language models (LLMs).
  • Evaluate and stress-test AI prompts across multiple domains (e.g., finance, healthcare, security) to uncover potential failure modes.
  • Develop and apply test cases to assess accuracy, bias, toxicity, hallucinations , and misuse potential in AI-generated responses.
  • Collaborate with data scientists, safety researchers, and prompt engineers to report risks and suggest mitigations.
  • Perform manual QA and content validation across model versions, ensuring factual consistency, coherence, and guideline adherence.
  • Create evaluation frameworks and scoring rubrics for prompt performance and safety compliance.
  • Document findings, edge cases, and vulnerability reports with high clarity and structure.

Requirements :

  • Proven experience in AI red teaming , LLM safety testing, or adversarial prompt design.
  • Familiarity with prompt engineering , NLP tasks, and ethical considerations in generative AI.
  • Strong background in Quality Assurance , content review, or test case development for AI / ML systems.
  • Understanding of LLM behaviour's, failure modes, and model evaluation metrics.
  • Excellent critical thinking, pattern recognition, and analytical writing skills.
  • Ability to work independently, follow detailed evaluation protocols, and meet tight deadlines.
  • Preferred Qualifications :

  • Prior work with teams like Open AI, Anthropic, Google DeepMind, or other LLM safety initiatives.
  • Experience in risk assessment, red team security testing, or AI policy & governance.
  • Background in linguistics, psychology, or computational ethics is a plus.

    Kindly Attempt the below assessment to proceed further with your application.

  • https : / / icap.innodata.com / registerfreelancer?enc=oUTZVsr / Pnz / 0Xygc2EK32MdtinqnjC9vy8RU3Ha4EMfQdYWF8n1oAiUtOZXMcKhhhsYYecqmKWja8eKXV801gezikielezikiel
  • Criar um alerta de emprego para esta pesquisa

    Expert • manaus, estado do amazonas, br

    Vagas relacionadas
    • Promovida
    • Nova!
    Application Architect - MongoDB - International Team - Remote

    Application Architect - MongoDB - International Team - Remote

    Initi8 Recruitmentmanaus, Brasil
    Enterprise Application Architect.MongoDB experience is essential for this role.Strong Communication in Spanish and English is required for this position (Bonus points for Portuguese too!).Enterpris...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    Senior IT Technical Recruiter – LATAM Based

    Senior IT Technical Recruiter – LATAM Based

    AptonetManaus, BR
    Senior IT Technical Recruiters.Our recruiting team builds the foundation of our clients’ success by connecting them with extraordinary talent who share our vision and values.Proven experience recru...Mostre maisÚltima atualização: 2 dias atrás
    • Promovida
    Unreal Programmer

    Unreal Programmer

    Zelcar Games LLCmanaus, estado do amazonas, br
    Programadores Unreal (Júnior, Plenos e Sêniores) – Full-Time / MMORPG.Brasil que queiram crescer conosco em projetos reais e de longo prazo. Programadores plenos (6–8 USDT / h) : .Programadores sêniores...Mostre maisÚltima atualização: 1 dia atrás
    • Promovida
    • Nova!
    Microsoft Teams Specialist Senior

    Microsoft Teams Specialist Senior

    Tata Consultancy Servicesmanaus, Brasil
    Join one of the biggest IT Services companies in the world! Here you can transform your career!.Why join TCS? Here at TCS we believe that people make the difference, that's why we live a culture of...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    • Nova!
    Especialista IA

    Especialista IA

    Haysmanaus, Brasil
    Estamos em busca de uma pessoa desenvolvedora com experiência prática em soluções de Inteligência Artificial e automação de processos (RPA), com foco em tecnologias Microsoft.Se você gosta de traba...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    • Nova!
    Especialista em Cloudflare (TypeScript + Rust)

    Especialista em Cloudflare (TypeScript + Rust)

    Petrus Softwaremanaus, Brasil
    Especialista Cloudflare (TypeScript + Rust) — Core Bancário.Faixa salarial competitiva (a combinar).Cloudflare (Workers, D1, KV, Queues). Cloudflare Workers, D1, KV e Queues.Mostre maisÚltima atualização: 2 horas atrás
    • Promovida
    • Nova!
    Especialista Genesys Cloud - Remoto

    Especialista Genesys Cloud - Remoto

    HCLTechmanaus, Brasil
    Remota
    Good understanding of SIP Protocols, Genesys Framework and Architecture.Reporting components like CCPulse / Pulse, ICON, Infomart and CXInsights. Good troubleshooting experience in Genesys infrastruct...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    • Nova!
    Tech Lead.NET

    Tech Lead.NET

    Vortigo Digitalmanaus, Brasil
    Ampliamos nossa atuação e hoje desenvolvemos softwares para ajudar empresas e startups no processo de transformação digital. Nosso time é composto por pessoas apaixonadas por desafios gigantes, muda...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    Senior Fullstack Engineer (remoto)

    Senior Fullstack Engineer (remoto)

    BrunelManaus, BR
    Remota
    Nosso cliente global em rastreamento de CCU busca.Engenheiro(a) Sênior Fullstack.Papel essencial em novos recursos, escalabilidade e boas práticas, atuando em infraestrutura AWS com foco em rastrea...Mostre maisÚltima atualização: 2 dias atrás
    • Promovida
    • Nova!
    Red Hat OpenShift Engineer - Relocation to Portugal

    Red Hat OpenShift Engineer - Relocation to Portugal

    Aubay Portugalmanaus, Brasil
    Your connection with Aubay starts in the following lines : .Aubay Portugal is a multinational French company, in Portugal since 2007. We have offices in Lisbon and Oporto and we are a specialized cons...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    • Nova!
    Specialist

    Specialist

    Innodata Inc.manaus, Brasil
    ONLY CANDIDATES FROM BRAZIL (PORTUGUESE LANGUAGE) REQUIRED FOR THE GIVEN PROJECT • •.This is a short term, SME on demand requirement and require you to support on immediate basis.Apply only if you ar...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    • Nova!
    Remote Continuous Improvement Specialist

    Remote Continuous Improvement Specialist

    INDI Staffing Servicesmanaus, Brasil
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    • Nova!
    Senior Endpoint Engineer

    Senior Endpoint Engineer

    Pathlockmanaus, Brasil
    We are seeking a Senior Endpoint Engineer to join our endpoint management team in maintaining and securing 600+ corporate devices across our global organization. This remote position requires a tech...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    • Nova!
    Tech Lead.NET / React

    Tech Lead.NET / React

    Stefanini Groupmanaus, Brasil
    Procuramos um(a) profissional experiente, capaz de aliar liderança técnica, capacidade de decisão e atuação hands-on em projetos estratégicos. O(a) candidato(a) deverá ter perfil proativo, autonomia...Mostre maisÚltima atualização: 2 horas atrás
    • Promovida
    • Nova!
    Desenvolvedor.NET Core Sênior

    Desenvolvedor.NET Core Sênior

    BRQ Digital Solutionsmanaus, Brasil
    Há 32 anos no mercado, a BRQ Digital Solutions se consolidou como uma das maiores empresas de transformação digital do país. Com uma plataforma de serviços end to end, oferecemos as mais eficientes ...Mostre maisÚltima atualização: 1 hora atrás
    • Promovida
    Tech Lead Outsystems

    Tech Lead Outsystems

    Framework DigitalManaus, BR
    O que é preciso para fazer parte do time?.Requisitos técnicos essenciais : .ODC (OutSystems Developer Cloud).Domínio das ferramentas do ecossistema : . Service Center, Lifetime, Integration Studio, AI M...Mostre maisÚltima atualização: há mais de 30 dias
    • Promovida
    Tech Lead.Net Sênior

    Tech Lead.Net Sênior

    MetaManaus, BR
    Desenvolver técnicas outros colaboradores, transformando-as numa equipe que gera resultados;.Propor soluções com autonomia, apoiando a tomada de decisão de diferentes níveis de liderança;.Liderar o...Mostre maisÚltima atualização: 2 dias atrás
    • Promovida
    QA / Red Teaming Expert

    QA / Red Teaming Expert

    Innodata Inc.Manaus, BR
    We are seeking highly analytical and detail-oriented professionals with hands-on experience in.Red Teaming, Prompt Evaluation. The ideal candidate will help us rigorously test and evaluate AI-genera...Mostre maisÚltima atualização: 2 dias atrás
    • Promovida
    Product Designer (B.I. or People Analytics)

    Product Designer (B.I. or People Analytics)

    UitifyManaus, BR
    Professional English is a requirement for this role⚠️.A challenge will be required ⚠️.Uitify is a design studio specializing in delivering high-quality UI / UX and branding solutions for early-stage ...Mostre maisÚltima atualização: 2 dias atrás
    • Promovida
    • Nova!
    Especialista em Exchange

    Especialista em Exchange

    Psm Companymanaus, Brasil
    A PSM Company é especializada na identificação de Talentos para as áreas de TI / Telecom como também para as áreas operacionais e administrativas. Nossa história de sucesso, está baseada em nosso mo...Mostre maisÚltima atualização: 2 horas atrás