Talent.com
Multimodal AI Evaluation Analyst

Multimodal AI Evaluation Analyst

iMerit TechnologyWorkFromHome, Indonesia
1 day ago
Job description

Senior Manager Talent Acquisition Global workforce at iMerit Technology

Target Language : English

Position Type : - Remote; Contract ($5 / hour); ~10-40 hours per week

Position Overview

iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems.

This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs.

As a Multimodal AI Evaluation Analyst, you’ll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world.

Compensation & Work Structure

  • Rate : $5 / hour
  • Phase 1 : ~12-hour paid pilot project (completed within a few days)
  • Phase 2 : Ongoing contract work (typically 15–40 hours / week) for top performers

What You’ll Do

  • Evaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts)
  • Assess quality, correctness, coherence, style, and cultural alignment
  • Identify subtle issues like hallucinations, logical gaps, or bias
  • Provide detailed written feedback and apply complex evaluation guidelines consistently
  • Collaborate with Quality Leads and Project Managers to ensure reliability and accuracy
  • What You Bring

  • Excellent critical reading and evaluation skills across multiple modalities
  • Familiarity with LLMs, generative AI, and multimodal systems
  • Exceptional attention to detail and consistency
  • Comfort with iterative feedback, evolving workflows, and nuanced judgments
  • Prior experience in data annotation, AI evaluation, or related work (preferred)
  • Preferred Qualifications

  • BA degree (preferred) or comparable experience
  • Experience working with annotation tools or AI data platforms
  • Understanding of multimodal communication (text-to-image, video narratives, etc.)Comfort with fast-paced projects and evolving quality standards
  • Awareness that incidental exposure to sensitive or NSFW content may occur
  • Why Join iMerit Scholars

  • Help shape how cutting-edge AI systems understand the world
  • Work remotely on projects at the forefront of multimodal AI
  • Collaborate with a global, expert community of AI trainers
  • Next Steps

  • Start by taking the 30-minute skill assessment
  • Qualified applicants will be invited by email to a paid 12-hour pilot project (includes 2 hours paid training)
  • Strong results in the pilot may lead to ongoing, flexible remote work (15–40 hrs / week) with iMerit Scholars.
  • #J-18808-Ljbffr

    Create a job alert for this search

    Analyst • WorkFromHome, Indonesia

    Related jobs
    Sr AI Engineer

    Sr AI Engineer

    Zealogics.comID
    Quick Apply
    Key Responsibilities : Develop and deploy AI-driven workflows for SFDC integration to enhance sales automation.Work on Sydney, our AI Virtual Assistant, to optimize lead qualification processes.Impl...Show moreLast updated: 30+ days ago
    • Promoted
    DevOps Engineer – AI / ML Infrastructure

    DevOps Engineer – AI / ML Infrastructure

    SiloTech.xyzWorkFromHome, Indonesia
    Human Resources | Customer Support Representative | Blockchain / Web3 Advocate.To apply, please complete this form : .Do not email your CV — we only process applications submitted through the form.This...Show moreLast updated: 1 day ago
    Data Analyst - Active Pooling

    Data Analyst - Active Pooling

    Activate TalentID
    Quick Apply
    DISCLAIMER : Please note that this job posting is for active pooling purposes only.By submitting your application, you are expressing interest in potential future opportunities with Activate Talent....Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer - NLP

    AI Engineer - NLP

    AJARI.AIIndonesia
    We combine cutting-edge technology with a human-centered approach to create relevant, efficient, and sustainable products and services. Founded with a vision to drive digital transformation across i...Show moreLast updated: 15 days ago
    • Promoted
    Senior Software Engineer (Multiple Stacks) - RemoteContract

    Senior Software Engineer (Multiple Stacks) - RemoteContract

    Salve.Inno ConsultingIndonesia, Indonesia
    We are hiring experienced Senior Software Engineers (3-9 years) for ongoing, short-term remote projects with a global AI-driven platform. This initiative supports a leading technology client's LLM E...Show moreLast updated: 30+ days ago
    • Promoted
    PhD Data Partner - Biology - Asia | Fully Remote

    PhD Data Partner - Biology - Asia | Fully Remote

    TELUS Digital AI Data SolutionsWorkFromHome, Indonesia
    PhD Data Partner - Biology - Asia | Fully Remote.PhD Data Partner - Biology - Asia | Fully Remote.TELUS Digital AI Data Solutions. Are you ready to use your domain knowledge to advance AI? Join us a...Show moreLast updated: 30+ days ago
    • Promoted
    AI Video Creator (remote)

    AI Video Creator (remote)

    Bored PandaIndonesia, Indonesia
    We are one of the leading tech-driven media and entertainment companies, producing uplifting content in 17 languages for people of all ages. Known for award-winning art and pop culture magazine Bore...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    ATI Business GroupIndonesia
    We're looking for an AI Engineer to strengthen our AI development and automation capability within the Data, AI & Platform division. The role focuses on building and operationalizing intelligent sys...Show moreLast updated: 29 days ago
    • Promoted
    AI Functional Lead

    AI Functional Lead

    IndosatIndonesia
    Department : Group Product & Offering Strategy.The main purpose of the position is to drive innovation in artificial intelligence by creating robust, efficient, scalable neural network solutions, an...Show moreLast updated: 30+ days ago
    • Promoted
    Business Analyst (Indonesian) - 47746

    Business Analyst (Indonesian) - 47746

    TuringWorkFromHome, Indonesia
    Get AI-powered advice on this job and more exclusive features.We’re seeking detail-oriented candidates with strong analytical and English comprehension skills. You’ll read, summarize, and analyze co...Show moreLast updated: 30+ days ago
    • Promoted
    Analyst : Indonesia

    Analyst : Indonesia

    Andaman PartnersWorkFromHome, Indonesia
    Project Manager (Operations) or Content Manager & Lead : Market Research.This role works with our international team and across our ANDAMAN Advisory and ANDAMAN Trade businesses with key tasks as fo...Show moreLast updated: 3 days ago
    • Promoted
    UX Researcher

    UX Researcher

    AJARI.AIIndonesia
    AJARI TECHNOLOGIES is a technology company focused on an AI-powered learning and workforce development platform.Our solutions are designed for governments, institutions, schools, universities, and ...Show moreLast updated: 1 day ago
    Engagement Analyst - Indonesia

    Engagement Analyst - Indonesia

    Climate Bonds InitiativeID
    Quick Apply
    Job Title : Job Title : Engagement Analyst .We’re on a mission to mobilise global capital for climate action.We’re committed to mobilising the power of the global bond market to drive real clim...Show moreLast updated: 1 day ago
    AI Engineer

    AI Engineer

    WRS HealthID
    Quick Apply
    Company Overview Voted #1 EHR by PC Mag, WRS Health delivers a fully integrated cloud based EMR and practice management solutions to its clients. We bring solutions to physicians by providing consta...Show moreLast updated: 30+ days ago
    AI Video Creator

    AI Video Creator

    Bamboo WorksID
    Quick Apply
    We’re hiring an AI Video Creator to join our growing team in Miami.This role leads a team of editors, develops AI-powered video concepts, and delivers high-quality content across platforms li...Show moreLast updated: 30+ days ago
    • Promoted
    Data Science (AI Engineer)

    Data Science (AI Engineer)

    UnitedtractorsIndonesia
    Extract large volumes of data from multiple internal and external sources.Develop data-driven solutions for the most pressing challenges. Create new algorithms to solve problems and build tools for ...Show moreLast updated: 3 days ago
    • Promoted
    L2 Cybersecurity Analyst

    L2 Cybersecurity Analyst

    Sumber Solusi Hebat - Member of Gan KapitalIndonesia
    Location : Placed at a Security Operations Center (SOC).Employment Type : Full-time / Contract.We are looking for an experienced L2 Cybersecurity Analyst to join our team at Sumber Solusi Hebat, work...Show moreLast updated: 1 day ago
    • Promoted
    AI Content Creator

    AI Content Creator

    Bored PandaIndonesia, Indonesia
    We are one of the leading tech-driven media and entertainment companies, producing uplifting content in 17 languages for people of all ages. Known for award-winning art and pop culture magazine bore...Show moreLast updated: 30+ days ago