Talent.com
Multimodal AI Evaluation Analyst

Multimodal AI Evaluation Analyst

iMerit TechnologyWorkFromHome, Jawa Barat, Indonesia
3 days ago
Job description

Senior Manager Talent Acquisition Global workforce at iMerit Technology

Target Language : English

Position Type : - Remote; Contract ($5 / hour); ~10-40 hours per week

Position Overview

iMerit Scholars is rapidly expanding our network of skilled AI Evaluation Analysts to help advance next-generation multimodal AI systems.

This opportunity begins with a short paid pilot project (~12 hours total). Successful participants may be invited to continue with ongoing project work (typically 15–40 hours per week), depending on performance and project needs.

As a Multimodal AI Evaluation Analyst, you’ll perform highly detailed evaluations of AI system outputs across text, image, video, and multimodal prompts. Your feedback will directly influence how leading AI systems understand and interact with the world.

Compensation & Work Structure

  • Rate : $5 / hour
  • Phase 1 : ~12-hour paid pilot project (completed within a few days)
  • Phase 2 : Ongoing contract work (typically 15–40 hours / week) for top performers

What You’ll Do

  • Evaluate and score AI-generated outputs (text, image captions, video descriptions, multimodal prompts)
  • Assess quality, correctness, coherence, style, and cultural alignment
  • Identify subtle issues like hallucinations, logical gaps, or bias
  • Provide detailed written feedback and apply complex evaluation guidelines consistently
  • Collaborate with Quality Leads and Project Managers to ensure reliability and accuracy
  • What You Bring

  • Excellent critical reading and evaluation skills across multiple modalities
  • Familiarity with LLMs, generative AI, and multimodal systems
  • Exceptional attention to detail and consistency
  • Comfort with iterative feedback, evolving workflows, and nuanced judgments
  • Prior experience in data annotation, AI evaluation, or related work (preferred)
  • Preferred Qualifications

  • BA degree (preferred) or comparable experience
  • Experience working with annotation tools or AI data platforms
  • Understanding of multimodal communication (text-to-image, video narratives, etc.)Comfort with fast-paced projects and evolving quality standards
  • Awareness that incidental exposure to sensitive or NSFW content may occur
  • Why Join iMerit Scholars

  • Help shape how cutting-edge AI systems understand the world
  • Work remotely on projects at the forefront of multimodal AI
  • Collaborate with a global, expert community of AI trainers
  • Next Steps

  • Start by taking the 30-minute skill assessment
  • Qualified applicants will be invited by email to a paid 12-hour pilot project (includes 2 hours paid training)
  • Strong results in the pilot may lead to ongoing, flexible remote work (15–40 hrs / week) with iMerit Scholars.
  • #J-18808-Ljbffr

    Create a job alert for this search

    Analyst • WorkFromHome, Jawa Barat, Indonesia

    Related jobs
    • Promoted
    Experienced Indonesian Interpreters

    Experienced Indonesian Interpreters

    AsialocalizeBandung, West Java, Indonesia
    AsiaLocalize provides comprehensive translation and localization services to support clients in accessing and succeeding in global markets. With a wide range of professional native translators, expe...Show moreLast updated: 30+ days ago
    • Promoted
    DevOps Engineer – AI / ML Infrastructure

    DevOps Engineer – AI / ML Infrastructure

    SiloTech.xyzWorkFromHome, Jawa Barat, Indonesia
    Human Resources | Customer Support Representative | Blockchain / Web3 Advocate.To apply, please complete this form : .Do not email your CV — we only process applications submitted through the form.This...Show moreLast updated: 3 days ago
    • Promoted
    EDI & API Analyst

    EDI & API Analyst

    BruntWorkWorkFromHome, Jawa Barat, Indonesia
    We are seeking a highly skilled.EDI) and application programming interface (API) connections between the company and its customers, vendors, and logistics partners. This role is essential in ensurin...Show moreLast updated: 1 day ago
    Senior AI Research Engineer, Model Inference (100% Remote)

    Senior AI Research Engineer, Model Inference (100% Remote)

    Tether Operations LimitedBandung, JB, ID
    Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution. Our cutting-edge solutions empower businesses—from ex...Show moreLast updated: 30+ days ago
    Indonesian Native Speakers Wanted for AI Voice Project

    Indonesian Native Speakers Wanted for AI Voice Project

    Your Personal AIBandung, JB, ID
    Indonesian Native Speakers Wanted for AI Voice Project at Your Personal AI.Your Personal AI is seeking Indonesian native speakers to join our exciting AI voice project team.As a valued member, you ...Show moreLast updated: 30+ days ago
    • Promoted
    Madurese Linguistic Projects (Remote)

    Madurese Linguistic Projects (Remote)

    Sigma AIWorkFromHome, Jawa Barat, Indonesia
    AI – Shaping the Future of Artificial Intelligence.What is Sigma? Sigma is a leading global technology company specializing in data collection and annotation for Artificial Intelligence.With over 3...Show moreLast updated: 30+ days ago
    • Promoted
    Basque Trilingual Language Specialist – AI Trainer

    Basque Trilingual Language Specialist – AI Trainer

    Invisible Expert MarketplaceWorkFromHome, Jawa Barat, Indonesia
    Basque Trilingual Language Specialist – AI Trainer.Are you fluent in Basque, English, and at least one additional language, and eager to apply your linguistic expertise to the future of AI? Large-s...Show moreLast updated: 3 days ago
    • Promoted
    System Analyst

    System Analyst

    RoketinKota Bandung, Jawa Barat, Indonesia
    Have experience as a business analyst at least 1 year.Have experience in designing software using BPMN, use Case Diagrams, Data Flow Diagrams (DFD), Activity Diagrams, Sequence Diagrams, Entity Rel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer, AI Model serving - Jakarta, Indonesia

    Senior Software Engineer, AI Model serving - Jakarta, Indonesia

    SpeechifyWorkFromHome, Jawa Barat, Indonesia
    PLEASE APPLY THROUGH THIS LINK : .The mission of Speechify is to make sure that reading is never a barrier to learning.Over 50 million people use Speechify’s text-to-speech products to turn whatever ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Software Engineer - AI Training Review Layer (Python)

    Senior Software Engineer - AI Training Review Layer (Python)

    G2i Inc.WorkFromHome, Jawa Barat, Indonesia
    Senior Software Engineer - AI Training Review Layer (Python).Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features. For the complete list of accepted locatio...Show moreLast updated: 29 days ago
    Senior Research Engineer Multimodal & Video Foundation Model (100% Remote)

    Senior Research Engineer Multimodal & Video Foundation Model (100% Remote)

    Tether Operations LimitedBandung, JB, ID
    Join Tether and Shape the Future of Digital Finance.At Tether, we’re not just building products, we’re pioneering a global financial revolution. Our cutting-edge solutions empower businesses—from ex...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Data Scientist

    Sr. Data Scientist

    GE Renewable Energy Power and AviationSubang, Jawa Barat, Indonesia
    The Sr Data Scientist will develop and implement Artificial Intelligence based solutions across various disciplines in GE Aerospace. In this role, the candidate will contribute to the development an...Show moreLast updated: 2 days ago
    • Promoted
    Video Editor Astronomy - Remote, UK Based Media Company

    Video Editor Astronomy - Remote, UK Based Media Company

    AnypearWorkFromHome, Jawa Barat, Indonesia
    Anypear is a headhunting and recruitment agency connecting New Zealand and Australian businesses with top overseas talent. We are currently on the lookout for a talented.UK-based media company in cr...Show moreLast updated: 1 day ago
    • Promoted
    Data Scientist

    Data Scientist

    Mobius DigitalWorkFromHome, Jawa Barat, Indonesia
    We are hiring developers for projects with one of the biggest reputable conglomerates in Indonesia.With us, you will be exposed to many exciting challenges and opportunities to grow through develop...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer (Chinese)

    Software Engineer (Chinese)

    Crossing HurdlesWorkFromHome, Jawa Barat, Indonesia
    This is a contract opportunity to contribute to cutting‑edge AI projects.The role involves designing realistic conversations in. You’ll be simulating real‑world interactions between users and AI ass...Show moreLast updated: 3 days ago
    • Promoted
    Technical Business Analyst

    Technical Business Analyst

    The Software Practice Pte LtdJawa Barat, Indonesia
    We are looking for a Technical Business Analyst to join our team.We will work together to design, implement and deliver mission-critical web and mobile applications for our clients.It is imperative...Show moreLast updated: 5 days ago
    • Promoted
    PhD Data Partner - Biology - Asia | Fully Remote

    PhD Data Partner - Biology - Asia | Fully Remote

    TELUS Digital AI Data SolutionsWorkFromHome, Jawa Barat, Indonesia
    PhD Data Partner - Biology - Asia | Fully Remote.PhD Data Partner - Biology - Asia | Fully Remote.TELUS Digital AI Data Solutions. Are you ready to use your domain knowledge to advance AI? Join us a...Show moreLast updated: 30+ days ago
    • Promoted
    GTM Analytics Analyst

    GTM Analytics Analyst

    SpiralyzeWorkFromHome, Jawa Barat, Indonesia
    We’re looking for someone great to join our Analytics Team! Your primary task is to help internal and external clients add (complex) tracking and fix issues that arise. You will take extreme amounts...Show moreLast updated: 3 days ago