AI Evaluator - Software Expert - AI Trainer
- Experience
- Senior level · 5+ years
- Location
- Remote, United States
- Work arrangement
- Remote
- Employment type
- Contract
- Category
- Information Technology
- Industry
- Information Technology
- Experience
- Senior level · 5+ years
- Salary
- $80 – $120 / hour
- Openings
- 1
- Apply by
- 19 Jan 2027
About the role
Mercor is hiring an AI Evaluator - Software Expert - AI Trainer to help improve leading AI models. This is a fully remote contract role open to candidates based in the United States, paying $80 to $120 per hour. You will evaluate AI-generated artifacts such as documents, spreadsheets and slide decks against domain-specific quality rubrics, identifying factual, aesthetic and presentation errors and providing clear, structured written feedback. You will apply your subject-matter expertise in software, AI, IT and data to judge the quality of model outputs and help shape the next generation of AI systems. The work is independent and asynchronous, with no fixed schedule beyond the projects you take on. Mercor connects elite creative and technical talent with leading AI research labs, and is headquartered in San Francisco.
Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics - Identify factual, aesthetic and presentation errors in documents, spreadsheets and slide decks - Provide clear, structured written feedback on model outputs - Apply subject-matter expertise in software, AI, IT and data to quality judgments - Work independently and asynchronously on evaluation projects
Requirements
- 5+ years of relevant professional experience in software, AI, IT or data - Native or professional fluency in English - Highly proficient in Microsoft Office and Google Workspace, especially Google Slides - Strong attention to detail and clear written communication - Ability to work independently and asynchronously
Preferred qualifications
An advanced degree (master's or higher) in a relevant field; experience evaluating AI outputs or training AI systems; experience creating or reviewing technical documentation.
Benefits
Competitive hourly compensation of $80 to $120 per hour; flexible, fully remote, asynchronous work; the opportunity to shape leading AI models; work with a team connecting elite talent with top AI research labs.
Skills
How to apply
- Select Apply now.
- You are taken to mercor’s own application page to send your application.
Applying is free. We never ask candidates for money. The exact steps can differ by job and employer.