AI Safety Specialist - Evaluation Expert
- Location
- Remote, Luxembourg
- Work arrangement
- Remote
- Employment type
- Contract
- Category
- Science & Research
- Industry
- Information Technology
- Salary
- $60 – $70 / hour
- Openings
- 1
About the role
mercor is looking for an AI Safety Specialist - Evaluation Expert to evaluate AI systems for safety. This is a remote, contract role paying $60 to $70 per hour. You will design and run evaluations that test how AI models behave in risky or edge-case situations, looking for harmful, biased or unsafe outputs and helping teams understand where safeguards are needed. A typical day may include writing evaluation prompts and test cases, reviewing model responses against safety criteria, documenting findings clearly, and working with researchers and engineers to improve evaluation methods. You will bring careful judgement to ambiguous cases, stay current with AI safety research, and communicate your findings in a way that helps teams act on them. This role suits someone with deep expertise in AI safety, evaluation or a related field who enjoys rigorous, detail-oriented work and wants the flexibility of a fully remote contract role.
Responsibilities
- Design and run evaluations testing AI model safety - Write evaluation prompts and test cases for risky and edge-case scenarios - Review model outputs against safety criteria and document findings - Work with researchers and engineers to improve evaluation methods - Communicate safety findings clearly so teams can act on them
Requirements
Deep expertise in AI safety, AI evaluation, machine learning or a closely related field. Strong analytical judgement, careful attention to detail, and clear written communication. Able to work independently in a fully remote, contract role and handle ambiguous safety questions rigorously.
Benefits
- Fully remote contract work - Pay of $60 to $70 per hour - Work at the forefront of AI safety evaluation
Skills
How to apply
- Select Apply now.
- You are taken to mercor’s own application page to send your application.
Applying is free. We never ask candidates for money. The exact steps can differ by job and employer.