Medical Expert - Evaluation Specialist
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Model Evaluation Specialist
Type: Contract
Compensation: $50–$75/hour
Commitment: 20 hours/week
Role Responsibilities
- Write realistic prompts reflecting professional and consumer domain-specific guidance needs.
- Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
- Identify fabricated claims, incorrect references, or misleading reasoning in model outputs.
- Score and rank multiple model responses using structured rubrics across dimensions.
- Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have
- Master’s degree or higher in Health or a relevant professional field.
- Professional experience applying domain expertise in a practitioner or advisory capacity.
- Familiarity with industry-specific standards, regulations, or clinical guidelines.
- Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
- Submit your resume to begin.
- Complete the Model Response Evaluation assessment.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: [email protected]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Recommended Jobs
Structures Designer San Diego, CA
Structures Designer San Diego, CA. Requirements Minimum of 7 years of experience as a Structures designer or in a closely related role Strong foundational understanding of aircraft load paths a…
Regional ISP Sales Manager - West
Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices.…
**Pharmacist
Overview St. Francis Medical Center is one of the leading comprehensive healthcare institutions in Los Angeles. St. Francis provides vital healthcare services for the 700,000 adults and 300,000 c…
Product Strategy Manager, NA Value Added Services - Processing Solutions
Job Description The role will support the Senior Director of NA VAS Issuing Solutions across a range of product solutioning, strategy, commercialization and planning activities. Time spent on th…
Reporter, US News and Crime
OVERVIEW OF THE COMPANY Fox News Media FOX News Media operates the FOX News Channel (FNC), FOX Business Network (FBN), FOX News Digital, FOX News Audio, FOX News Books, the direct-to-consumer d…
Software Engineer - Perception / Fleet Mapping
High-definition HD maps are foundational to enabling safe, scalable autonomous driving. We are seeking highly motivated engineers who are passionate about solving complex, real-world problems and bui…
Data Security Administrator 2
Requisition Number: 28103 Required Travel: 0 - 10% Employment Type: Full Time/Salaried/Exempt Anticipated Salary Range: $70,215.00 - $100,000.00 Security Clearance: TS/SCI Leve…
Senior Acquisition Management Analyst
One Federal Solution (OFS) is seeking a Senior Acquisition Management Analyst to provide analytical and acquisition support for federal program operations. The Senior Acquisition Management Analyst w…
allcove Center Manager
PLEASE SUBMIT JOB APPLICATION ON OUR WEBSITE Job Title: allcove Center Manager FLSA Classification: Exempt Department: Programs Department Compensation: $80,000 - $110,000 Ann…
Category Analyst
The Category Analyst is responsible for collecting and analyzing data from multiple sources—including Circana, Nielsen, consumer data, and wholesale shipment data—to identify growth opportunities for…