Financial Professional
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: AI Model Evaluation Specialist
Type: Contract
Compensation: $60–$80/hour
Commitment: 20 hours/week
Role Responsibilities
- Write realistic prompts reflecting professional and consumer domain-specific guidance.
- Evaluate AI-generated responses for factual accuracy, regulatory correctness, and practical usefulness.
- Identify fabricated claims, incorrect references, or misleading reasoning in model outputs.
- Score and rank model responses using structured rubrics across dimensions.
- Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have
- Master’s degree or higher in Finance , Accounting , Law , Medicine , Healthcare , or Engineering .
- Professional experience applying domain expertise in a practitioner or advisory capacity.
- Familiarity with industry-specific standards, regulations, or clinical guidelines.
- Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
- Submit your resume to begin.
- Complete a Training Assessment.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: [email protected]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Recommended Jobs
Car Wash Sales Specialist
Are you a high-energy individual who loves talking to people? We are looking for a Sales Specialist to join our Tommy's Express Car Wash team. You won't just be processing transactions; you’ll be t…
Personal Assistant
We are seeking a trustworthy, organized Personal Assistant to help with daily household support, including running errands and handling routine payments. This role is ideal for someone dependable, det…
Senior Full Stack Software Engineer
Icarus was founded on the belief that the Stratosphere is the Forgotten Frontier and that reclaiming it will define the next era of aerospace and what is possible from the sky. We build solar-powere…
Senior Software Engineer, Rendering and Sensor Simulation
What we are looking for Aurora hires talented people with diverse backgrounds who are ready to help build a transportation ecosystem that will make our roads safer, get crucial goods where they ne…
Field Service Technician (CA)
At ABB, we help industries outrun - leaner and cleaner. Here, progress is an expectation - for you, your team, and the world. As a global market leader, we'll give you what you need to make it happen.…
Lead Software Optimization Engineer
Efficient is developing the world’s most energy-efficient general-purpose computer processor. Efficient’s patented technology uses 100x less energy than state of the art commercially available ultra-…
Clinician II MA (Wed-Sat) (Inpatient) (Santa Rosa)
ABOUT US: Formerly Aurora Santa Rosa Hospital, SRBHH was opened in 2016 and is regarded as an integral part of the greater Santa Rosa and Northern California mental health system of care. Conven…
Director/Senior Director Business Development - Commercial
Sr. Director of Business Development (Commercial) In this role, you will be responsible for identifying, prioritizing, and targeting prospective new business leads while collaborating with our org…
Software Engineer, Backend, Workflow Runner, San Francisco
Profound is on a mission to help companies understand and control their AI presence. We're building the foundational agentic layer for modern companies. Our Workflow Runner is the execution backbone …
Procurement Category Specialist, Contract
Title: Procurement Category Specialist, Contract Reports to : Procurement Manager, Canada Job Type: Full Time Contract Experience: 3-5 years + Education: Business/Bachelor Commerce De…