Financial Professional
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Model Evaluator
Type: Contract
Compensation: $50–$75/hour
Commitment: 20 hours/week
Role Responsibilities
- Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
- Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
- Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
- Score and rank multiple model responses using structured rubrics across dimensions.
- Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have- Master’s degree or higher in Finance, Accounting, or a relevant professional field.
- Professional experience applying domain expertise in a practitioner or advisory capacity.
- Familiarity with industry-specific standards, regulations, or clinical guidelines.
- Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
- Submit your resume to begin.
- Complete the Model Response Evaluation assessment.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: [email protected]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#J-18808-LjbffrRecommended Jobs
Field Clinical Specialist - Sacramento - Peripheral Vascular
The Field Clinical Specialist works using independent judgement, partners with local Account Managers to increase clinical support, education resulting in increased clinical acumen. Responsibili…
Engineer I
POSITION SUMMARY Respond and attend to guest repair requests. Communicate with guests/customers to resolve maintenance issues. Perform preventive maintenance on tools and kitchen and mechanical roo…
Senior Financial Analyst - Commercial
JOB DESCRIPTION Work Schedule Standard (Mon-Fri) Environmental Conditions Office Job Description At Thermo Fisher Scientific, our Finance teams are important to our business an…
Senior Vice President, Global Go-To-Market (GTM) - Citrix Security Business
Citrix is seeking an exceptional, growth-oriented Senior Vice President (SVP), Global Go-To-Market (GTM) – Citrix Security Business to build market credibility, lead, scale, and drive enterprise awar…
Part Time Core Sales Associate
Pandora @ Valley Fair [RELO] As the largest jewellery brand in the world, we a give a voice to millions of people’s loves every day. Our beautiful products empower people all around the world to …
VP of Estimating (Civil Construction)
Description We are seeking a highly skilled and experienced Vice President of Heavy Civil Construction Estimating to lead our estimating department. This pivotal role will involve strategic oversigh…
City Manager - Luxury Retail
Are you a passionate retail leader with a strong commercial mindset and a talent for developing high-performing teams? We are looking for an experienced City Manager to oversee our store operation…
Senior Bioinformatics Scientist (South San Francisco, CA)
We are seeking a highly motivated and innovative Senior/Staff Bioinformatics Scientist to join our R&D team focused on synthetic biology product development. In this role, you will work at the int…
Executive Assistant (Korean Speaking)
Executive Assistant (Korean Speaking) JOB-10047275 Anticipated Start Date August 24, 2026 Location Austin, TX Type of Employment Contract to Hire Job Summary We…