Finance Domain Expert for AI Training and Evaluation
Drive how advanced generative AI models understand and perform real financial work by providing deep, practice-based finance judgment. In this hands-on role you will assess model outputs, author precise instruction specifications and golden solutions, and build rigorous benchmarks so research teams can measure real improvement. This position places you on-site with a leading AI research team as a W-2 employee of Cincinnatus LLC.
Key Responsibilities- Data quality reviews: Vet finance tasks and model outputs for missing behaviors, shallow or flawed reasoning, incorrect assumptions, and answers that look plausible but would fail professional review.
- Instruction specs and golden datasets: Write high-quality instruction specifications, create authoritative solutions to financial problems, and define new tasks that reflect real-world finance practice.
- Benchmark design: Design challenging finance evaluation sets and tasks that reveal domain depth, and collaborate with researchers to build finance-specific skills and tools.
- Calibration and standards: Work with researchers and adjacent specialists to translate tacit financial judgment into explicit, teachable evaluation criteria and keep standards consistent.
- Minimum 5 years of substantive, dedicated professional finance experience at a recognized institution such as an investment bank, asset manager, private equity or credit fund, Big Four firm, large corporate finance function, or financial regulator. Roles that only touch finance peripherally do not meet this requirement.
- Specialization in at least one core finance discipline, for example corporate finance and FP&A, investment banking and M&A, asset or wealth management, private equity or private credit, quantitative finance and risk management, treasury, or accounting and audit.
- Senior-level progression with clear ownership of analysis and decisions, such as titles like Vice President, Director, Principal, Managing Director, Portfolio Manager, Controller, or CFO.
- Advanced degree from a strong program (MBA, MS, or PhD in finance, economics, accounting, or a quantitative field) and/or a recognized credential such as CFA, CPA, FRM, or an actuarial designation, strongly preferred.
- Practical familiarity with large language models, including hands-on use in professional work, and the judgment to distinguish well-reasoned answers from plausible-sounding but incorrect outputs.
- Excellent written communication, including the ability to provide precise, well-structured written feedback.
- Availability to commit reliably to 40 hours per week for an initial engagement of 6 months.
- Employment type: Full-time W-2 employment through Cincinnatus LLC, serving as the employer of record for this placement.
- Onsite requirement: Hybrid role based in the Bay Area, California. You must live in the Bay Area and be able to work on-site with the client''s team multiple days each week when required. This is not a remote role.
- Relocation: Candidates not currently based in the Bay Area must be willing to relocate at their own expense; relocation assistance is not provided.
- Placement and tools: You will be placed as part of the client research team, provisioned with client-issued accounts and equipment, and will work inside the client’s tools and workflows alongside their researchers.
- Engagement character: These roles are structured, role-based positions rather than freelance or short project gigs, and involve close collaboration and integration into standard enterprise workflows.
- Pay rate: $60.00 to $100.00 per hour.
- Must be able to accept W-2 employment with Cincinnatus LLC.
- Must reside in the Bay Area, California or relocate there before the engagement begins, at the candidate''s expense.
- Cincinnatus LLC administers employment, onboarding, payroll, benefits, and compliance for this role as the employer of record.
- Cincinnatus is an Equal Employment Opportunity employer and will provide reasonable accommodations for qualified applicants with disabilities.
Submit your resume and a brief cover letter describing your relevant finance specialization and hands-on experience with large language models. Applications will be processed through the hiring organization, and if selected you will be onboarded as a W-2 employee of Cincinnatus LLC which manages payroll, benefits, and employment administration for this placement.
Recommended Jobs
Management Company Controller
We are a provider of specialized fund administration services for Managers and General Partners of private equity funds, specifically: Buy‐out, Venture Capital, Real Estate and Fund‐of‐ Funds. For ne…
Film Processor
What you´ll do The Use of equipment and tools needed to Inspect and package into finish good orders Count and package various size film material Verify labels against Production Order paperw…
Senior Counsel, Infrastructure
About Fluidstack We exist to make humanity more free. For most of human history, you farmed or you starved. Technology gave people more time for the thi…
Guest Service Representative
Job Description Job Description Benefits/Perks Flexible Scheduling Career Advancement Opportunities Competitive Compensation Job Summary We are looking for a customer-focused Gues…
Locum Physician- Neurosurgery
Description . This on-site, contract position is designed for a mid-senior level professional eager to make a significant impact in the neurosurgical field. You will play a crucial role in providi…
Bartender
Company San Vicente is a private membership club designed to attract a diverse and unique community of individuals from the creative and business worlds, each contributing something unique to its so…
Cafe Manager
About Cafe Knotted: Cafe Knotted is a beloved dessert cafe from Seoul, founded in 2017 and known for its hand-crafted cream-filled donuts, fresh milk cream, and playful design. The brand quickly g…
Project Controls Specialist III (Cost Analyst)
Job Description Job Description Summary Our client is seeking an experienced Project Controls Specialist III (Cost Analyst) to support large-scale capital construction projects for the Los Ange…