AI Evaluations Program Manager

Location: Business Unit CA - San Francisco
US - Remote
NY - New York City

The role:

We are seeking an AI Evaluations Program Manager to own the end-to-end process for evaluating AI chat outputs in a financial services context. This role is critical to ensuring our AI delivers guidance and education that is accurate, compliant, consistent, and genuinely helpful to members who want to Get Their Money Right.

You’ll be responsible for managing the daily evaluation workflows for AI-generated chat responses, with particular attention to financial accuracy, regulatory risk, and user helpfulness. You’ll also own the continuous improvement loop, translating evaluation insights into measurable improvements through partnership with our Legal, Compliance, Engineering, Product, and Design (EPD) teams.

As the program manager, you’ll sit at the intersection of product, AI, operations, risk, and financial expertise, helping us achieve our mission to empower members to reach financial independence.

What you’ll do:

Own the AI Evaluation Program on SoFi’s AI powered financial coach, designing processes related to daily workflows, schedules for grading and reporting.

Work alongside our technology team to integrate feedback and test improvements of AI guardrails and overall knowledge base.

Establish and lead the continuous improvement loop to ensure all stakeholders are informed of performance, improvements, trends, issues and other metrics.

Partner with Product, Legal & Compliance to maintain the AI knowledge base as well as any data retention and documentation processes.

What you’ll need:

8+ years of professional experience working in program management, operations, quality, risk, or evaluation roles within a financial services organization.

Familiarity with AI/LLM technologies and their application in providing personalized guidance.

Experience building and managing structured processes in complex or regulated environments.

Excellent analytical skills and comfort working with both qualitative and quantitative data.

Strong stakeholder management skills, with the ability to drive alignment across technical, financial, and regulatory partners.

Familiarity with financial products such as investments, retirement accounts, loans and banking.

Nice to have:

Credentials: CFP® or other professional financial designation.

Licenses: FINRA Series 65 or interest in obtaining.

Prior experience in financial technology (fintech), Financial Advisory or Wealth Management.

Experience directly working with technical teams.

Compensation and Benefits

The base pay range for this role is listed below. Final base pay offer will be determined based on individual factors such as the candidate’s experience, skills, and location.

Pay range: $105,600.00 - $198,000.00

Payment frequency: Annual

This role is also eligible for a bonus, long‑term incentives and competitive benefits.

To view all of our comprehensive and competitive benefits, visit the Benefits at SoFi page.

Equal Employment Opportunity Statement

SoFi provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion (including religious dress and grooming practices), sex (including pregnancy, childbirth and related medical conditions, breastfeeding, and conditions related to breastfeeding), gender, gender identity, gender expression, national origin, ancestry, age (40 or over), physical or medical disability, medical condition, marital status, registered domestic partner status, sexual orientation, genetic information, military and/or veteran status, or any other basis prohibited by applicable state or federal law.

San Francisco Fair Chance Ordinance

The Company hires the best qualified candidate for the job, without regard to protected characteristics. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Inclusion and Accommodation

SoFi is committed to an inclusive culture. As part of this commitment, SoFi offers reasonable accommodations to candidates with physical or mental disabilities. If you need accommodations to participate in the job application or interview process, please let your recruiter know or email [email protected].

Remote Work

Due to insurance coverage issues, we are unable to accommodate remote work from Hawaii or Alaska at this time.

Internal Employees

If you are a current employee, do not apply here – please navigate to our Internal Job Board in Greenhouse to apply to our open roles.