Senior Machine Learning Engineer

SAP
Palo Alto, CA

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

We are seeking a highly skilled and driven Senior Machine Learning Engineer to design and deliver intelligent, distributed systems that power large-scale AI and large language model (LLM) capabilities. In this role, you will shape cutting-edge infrastructure, mentor world-class engineers, and bring bold ideas from concept to production—driving meaningful impact across SAP’s global ecosystem.

Description

As a key member of our fast-moving team, you will have the unique opportunity to define and execute the vision for AI and LLM‑based systems at scale. We are looking for someone with exceptional programming expertise, deep distributed systems knowledge, and the curiosity and grit to tackle complex, ambiguous challenges. You will work across a diverse technology stack, collaborate closely with engineers and product leaders, and help set the technical direction for AI initiatives.

Key Responsibilities

  • Architect, design, and implement production systems in Go, Java, and Python (full‑stack experience a plus).
  • Build and optimize backend services, databases, APIs, and LLM infrastructure.
  • Leverage technologies such as Kafka, Postgres, HANA, gRPC, and advanced LLM frameworks.
  • Mentor and guide engineers from junior to senior levels, fostering technical excellence.
  • Partner with cross‑functional teams to translate business goals into scalable, high‑impact solutions.

Minimum Qualifications

  • Bachelor’s degree in Computer Science, Mathematics, Physics, or related field, with strong programming expertise.
  • 6+ years of software engineering experience, with a track record of delivering complex systems.
  • Proven ability to work independently and lead initiatives from idea to deployment.
  • Hands-on experience with AI/ML and/or LLM systems in a production environment.
  • Expertise in distributed systems design and implementation.
  • Familiarity with CI/CD pipelines and modern development practices.
  • Strong English communication skills and ability to thrive in a global, multicultural team.

Preferred Qualifications

  • Open-source contributions or significant personal technical projects.
  • Experience integrating AI capabilities into large‑scale enterprise products.
  • Strong problem‑solving skills and an iterative, results‑oriented mindset.

Why Join Us

  • Build cutting-edge AI and LLM systems used across SAP’s global platform.
  • Work in a high‑autonomy, trust‑based environment without unnecessary bureaucracy.
  • Collaborate with some of the best engineers in the industry in a fast‑paced, impact‑driven team.
  • Take ownership of projects that directly influence SAP’s AI strategy and product capabilities.

#SAPAIAPP

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: [email protected].

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program , according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, age, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability.

Compensation Range Transparency : SAP believes the value of pay transparency contributes towards an honest and supportive culture and is a significant step toward demonstrating SAP’s commitment to pay equity. SAP provides the annualized compensation range inclusive of base salary and variable incentive target for the career level applicable to the posted role. The targeted combined range for this position is 148,600 - 306300(USD) USD. The actual amount to be offered to the successful candidate will be within that range, dependent upon the key aspects of each case which may include education, skills, experience, scope of the role, location, etc. as determined through the selection process. Any SAP variable incentive includes a targeted dollar amount and any actual payout amount is dependent on company and personal performance. Please reference this link for a summary of SAP benefits and eligibility requirements:

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our .

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 446271 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid

Posted 2026-03-07

Recommended Jobs

Adult Day Program Staff

A Bright Future, Inc.
American Canyon, CA

A Bright Future Academy Headquarters Are in American Canyon, CA 94503 Mission Statement: To create tailored services designed to meet the specific needs of our consumers Industry: Servicing Disa…

View Details
Posted 2026-01-27

Traveling Electronic Security Systems Technician

Evergreen Fire and Security
San Diego, CA

Who We Are Evergreen Fire and Security (EFS) is a recognized leader in the life safety and security solutions industry.  We are entrusted by the Federal Government and commercial customers to prot…

View Details
Posted 2026-01-24

Business Manager

Aspire Public Schools
Sacramento, CA

Description We are accepting applications for an immediate position at Aspire Capitol Heights Academy in Sacramento, CA. ABOUT ASPIRE Aspire Public Schools operates a network of high-performing…

View Details
Posted 2026-02-24

Travel Registered Nurse ICU Job

Los Angeles, CA

Job Overview TLC Nursing Associates, Inc. is seeking a highly skilled Registered Nurse (RN) – Intensive Care Unit (ICU) to provide specialized nursing care to critically ill patients. The ICU RN …

View Details
Posted 2026-03-06

Citizen Hotel Autograph Collection - Host Person

Evolution Hospitality
Sacramento, CA

Join Our Team as a Host Person! As the Host, you're the VIP guide to a fabulous dining adventure! You’ll be the first to spot our guests and welcome them with a smile, whisking them off to their tabl…

View Details
Posted 2026-03-03

Summer Assistant Facility Manager

Premier Aquatics
Paramount, CA

COMPENSATION   $21.00-$24.00/hour  Full-time, hourly, or part-time, hourly  SUMMARY   As an Assistant Facility Manager, you will assist in organizing, scheduling, and providing direct daily …

View Details
Posted 2026-01-15

Accounts Receivable Specialist

Hanna Interpreting Services Llc
Spring Valley, CA

Key Responsibilities: The Accounts Receivable (AR) Specialist is responsible for overseeing the full lifecycle of customer receivables—from invoicing to payment application and collections. This r…

View Details
Posted 2026-03-04

Cybersecurity Associate - Regulatory, Audit, and Compliance- Local Candidates Only

VISA
Foster, CA

Job Description This Cybersecurity Associate position will serve as part of Visa's Cybersecurity Regulator, Audit, and Compliance function within the Cybersecurity Governance Risk and Compliance an…

View Details
Posted 2026-02-15

Project Accountant PT

Tri State General Contractors
Escondido, CA

We are a family owned and operated General Contractor in North San Diego County, Escondido specializing in high-quality Retail and Commercial Construction. We are seeking a detail-oriented and m…

View Details
Posted 2026-02-28

Regional Client Operations Manager

LaSalle Network
California

Please Read: This position is remote and requires a California resident, applicants not based in California will not be considered. LaSalle Network is hiring on behalf of a growing logistics techno…

View Details
Posted 2026-03-04