Compiler Engineer (Mid and/or Backend)

Persimmons
San Jose, CA

Who we are:

Persimmons is building the infrastructure that will power the next decade of AI. Founded in 2023 by veteran technologists from the worlds of semiconductors, AI systems, and software innovation, We’re on a mission to enable smarter devices, more sustainable data centers, and entirely new applications the world hasn’t imagined yet.

Why join us:

We’re growing fast and looking for bold thinkers, builders, and curious problem-solvers who want to push the limits of AI hardware and software. If you're ready to join a world-class team and play a critical role in making a global impact - we want to talk to you.

Summary of Role:

This role focuses on transforming higher-level MLIR-based large language models by applying sophisticated mid- and backend compiler techniques to target Persimmons.ai's custom accelerator hardware. You will help design and optimize the Persimmons Compiler mid- and backend, integrate it with custom operations and kernels, as well as implement compiler passes that convert higher-level intermediate representations into runtime-oriented code and libraries. This position offers the opportunity to directly shape Persimmons.ai’s innovative AI hardware and software stack through close collaboration with teams across hardware, systems, and software.

What you’ll do:

  • Develop and enhance MLIR-based compiler pipelines targeting Persimmons' custom spatial accelerator hardware.
  • Design and optimize the Persimmons Compiler mid- and backend techniques for efficient lowering, graph-to-resources mapping, and code generation.
  • Implement transformations to convert Python, PyTorch, and similar kernel representations to LLVM IR and runtime-ready libraries.
  • Architect and implement efficient support for SPMD-based, distributed collective operations and lower them through specialized MLIR compiler dialects (e.g., MESH, SHARDY).
  • Drive advanced loop optimizations leveraging polyhedral analysis: loop tiling, fusion, interchange, skewing, and related techniques.
  • Apply and optimize techniques such as bufferization, padding, inlining, and integration of custom operations and kernels within the compilation workflow.
  • Work on register allocation and instruction scheduling for Persimmons’ spatial hardware, ensuring high resource utilization, throughput, and low latency.
  • Contribute to graph and tensor partitioning logic for optimal hardware-targeted execution.
  • Collaborate across teams to deliver performant compilation flows from high-level ML representations to low-level executable artifacts.

Requirements

What You Bring To The Table:

  • We do not expect candidates to meet all of the requirements listed below; strong candidates will demonstrate expertise in several key areas.
  • Solid understanding and experience with underlying principles and methods of the MLIR framework (SSA representation, interfaces, rewriting, dialect hierarchy, etc.).
  • Hands-on experience with developing MLIR-based compiler infrastructure, algorithms, and techniques for non-GPU/custom spatial hardware architectures.
  • Working experience with lowering SIMD operations from PyTorch, Triton, xDSL, pyDSL, or similar Python-based frontends toward LLVM IR and, further, to SIMD kernel library.
  • Extensive experience and understanding of loop optimization based on polyhedral principles.
  • Experience and understanding of SPMD-based, distributed collective operations, specialized MLIR compiler dialects (e.g., MESH, SHARDY), and collective operation lowering in compilers for spatial hardware.
  • Experience with techniques such as padding, bufferization, inlining, and other lowering techniques.
  • Knowledge of register allocation and instruction scheduling in spatial architectures.
  • Experience in lowering and integration of custom operations and kernels at the compiler mid- and backend.
  • Familiarity with graph and tensor partitioning and mapping optimization algorithms and their integration in the compiler workflow.
  • High level of understanding and 5+ years of experience with C++ and appreciation for writing clean and maintainable code. Good knowledge of Python is a big plus.

Benefits

  • Competitive salary and benefits package.
  • Flexible PTO
  • 401k

Please note : Our organization does not accept unsolicited candidate submissions from external recruiters or agencies. Any such submissions, regardless of form (including but not limited to email, direct messaging, or social media), shall be deemed voluntary and shall not create any express or implied obligation on the part of the organization to pay any fees, commissions, or other compensation. Direct contact of employees, officers, or board members regarding employment opportunities is strictly prohibited and will not receive a response.

Posted 2026-03-03

Recommended Jobs

Software Engineer - Integration Platform

Conductorone
San Francisco, CA

Do you remember the first time you got a connector to just work ? After days of wrestling with a poorly documented API, decoding cryptic error messages, and reverse-engineering authentication flows—…

View Details
Posted 2026-03-04

Big Data Engineer

Uber
San Francisco, CA

Job Responsibilities: Work with tech and product teams to develop new tools and systems to support the growth of the business Create and optimize our data pipeline architecture Build data ac…

View Details
Posted 2026-02-10

Activity Coordinator

North East Medical Services
San Francisco, CA

The Activity Coordinator is responsible for providing a comprehensive therapeutic recreation program for PACE Participants. This includes assessment, care planning, and the coordination of therapeuti…

View Details
Posted 2026-01-09

Director of Finance

JCC East Bay
Berkeley, CA

ABOUT THE JCC EAST BAY The JCC East Bay (JCCEB) values hachnasat orchim (providing a welcoming home) for people of all ages and life stages. Inspired by Jewish values, culture, and tradition, we…

View Details
Posted 2026-02-28

GTM Engineer

LangChain
San Francisco, CA

About the Role: We are looking for an GTM Engineer where you won’t just be using our tools—you’ll be the "First Customer," building the AI-native systems that power our technical support, onboardi…

View Details
Posted 2026-02-19

Youth Development Professional

Boys & Girls Club of North Lake Tahoe
Truckee, CA

TRAVEL TO TRUCKEE , CA REQUIRED Our mission is to inspire and enable all youth, especially those who need us most, to reach their full potential as productive, caring, responsible citizens.  Under…

View Details
Posted 2026-02-28

Director, Finance, FP&A

HARMAN International
Carlsbad, CA

Description & Requirements About the Role As the Director, Finance in the Sound United SBU of the Lifestyle Division of HARMAN, you will be supporting the SBU leaders to create a…

View Details
Posted 2026-02-13

People Ops and Talent Manager

Anthro
Alameda, CA

We are looking for a Recruiting and People Ops Manager who will be the backbone of our employee experience and the engine behind our people systems as we scale. In this role, you’ll work across Peopl…

View Details
Posted 2026-01-16

Account Executive

Talent Pros Recruiting Specialists
Concord, CA

Account Executive – Concord, CA Build Your Sales Career with a National Industry Leader Are you a competitive, self-driven sales professional who thrives in a fast-paced, field-based enviro…

View Details
Posted 2026-01-24

Personal Injury Lien Reduction Specialist

TORKLAW
Irvine, CA

ALL APPLICANTS AND APPLICATIONS WILL REMAIN CONFIDENTIAL - APPLY WITH CONFIDENCE Full time: In Office, Irvine, CA Pay: $50K - $70K DOE TORKLAW is more than an award-winning personal injury…

View Details
Posted 2026-02-25