Software Engineer, Infrastructure

Harvey
San Francisco, CA

Why Harvey

Harvey is a secure AI platform for legal and professional services that augments productivity and automates complex workflows. Harvey uses algorithms with reasoning-adept LLMs that have been customized and developed by our expert team of lawyers, engineers and research scientists. We’ve found product market fit and are scaling our team very quickly. Some reasons to join Harvey are:

  • Exceptional product market fit: We have partnered with the largest law firms and professional service providers in the world, including Paul Weiss , A&O Shearman , Ashurst , O'Melveny & Myers, PwC , KKR, and many others.

  • Strategic investors: Raised over $200 million from strategic investors including Sequoia, Google Ventures, Kleiner Perkins, and the OpenAI Startup Fund.

  • World-class team: Harvey is hiring the best talent from DeepMind, Google Brain, Stripe, FAIR, Tesla Autopilot, Glean, Superhuman, Figma, and more.

  • Partnerships: Our engineers and researchers work directly with OpenAI to build the future of generative AI and redefine professional services.

  • Performance: 4x ARR in 2024.

  • Competitive compensation.

Role Overview

As a Software Engineer on the Infrastructure team at Harvey, you will build and maintain the infrastructure for serving our legal AI platform at scale. We are looking for software engineers with past infrastructure experience building large-scale distributed systems who are excited to build the foundational infrastructure for a fast growing startup.

This role is based in San Francisco, CA. We use an in-person work model and offer relocation assistance to new employees.

What You'll Do

  • Retrieval over peta-byte scale documents

  • Organizational-level interfaces to collaborate with AI

  • Managing dedicated GPU capacity across 5+ regions

  • 1000-step planning agents that help take companies public

  • Government-level security for the world's most sensitive matters

  • Evaluating LLMs across a 10k+ leaf taxonomy of tasks

  • Internet-scale data collection from over 50+ jurisdictions

What You Have

  • 3+ years of experience building and scaling distributed systems.

  • A deep understanding of how infrastructure-layer (Kubernetes, Database, OS, Cloud Storage etc) software systems work.

  • Strong attention to detail and spidey sense for where and when things could go wrong.

  • Track record of shipping high quality products.

  • Strong programming skills and general Computer Science knowledge.

Please find our CA applicant privacy notice here .

Compensation Range

$175,000 - $250,000 USD

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are in the early innings of a generational company. Joining early at a hypergrowth startup has proven to lead to exponential growth in responsibility, access, and ability. Apply here today!

Posted 2026-03-22

Recommended Jobs

Staff Software Engineer, Hyperscale Build Infrastructure

Pure Storage
Santa Clara, CA

We’re in an unbelievably exciting area of tech and are fundamentally reshaping the data storage industry. Here, you lead with innovative thinking, grow along with us, and join the smartest team in th…

View Details
Posted 2026-02-28

Senior Analyst, Personalization Data Science

Sephora
San Francisco, CA

Sephora USA is seeking a Senior Analyst in Personalization Data Science to join its innovative team. This remote position involves developing advanced analytical solutions and transforming raw data in…

View Details
Posted 2026-02-15

Embedded Software Manager (Networking)

TP-Link Systems Inc.
Irvine, CA

About Us Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi…

View Details
Posted 2026-01-15

E-Commerce Manager

SUNNY DISTRIBUTOR INC.
City of Industry, CA

Responsibilities: Develop direct and semi-direct online marketing channels to check and improve the internet presence of Sunny Health & Fitness. Provide recommendations for improvements to webs…

View Details
Posted 2026-01-21

Outbound Sales Specialist (Telecommunications) - Remote

NTT DATA, Inc.
California

Position Overview: As a Technical Sales Specialist, you will support our client’s suite of products and services where applicable and provide product/service options that are tailored to the needs…

View Details
Posted 2026-01-27

Senior Software Engineer, AI Ecosystem

Brex
San Francisco, CA

AI at Brex AI Engineering at Brex is redefining how businesses run their finances by building intelligent, autonomous systems directly into the Brex platform. Our teams develop AI agents that don’…

View Details
Posted 2026-03-04

Director, IT Service Desk & End User Experience (Enterprise & Distribution Ops) (Murrieta)

Jobot
Murrieta, CA

Civil Engineering - PE - Water - WW - SW in Reno! This Jobot Job is hosted by: Jeffrey Skarvan Are you a fit? Easy Apply now by clicking the "Apply" button and sending us your resume. Sala…

View Details
Posted 2026-03-21

Fraud & Risk Operations Lead

Fitt Talent Partners
San Francisco, CA

Fitt Talent Partners is a specialized recruitment firm working with top health and wellness companies. We’re filling this role for a client, a leading consumer Health & Wellness Platform — that h…

View Details
Posted 2026-03-19

Senior Scientist, Rider Personalization

Uber
San Francisco, CA

About the Role The Rider team is the centerpiece of the Uber consumer experience, owning the core flagship app used by over 100M+ monthly active users. The Personalization team is looking for a…

View Details
Posted 2026-02-24

K-12 Special Education Teacher

BlueCloud Staffing
Modesto, CA

A student-centered school in Modesto, CA is seeking a Special Education Teacher whos passionate about creating equitable opportunities for all learners. This full-time position is ideal for an educat…

View Details
Posted 2026-02-04