Software Engineer, Infrastructure

Harvey
San Francisco, CA

Why Harvey

Harvey is a secure AI platform for legal and professional services that augments productivity and automates complex workflows. Harvey uses algorithms with reasoning-adept LLMs that have been customized and developed by our expert team of lawyers, engineers and research scientists. We’ve found product market fit and are scaling our team very quickly. Some reasons to join Harvey are:

  • Exceptional product market fit: We have partnered with the largest law firms and professional service providers in the world, including Paul Weiss , A&O Shearman , Ashurst , O'Melveny & Myers, PwC , KKR, and many others.

  • Strategic investors: Raised over $200 million from strategic investors including Sequoia, Google Ventures, Kleiner Perkins, and the OpenAI Startup Fund.

  • World-class team: Harvey is hiring the best talent from DeepMind, Google Brain, Stripe, FAIR, Tesla Autopilot, Glean, Superhuman, Figma, and more.

  • Partnerships: Our engineers and researchers work directly with OpenAI to build the future of generative AI and redefine professional services.

  • Performance: 4x ARR in 2024.

  • Competitive compensation.

Role Overview

As a Software Engineer on the Infrastructure team at Harvey, you will build and maintain the infrastructure for serving our legal AI platform at scale. We are looking for software engineers with past infrastructure experience building large-scale distributed systems who are excited to build the foundational infrastructure for a fast growing startup.

This role is based in San Francisco, CA. We use an in-person work model and offer relocation assistance to new employees.

What You'll Do

  • Retrieval over peta-byte scale documents

  • Organizational-level interfaces to collaborate with AI

  • Managing dedicated GPU capacity across 5+ regions

  • 1000-step planning agents that help take companies public

  • Government-level security for the world's most sensitive matters

  • Evaluating LLMs across a 10k+ leaf taxonomy of tasks

  • Internet-scale data collection from over 50+ jurisdictions

What You Have

  • 3+ years of experience building and scaling distributed systems.

  • A deep understanding of how infrastructure-layer (Kubernetes, Database, OS, Cloud Storage etc) software systems work.

  • Strong attention to detail and spidey sense for where and when things could go wrong.

  • Track record of shipping high quality products.

  • Strong programming skills and general Computer Science knowledge.

Please find our CA applicant privacy notice here .

Compensation Range

$175,000 - $250,000 USD

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are in the early innings of a generational company. Joining early at a hypergrowth startup has proven to lead to exponential growth in responsibility, access, and ability. Apply here today!

Posted 2025-12-13

Recommended Jobs

Director, Product Manager, Coupang Media Group - Ads

Coupand
Mountain View, CA

  We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, "How did we ever live without Coupang?" Born out of an obsession to make shopping, eating, and livi…

View Details
Posted 2025-11-25

Software Engineer, Supercomputing

Thinking Machines Lab
San Francisco, CA

Thinking Machines Lab's mission is to empower humanity through advancing collaborative general intelligence. We're building a future where everyone has access to the knowledge and tools to make AI wo…

View Details
Posted 2026-01-07

Propulsion Test Engineer

K2 Space
Los Angeles, CA

K2 is building the largest and highest-power satellites ever flown, unlocking performance levels previously out of reach across every orbit. Backed by $450M from leading investors including Altimete…

View Details
Posted 2025-12-16

Machine Learning Engineer, Community Notes

Xai
Palo Alto, CA

About xAI xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on eng…

View Details
Posted 2025-12-10

Part-Time Sales Help

Lids
Rancho Cucamonga, CA

For California-based roles: Annual pay ranges may fall between $33,280 - $68,640 . You may also be offered a bonus, and other benefits. EEO Statement: Hat World, Inc., Lids Holdings, Inc., dba …

View Details
Posted 2025-11-09

Sr. Hardware Test Engineer

Reliable Robotics
Mountain View, CA

We're building safety-enhancing technology for aviation that will save lives. Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally tran…

View Details
Posted 2026-01-07

Data Scientist at Twitter

Sharustar.com
San Francisco, CA

Currently looking for Data Scientist: *Build complex fraud detection models that scale to run over terabyte-sized datasets *Write and interpret complex SQL queries for standard as well as a…

View Details
Posted 2025-11-25

Software Engineer - Power Management, Hardware Health

Openai
San Francisco, CA

About the Team OpenAI’s Hardware Health team is dedicated to ensuring the optimal performance and reliability of our custom-built hyperscale supercomputers. We focus on maximizing supercomputing cap…

View Details
Posted 2025-12-19

Senior Structural Engineer

Disneyland Resort
Anaheim, CA

“We create happiness.” That’s our motto at Disney Experiences. At Disney, you’ll help inspire magic by enabling our teams to push the limits of entertainment and create innovative built environments. …

View Details
Posted 2026-01-09