Senior AI Infrastructure Engineer
Who We Are
Hyperbolic Labs is on a mission to democratize AI by breaking down the barriers to computing power with our Open-Access AI Cloud. By aggregating computing resources across the globe, we offer an innovative GPU marketplace and AI inference service that promise affordability and accessibility for all. As pioneers at the intersection of AI and open-source technology, we believe in an open future where AI innovation is limited only by imagination, not by access to resources. We're looking for forward-thinking individuals who share our passion for making AI universally accessible, secure, and affordable. Join us in building a platform that empowers innovators everywhere to turn their visionary AI projects into reality.
As we prepare for growth after our Series A, our team — led by co-founders with PhDs in AI, Math, and Computer Science — is poised to redefine computing.
About the Role
We're seeking a Senior Infrastructure Engineer to help build and scale Hyperbolic's GPU Cloud Marketplace, by building a multi-tenancy provisioning and virtualization solution. This is a foundational role where you'll be responsible for transforming raw GPUs from diverse global suppliers into a programmable, orchestrated pool that serves thousands of AI developers and researchers. You'll work at the cutting edge of cloud infrastructure, building the core orchestration layer that enables our platform to deliver up to 75% cost savings compared to traditional cloud providers.
Who You Are
Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows
Deep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimization
Strong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementation
Experience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpoints
Proficiency with API design and cloud-init for automated provisioning and configuration
Solid understanding of GPU architecture, CUDA, and GPU compute optimization
Highly collaborative team player with excellent communication skills across technical and non-technical stakeholders
Proven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations
Experience building and scaling cloud infrastructure or distributed systems in production environments
Preferred Qualifications
Familiarity with high-performance networking technologies such as InfiniBand and RoCE (RDMA over Converged Ethernet)
Experience with distributed storage systems such as Ceph, Weka, or VAST Data
Hyperbolic is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Recommended Jobs
Diesel Technician
DESCRIPTION Job Summary: Completes diagnostics, repairs and rebuilds on engine products in a service workshop under limited supervision. We are looking for a talented Diesel Technician/Mecha…
CNC Machinist- Night Shift (Fresno)
Staff Accountant / next in line to be CFO / Great small business / awesome CFO grooming the next person This Jobot Job is hosted by: Scott Dennis Are you a fit? Easy Apply now by clicking the A…
Tennis Shop Attendant
Tennis Shop Attendant/On Court Assistant Coach We're hiring a Part Time Tennis Shop Attendant for Yorba Linda Country Club! Ideal candidates are highly motivated, customer service-centric, and p…
Embedded Software Engineer
Logos Space is a Low Earth Orbit (LEO) satellite system purpose-built to serve the connectivity needs of the commercial enterprise users and government users. We will help fill an important gap in th…
Software Engineer - Formal Verification
About Nexus Nexus is building a world supercomputer by leveraging the latest advancements in cryptography, engineering, and science. Our team of experts is developing and deploying the Nexus Layer…
Marketing Manager
Advanced IPM is a family-owned, rapidly growing leader in residential and commercial pest management services. Since 1981, we’ve built a reputation for excellence, integrity, and long-term customer r…
Workers Compensation Defense Attorney-CA Remote (Mission Viejo)
A Top Workers Compensation Defense and Civil Litigation Firm Seeks a seasoned WC Defense Attorney! This Jobot Job is hosted by: Chris De Armas Are you a fit? Easy Apply now by clicking the Apply…
Service Manager / Shasta Harley-Davidson
Title: Service Manager Department: Service Reports To: General Manager Location: Shasta Harley-Davidson Ride With Us At Shasta Harley-Davidson, we don’t just service bikes, we keep dre…
Clinical Training Manager (NP or PA - License Required) | Full-Time | Burbank, IL
Description: The Clinical Training Manager is a field-based clinical leader responsible for onboarding and training Puzzle Healthcare providers across a growing, multi-state post-acute platform. T…
Customer Experience Manager (ERP)
Stampli is hiring a CX Manage r with deep expertise in ERP finance systems, P2P workflows, and integrations . This role is the ERP SME and integration owner within Customer Experience . The …