Staff Software Engineer- Data infrastructure
We are looking for people with strong Backend Data Engineering capabilities to build highly efficient, resilient systems & pipelines for large-scale data processing. You’ll be part of Luma’s applied research team and work directly on mission critical work-streams utilizing thousands of GPUs. \n
Responsibilities- Design, build and automate infrastructure for processing data across multiple clusters of thousands of GPUs.
- Work with researchers to identify and implement technical data requirements, and optimize distributed loading for model training.
- Work cross-functionally for diverse backend engineering needs.
- Design & build performant infrastructure to manage and leverage large-scale datasets for our model training.
- Requirement of 10+ years of engineering, including 2+ years of work experience in petabyte-level data processing.
- Very strong generalist python coding.
- Experience engineering large-scale systems that process and serve petabytes of data.
- Deep understanding of Kubernetes, SLURM, Ray and other cluster orchestration systems.
- Experience working with visual data.
- Experience working closely with ML is a strong plus .
- Please note this role is not meant for recent grads.
- The pay range for this position in California is $200,000 - $250,000yr; however, base pay offered may vary depending on job-related knowledge, skills, candidate location, and experience. We also offer competitive equity packages in the form of stock options and a comprehensive benefits plan.
$250,000 - $300,000 a year
The pay range for this position in California is $200,000 - $300,000yr; however, base pay offered may vary depending on job-related knowledge, skills, candidate location, and experience. We also offer competitive equity packages in the form of stock options and a comprehensive benefits plan. \nAll your applications are reviewed by real people.
Recommended Jobs
Software Engineer, Developer Experience
Crusoe is building the World’s Favorite AI-first Cloud infrastructure company. We’re pioneering vertically integrated, purpose-built AI infrastructure solutions trusted by Fortune 500 companies to po…
Senior Software Engineer, Data Tooling
Waymo is an autonomous driving technology company with the mission to be the most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the W…
Software Engineer, Full Stack
A Bit About Us: We are Arcadia Science, an evolutionary biology company founded and led by scientists. Our mission is to turn natural innovations into real-world solutions by developing systematic…
Au Pair
Thank you for your interest in becoming an au pair for our family. We are seeking a caring, responsible, and educated individual to help us with our newborn for an 8-month period. As working parents, …
Janitor I - 2nd shift
We are looking for a Janitor who has commercial cleaning experience. This individual is responsible for maintaining the manufacturing/production areas, interior office, and/or the exterior landscap…
Senior Software Engineer, Full Stack
Mithril is actively seeking talented candidates at the Senior to Principal level, with leveling determined based on experience and demonstrated expertise. We welcome individuals who bring deep techni…
Software Engineer I
GumGum is a contextual-first, global digital advertising platform that uses advanced AI technology to serve captivating creative ads that drive consumer attention, without the use of personal data. A…
Software Eng II
Why PlayStation? PlayStation isn’t just the Best Place to Play — it’s also the Best Place to Work. Today, we’re recognized as a global leader in entertainment producing The PlayStation family of pr…
Sr. Product Manager - FinTech
Stampli, a leader in B2B SaaS and fintech innovation, is seeking a Senior Product Manager to help drive the vision, strategy, and execution of our Fintech product offerings. Our solutions are trans…