Staff Product Manager, Infrastructure as a Service

Together Ai
San Francisco, CA

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fast, reliable inference and model shaping services with state-of-the-art AI cloud infrastructure.

As a Staff Product Manager, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud for building and running AI models, agents and applications. Our IaaS services power both our internal SaaS products (inference, fine-tuning) and our external cloud customers, spanning more than a dozen data centers across the world.

Some of what you’ll work on:


  • Build new cloud services that provide compelling, convenient and economical ways for developers and labs to consume AI-native infrastructure

  • Developing the strategy and execute the roadmap for Together AI’s AI-native infrastructure-as-service products that includes compute, storage and networking services

  • Developing and managing the economic model for Together AI’s IaaS services, ensuring they are market competitive and profitable.

  • Collaborating with the inference, training & model shaping teams as large internal customers of the IaaS portfolio

To be successful, you’ll need to be an entrepreneurial product leader who is effective at analyzing markets & needs, formulating strategy, leading teams and partnering with customers.

Requirements


  • 4+ years as a product manager who has worked on B2B software infrastructure

  • At least one experience leading a commercial B2B SaaS infrastructure product through the “full lifecycle” from ideation to launch with follow-on releases

  • Experience with cloud infrastructure stacks, devops and CI/CD tools

  • Familiarity with infrastructure automation frameworks such as Kubernetes, Terraform & Ansible

  • Familiarity with virtualization technologies such as KVM, Kubevirt, vGPU and MIG

  • Experience virtualizing GPUs and/or Infiniband a big plus

  • Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale

  • Can develop an easy to follow, framework-driven strategy for a product and market

  • Effective at partnering senior engineers and engineering leaders

  • Ability to lead cross-functional “extended product teams” including stakeholders from sales, marketing and customer experience

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $240,000 - $300,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at

Posted 2025-11-28

Recommended Jobs

Software Engineer - Data Engine

Applied Intuition
Mountain View, CA

About Applied Intuition Applied Intuition is the vehicle intelligence company that accelerates the global adoption of safe, AI-driven machines. Founded in 2017, Applied Intuition delivers the to…

View Details
Posted 2025-11-25

Personal Lines Service Assistant

Heffernan Network Insurance Brokers
Tracy, CA

Job Summary: The main role of a Personal Lines Service Assistant is to support Account Managers and Producers with clerical tasks related to account servicing. Under the guidance of an Account Manag…

View Details
Posted 2026-01-10

Senior Embedded Software Test Engineer

Intuitive
Sunnyvale, CA

Company Description At Intuitive, we are united behind our mission: we believe that minimally invasive care is life-enhancing care. Through ingenuity and intelligent technology, we expand the po…

View Details
Posted 2025-11-28

Staff Product Manager (Build Experience)

Workato
Palo Alto, CA

About Workato Workato transforms technology complexity into business opportunity. As the leader in enterprise orchestration, Workato helps businesses globally streamline operations by connecting…

View Details
Posted 2025-12-19

Beverage Scientist

National Beverage
Hayward, CA

JOB OVERVIEW: The Beverage Scientist develops and optimizes formulas and processes for beverage products under the National Beverage portfolio. Owns and supports product development stages from con…

View Details
Posted 2026-01-09

Content Editorial Manager - Okta Blog

Okta
Ontario, CA

Get to know Okta Okta is The World’s Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Pla…

View Details
Posted 2025-11-20

Floor Manager

Monsieur Dior by Dominique Crenn
Beverly Hills, CA

As a Service / Floor Manager, you will be responsible for supporting the General Manager in the day-to-day running of restaurant operations. This role requires a dedicated leader who can inspire our …

View Details
Posted 2026-01-09

Paralegal

ALSO.
Palo Alto, CA

About ALSO. We’re ALSO, an electric mobility company originally conceived as a part of Rivian. We’re a passionate team of builders, dreamers, doers and innovators, focused on creating entirely new…

View Details
Posted 2025-12-27

Software Engineer (UI/UX Developer)

G2 Ops
San Diego, CA

​​  Quick Position Facts! Location: San Diego, CA at our wonderful G2 Ops office and customer site Work Setting: In person, some remote opportunity, and/or flexible working hours, not a …

View Details
Posted 2026-01-07