Staff Product Manager, Infrastructure as a Service

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fast, reliable inference and model shaping services with state-of-the-art AI cloud infrastructure.

As a Staff Product Manager, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud for building and running AI models, agents and applications. Our IaaS services power both our internal SaaS products (inference, fine-tuning) and our external cloud customers, spanning more than a dozen data centers across the world.

Some of what you’ll work on:

• Build new cloud services that provide compelling, convenient and economical ways for developers and labs to consume AI-native infrastructure


• Developing the strategy and execute the roadmap for Together AI’s AI-native infrastructure-as-service products that includes compute, storage and networking services


• Developing and managing the economic model for Together AI’s IaaS services, ensuring they are market competitive and profitable.


• Collaborating with the inference, training & model shaping teams as large internal customers of the IaaS portfolio

To be successful, you’ll need to be an entrepreneurial product leader who is effective at analyzing markets & needs, formulating strategy, leading teams and partnering with customers.

Requirements

• 4+ years as a product manager who has worked on B2B software infrastructure


• At least one experience leading a commercial B2B SaaS infrastructure product through the “full lifecycle” from ideation to launch with follow-on releases


• Experience with cloud infrastructure stacks, devops and CI/CD tools


• Familiarity with infrastructure automation frameworks such as Kubernetes, Terraform & Ansible


• Familiarity with virtualization technologies such as KVM, Kubevirt, vGPU and MIG


• Experience virtualizing GPUs and/or Infiniband a big plus


• Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale


• Can develop an easy to follow, framework-driven strategy for a product and market


• Effective at partnering senior engineers and engineering leaders


• Ability to lead cross-functional “extended product teams” including stakeholders from sales, marketing and customer experience

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $240,000 - $300,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at