Staff Product Manager, Infrastructure as a Service
Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fast, reliable inference and model shaping services with state-of-the-art AI cloud infrastructure.
As a Staff Product Manager, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud for building and running AI models, agents and applications. Our IaaS services power both our internal SaaS products (inference, fine-tuning) and our external cloud customers, spanning more than a dozen data centers across the world.
Some of what you’ll work on:
- Build new cloud services that provide compelling, convenient and economical ways for developers and labs to consume AI-native infrastructure
- Developing the strategy and execute the roadmap for Together AI’s AI-native infrastructure-as-service products that includes compute, storage and networking services
- Developing and managing the economic model for Together AI’s IaaS services, ensuring they are market competitive and profitable.
- Collaborating with the inference, training & model shaping teams as large internal customers of the IaaS portfolio
To be successful, you’ll need to be an entrepreneurial product leader who is effective at analyzing markets & needs, formulating strategy, leading teams and partnering with customers.
Requirements
- 4+ years as a product manager who has worked on B2B software infrastructure
- At least one experience leading a commercial B2B SaaS infrastructure product through the “full lifecycle” from ideation to launch with follow-on releases
- Experience with cloud infrastructure stacks, devops and CI/CD tools
- Familiarity with infrastructure automation frameworks such as Kubernetes, Terraform & Ansible
- Familiarity with virtualization technologies such as KVM, Kubevirt, vGPU and MIG
- Experience virtualizing GPUs and/or Infiniband a big plus
- Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
- Can develop an easy to follow, framework-driven strategy for a product and market
- Effective at partnering senior engineers and engineering leaders
- Ability to lead cross-functional “extended product teams” including stakeholders from sales, marketing and customer experience
About Together AI
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.
Compensation
We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $240,000 - $300,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Please see our privacy policy at
Recommended Jobs
Help Desk Analyst
POSITION SUMMARY Part of an IT support team, answers incoming calls from customers and resolves technical issues, while ensuring a high level of customer service and maximizing productivity; handles…
HR Assistant and Administrative Support
HR Assistant and Administrative Support Location Oakland, CA (Rancho San Antonio area) : Overview: Support and complete general HR and office administration, including payroll, onboarding, HR-relate…
Assoc Clerical I Days I 5B UF Health North Campus
Assoc Clerical I Days I 5B UF Health North Campus Location Jacksonville, FL (San Jose area) : Overview: The Clerical Associate (C.A.) is a member of the patient care team whose primary responsibilit…
Sr Staff Ecosystem Product Operations Manager
P-1495 About Databricks At Databricks, we are passionate about enabling Data and AI teams to solve the world’s toughest problems — from making the next mode of transportation a reality to accele…
Software Engineer/Tester
Capio Group is looking for an experienced Software Engineer/Tester! Full-time employee - Sacramento Salary: $125,000 - $135,000 About Us: Capio Group is a California-based Information Techn…
Staff Accountant [INTERNAL CANDIDATES ONLY]
4Cs Now Hiring: Staff Accountant Full Time Position , Non-Exempt Starting Pay: $36 - $38 per hour Position is located in Santa Rosa Office Hours: Monday-Friday 8:30 AM – 5 PM TH…
Executive Director, AI Data Scientist
At TWG Group Holdings, LLC (“TWG Global”), we drive innovation and business transformation across a range of industries—including financial services, insurance, technology, media, and sports—by lever…
Senior Applied Machine Learning Engineer, Frontier AI
ABOUT THE TEAM Anduril’s Lattice software platform integrates together many sensors into a single cohesive view of the world, providing needed context for our users. AI Engineers on Anduril’s Fr…
Senior Engineering Manager for Workspace Platform
RDQ225R488 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development …