Together AI
Staff Product Manager, Infrastructure as a Service
Together AI, San Francisco, California, United States, 94199
Overview
Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fast, reliable inference and model shaping services with state-of-the-art AI cloud infrastructure.
As a Staff Product Manager, you will play a key role in building the next generation AI cloud platform — a highly available, global, blazing-fast cloud for building and running AI models, agents and applications. Our IaaS services power both our internal SaaS products (inference, fine-tuning) and our external cloud customers, spanning more than a dozen data centers across the world.
Some of what you’ll work on:
Build new cloud services that provide compelling, convenient and economical ways for developers and labs to consume AI-native infrastructure
Developing the strategy and execute the roadmap for Together AI’s AI-native infrastructure-as-service products that includes compute, storage and networking services
Developing and managing the economic model for Together AI’s IaaS services, ensuring they are market competitive and profitable.
Collaborating with the inference, training & model shaping teams as large internal customers of the IaaS portfolio
To be successful, you’ll need to be an entrepreneurial product leader who is effective at analyzing markets & needs, formulating strategy, leading teams and partnering with customers.
Requirements
4 years as a product manager who has worked on B2B software infrastructure
At least one experience leading a commercial B2B SaaS infrastructure product through the “full lifecycle” from ideation to launch with follow-on releases
Experience with cloud infrastructure stacks, devops and CI/CD tools
Familiarity with infrastructure automation frameworks such as Kubernetes, Terraform & Ansible
Familiarity with virtualization technologies such as KVM, Kubevirt, vGPU and MIG
Experience virtualizing GPUs and/or Infiniband a big plus
Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
Can develop an easy to follow, framework-driven strategy for a product and market
Effective at partnering senior engineers and engineering leaders
Ability to lead cross-functional “extended product teams” including stakeholders from sales, marketing and customer experience
About Together AI Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.
Compensation We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $240,000 – $300,000 equity benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Privacy policy at https://www.together.ai/privacy
#J-18808-Ljbffr
As a Staff Product Manager, you will play a key role in building the next generation AI cloud platform — a highly available, global, blazing-fast cloud for building and running AI models, agents and applications. Our IaaS services power both our internal SaaS products (inference, fine-tuning) and our external cloud customers, spanning more than a dozen data centers across the world.
Some of what you’ll work on:
Build new cloud services that provide compelling, convenient and economical ways for developers and labs to consume AI-native infrastructure
Developing the strategy and execute the roadmap for Together AI’s AI-native infrastructure-as-service products that includes compute, storage and networking services
Developing and managing the economic model for Together AI’s IaaS services, ensuring they are market competitive and profitable.
Collaborating with the inference, training & model shaping teams as large internal customers of the IaaS portfolio
To be successful, you’ll need to be an entrepreneurial product leader who is effective at analyzing markets & needs, formulating strategy, leading teams and partnering with customers.
Requirements
4 years as a product manager who has worked on B2B software infrastructure
At least one experience leading a commercial B2B SaaS infrastructure product through the “full lifecycle” from ideation to launch with follow-on releases
Experience with cloud infrastructure stacks, devops and CI/CD tools
Familiarity with infrastructure automation frameworks such as Kubernetes, Terraform & Ansible
Familiarity with virtualization technologies such as KVM, Kubevirt, vGPU and MIG
Experience virtualizing GPUs and/or Infiniband a big plus
Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
Can develop an easy to follow, framework-driven strategy for a product and market
Effective at partnering senior engineers and engineering leaders
Ability to lead cross-functional “extended product teams” including stakeholders from sales, marketing and customer experience
About Together AI Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.
Compensation We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work. The US base salary range for this full-time position is: $240,000 – $300,000 equity benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Privacy policy at https://www.together.ai/privacy
#J-18808-Ljbffr