ZipRecruiter
Staff Product Manager - AI Performance and Benchmarking
ZipRecruiter, Sunnyvale, California, United States, 94087
Overview
CoreWeave is the AI Hyperscaler, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilient solutions for accelerated computing. Since 2017, CoreWeave has operated a growing footprint of data centers covering every region of the US and across Europe. CoreWeave was ranked as one of the TIME100 most influential companies of 2024. As the leader in the industry, we thrive in an environment where adaptability and resilience are key. Our culture offers career-defining opportunities for those who excel amid change and challenge. If you\'re someone who thrives in a dynamic environment, enjoys solving complex problems, and is eager to make a significant impact, CoreWeave is the place for you. Join us, and be part of a team solving some of the most exciting challenges in the industry. CoreWeave powers the creation and delivery of the intelligence that drives innovation. What You\'ll Do
We are looking for a
Staff Product Manager for AI Platform Services
to lead
performance optimization and benchmarking
for foundation model training and inference on CoreWeave. In this pivotal role, you will work closely with our top customers across AI Labs, startups, and enterprises to identify performance bottlenecks and partner with engineering to deliver product capabilities that maximize infrastructure efficiency and performance. You\'ll have a direct impact on shaping the future of AI infrastructure and services. About The Role The ideal candidate is passionate about AI and infrastructure technologies, with a deep understanding of GPUs, networking, and storage systems, foundation model architectures, AI workloads, frameworks and engines (e.g., PyTorch, JAX, vLLM), cloud technologies, and low-level constructs such as CUDA, NCCL, and kernels. You will leverage industry and customer insights as well as technical expertise to define the product vision, roadmap, and go-to-market strategy, ensuring that CoreWeave builds on its market-segment position as the leading AI Hyperscaler. Responsibilities
Product Strategy : Define and evolve CoreWeave\'s strategic software offerings for performance optimization and benchmarking of foundation model development and inference. Identify new opportunities and optimize existing approaches to deliver the highest infrastructure efficiency and performance for AI workloads. Performance & Benchmarking : Drive the charter for platform capabilities that continually benchmark and monitor AI workload performance on CoreWeave. Lead submissions in industry benchmarking efforts such as MLPerf. Model Development & Customization : Support customer workflows including pre-training, fine-tuning, evaluation, RL, and inference. Solve novel problems related to scaling AI model development and inference on specialized hardware. Cross-Functional Collaboration : Partner with engineering, sales, finance, and marketing teams to ensure alignment on adoption and monetization goals, effective product launches, and seamless go-to-market execution. Customer Success : Work closely with customers and go-to-market teams to ensure successful outcomes from onboarding to POC to scale. Market Analysis : Conduct in-depth market research and competitive analysis to identify industry landscape, best practices, emerging trends, open source efforts, and opportunities for differentiation. Pricing Strategy & Execution : Develop and implement pricing strategies considering market trends, competitive landscape, customer segmentation, and product value. Performance Monitoring : Define key metrics and establish robust reporting to monitor adoption, identify areas for improvement, and inform future decisions. Go-to-Market Strategy : Partner with industry partners, open-source projects (e.g., PyTorch, vLLM, llm-d), marketing, and sales teams to develop and execute effective go-to-market strategies, including positioning, messaging, and competitive differentiation. Represent CoreWeave in external conferences and industry events. Who You Are
Experience: 8+ years of professional experience, with at least 5 years in Product Management of AI/ML or infrastructure products. Former engineers, solutions architects, or researchers with deep optimization and infra experience strongly encouraged. Technical Knowledge: Deep understanding of HPC and AI/ML workloads including foundation model training, fine-tuning, inference, and RL. Domain Knowledge: Expertise in model architectures and frameworks such as PyTorch, JAX, Ray, vLLM; strong grasp of CUDA, NCCL, kernels, and low-level GPU optimizations. Infrastructure Knowledge: Strong understanding of GPUs, networking, and storage systems in distributed training/inference environments. Leadership: Proven ability to lead cross-functional initiatives and teams, with strong decision-making and product management skills. Customer-Centric Approach: Demonstrated experience working closely with customers to identify performance needs and translate them into product solutions. Communication Skills: Excellent verbal and written communication skills with the ability to influence cross-functional teams and stakeholders. Results-Oriented: Proven track record of driving business growth through innovative product solutions in the AI and infrastructure space. Hands-On: Comfortable working with engineering teams to prototype, build, and test optimizations. Education: Bachelor\'s or Master\'s degree in Computer Science, Engineering, or a related technical field. MBA or equivalent experience is a plus. Candidate Fit
Wondering if you\'re a good fit?
We believe in investing in our people and value candidates who can bring their own diversified experiences to our teams – even if you aren\'t a 100% skill or experience match. Here are a few qualities we\'ve found compatible with our team: You love to build technology solutions that power innovations. You're curious about the future of AI development with emerging technologies. You're an expert in foundation model architectures and AI infrastructure. Why CoreWeave?
At CoreWeave, we work hard, have fun, and move fast! We\'re in an exciting stage of hyper-growth that you will not want to miss out on. We\'re not afraid of a little chaos, and we\'re constantly learning. Our team cares deeply about how we build our product and how we work together, which is represented through our core values: Be Curious at Your Core Act Like an Owner Empower Employees Deliver Best-in-Class Client Experiences Achieve More Together We support and encourage an entrepreneurial outlook and independent thinking. We foster an environment that encourages collaboration and provides the opportunity to develop innovative solutions to complex problems. As we get set for take off, the growth opportunities within the organization are constantly expanding. You will be surrounded by some of the best talent in the industry, who will want to learn from you, too. Come join us! The base salary range for this role is $188,000 to $275,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility). What We Offer
The range we\'ve posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location. In addition to a competitive salary, we offer a variety of benefits to support your needs, including: Medical, dental, and vision insurance - 100% paid for by CoreWeave Company-paid Life Insurance Voluntary supplemental life insurance Short and long-term insurance Flexible Spending Account Health Savings Account Tuition Reimbursement Ability to Participate in Employee Stock Purchase Program (ESPP) Mental Wellness Benefits through Spring Health Family-Forming support provided by Carrot Paid Parental Leave Flexible, full-service childcare support with Kinside 401(k) with a generous employer match Flexible PTO Catered lunch each day in our office and data center locations A casual work environment A work culture focused on innovative disruption Our Workplace
While we prioritize a hybrid work environment, remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of our hubs within their first month. Teams also gather quarterly to support collaboration California Consumer Privacy Act - California applicants only CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, veteran status, or genetic information. As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: careers@coreweave.com. Export Control Compliance
This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as a U.S. or green card holder, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. CoreWeave may, for legitimate business reasons, decline to pursue any export licensing process.
#J-18808-Ljbffr
CoreWeave is the AI Hyperscaler, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilient solutions for accelerated computing. Since 2017, CoreWeave has operated a growing footprint of data centers covering every region of the US and across Europe. CoreWeave was ranked as one of the TIME100 most influential companies of 2024. As the leader in the industry, we thrive in an environment where adaptability and resilience are key. Our culture offers career-defining opportunities for those who excel amid change and challenge. If you\'re someone who thrives in a dynamic environment, enjoys solving complex problems, and is eager to make a significant impact, CoreWeave is the place for you. Join us, and be part of a team solving some of the most exciting challenges in the industry. CoreWeave powers the creation and delivery of the intelligence that drives innovation. What You\'ll Do
We are looking for a
Staff Product Manager for AI Platform Services
to lead
performance optimization and benchmarking
for foundation model training and inference on CoreWeave. In this pivotal role, you will work closely with our top customers across AI Labs, startups, and enterprises to identify performance bottlenecks and partner with engineering to deliver product capabilities that maximize infrastructure efficiency and performance. You\'ll have a direct impact on shaping the future of AI infrastructure and services. About The Role The ideal candidate is passionate about AI and infrastructure technologies, with a deep understanding of GPUs, networking, and storage systems, foundation model architectures, AI workloads, frameworks and engines (e.g., PyTorch, JAX, vLLM), cloud technologies, and low-level constructs such as CUDA, NCCL, and kernels. You will leverage industry and customer insights as well as technical expertise to define the product vision, roadmap, and go-to-market strategy, ensuring that CoreWeave builds on its market-segment position as the leading AI Hyperscaler. Responsibilities
Product Strategy : Define and evolve CoreWeave\'s strategic software offerings for performance optimization and benchmarking of foundation model development and inference. Identify new opportunities and optimize existing approaches to deliver the highest infrastructure efficiency and performance for AI workloads. Performance & Benchmarking : Drive the charter for platform capabilities that continually benchmark and monitor AI workload performance on CoreWeave. Lead submissions in industry benchmarking efforts such as MLPerf. Model Development & Customization : Support customer workflows including pre-training, fine-tuning, evaluation, RL, and inference. Solve novel problems related to scaling AI model development and inference on specialized hardware. Cross-Functional Collaboration : Partner with engineering, sales, finance, and marketing teams to ensure alignment on adoption and monetization goals, effective product launches, and seamless go-to-market execution. Customer Success : Work closely with customers and go-to-market teams to ensure successful outcomes from onboarding to POC to scale. Market Analysis : Conduct in-depth market research and competitive analysis to identify industry landscape, best practices, emerging trends, open source efforts, and opportunities for differentiation. Pricing Strategy & Execution : Develop and implement pricing strategies considering market trends, competitive landscape, customer segmentation, and product value. Performance Monitoring : Define key metrics and establish robust reporting to monitor adoption, identify areas for improvement, and inform future decisions. Go-to-Market Strategy : Partner with industry partners, open-source projects (e.g., PyTorch, vLLM, llm-d), marketing, and sales teams to develop and execute effective go-to-market strategies, including positioning, messaging, and competitive differentiation. Represent CoreWeave in external conferences and industry events. Who You Are
Experience: 8+ years of professional experience, with at least 5 years in Product Management of AI/ML or infrastructure products. Former engineers, solutions architects, or researchers with deep optimization and infra experience strongly encouraged. Technical Knowledge: Deep understanding of HPC and AI/ML workloads including foundation model training, fine-tuning, inference, and RL. Domain Knowledge: Expertise in model architectures and frameworks such as PyTorch, JAX, Ray, vLLM; strong grasp of CUDA, NCCL, kernels, and low-level GPU optimizations. Infrastructure Knowledge: Strong understanding of GPUs, networking, and storage systems in distributed training/inference environments. Leadership: Proven ability to lead cross-functional initiatives and teams, with strong decision-making and product management skills. Customer-Centric Approach: Demonstrated experience working closely with customers to identify performance needs and translate them into product solutions. Communication Skills: Excellent verbal and written communication skills with the ability to influence cross-functional teams and stakeholders. Results-Oriented: Proven track record of driving business growth through innovative product solutions in the AI and infrastructure space. Hands-On: Comfortable working with engineering teams to prototype, build, and test optimizations. Education: Bachelor\'s or Master\'s degree in Computer Science, Engineering, or a related technical field. MBA or equivalent experience is a plus. Candidate Fit
Wondering if you\'re a good fit?
We believe in investing in our people and value candidates who can bring their own diversified experiences to our teams – even if you aren\'t a 100% skill or experience match. Here are a few qualities we\'ve found compatible with our team: You love to build technology solutions that power innovations. You're curious about the future of AI development with emerging technologies. You're an expert in foundation model architectures and AI infrastructure. Why CoreWeave?
At CoreWeave, we work hard, have fun, and move fast! We\'re in an exciting stage of hyper-growth that you will not want to miss out on. We\'re not afraid of a little chaos, and we\'re constantly learning. Our team cares deeply about how we build our product and how we work together, which is represented through our core values: Be Curious at Your Core Act Like an Owner Empower Employees Deliver Best-in-Class Client Experiences Achieve More Together We support and encourage an entrepreneurial outlook and independent thinking. We foster an environment that encourages collaboration and provides the opportunity to develop innovative solutions to complex problems. As we get set for take off, the growth opportunities within the organization are constantly expanding. You will be surrounded by some of the best talent in the industry, who will want to learn from you, too. Come join us! The base salary range for this role is $188,000 to $275,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility). What We Offer
The range we\'ve posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location. In addition to a competitive salary, we offer a variety of benefits to support your needs, including: Medical, dental, and vision insurance - 100% paid for by CoreWeave Company-paid Life Insurance Voluntary supplemental life insurance Short and long-term insurance Flexible Spending Account Health Savings Account Tuition Reimbursement Ability to Participate in Employee Stock Purchase Program (ESPP) Mental Wellness Benefits through Spring Health Family-Forming support provided by Carrot Paid Parental Leave Flexible, full-service childcare support with Kinside 401(k) with a generous employer match Flexible PTO Catered lunch each day in our office and data center locations A casual work environment A work culture focused on innovative disruption Our Workplace
While we prioritize a hybrid work environment, remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of our hubs within their first month. Teams also gather quarterly to support collaboration California Consumer Privacy Act - California applicants only CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, veteran status, or genetic information. As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: careers@coreweave.com. Export Control Compliance
This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as a U.S. or green card holder, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. CoreWeave may, for legitimate business reasons, decline to pursue any export licensing process.
#J-18808-Ljbffr