CoreWeave
Staff Product Manager - AI Performance and Benchmarking
CoreWeave, New York, New York, us, 10261
What You’ll Do
We are looking for a
Staff Product Manager for AI Platform Services
to lead
performance optimization and benchmarking
for foundation model training and inference on CoreWeave. In this pivotal role, you will work closely with our top customers across AI Labs, startups, and enterprises to identify performance bottlenecks and partner with engineering to deliver product capabilities that maximize infrastructure efficiency and performance. You’ll have a direct impact on shaping the future of AI infrastructure and services. About The Role
The ideal candidate is passionate about AI and infrastructure technologies, with a deep understanding of GPUs, networking, and storage systems, foundation model architectures, AI workloads, frameworks and engines (e.g., PyTorch, JAX, vLLM), cloud-native technologies, and low-level constructs such as CUDA, NCCL, and kernels. You will leverage industry and customer insights as well as technical expertise to define the product vision, roadmap, and go-to-market strategy, ensuring that CoreWeave builds on its market-segment position as the leading AI Hyperscaler. Key Responsibilities
Product Strategy: Define and evolve CoreWeave\'s strategic software offerings for performance optimization and benchmarking of foundation model development and inference. Identify new opportunities and optimize existing approaches to deliver the highest infrastructure efficiency and performance for AI workloads. Performance & Benchmarking: Drive the charter for platform capabilities that continually benchmark and monitor AI workload performance on CoreWeave. Lead submissions in industry benchmarking efforts such as MLPerf. Model Development & Customization: Support customer workflows including pre-training, fine-tuning, evaluation, RL, and inference. Solve novel problems related to scaling AI model development and inference on specialized hardware. Cross-Functional Collaboration: Partner with engineering, sales, finance, and marketing teams to ensure alignment on adoption and monetization goals, effective product launches, and seamless go-to-market execution. Customer Success: Work closely with customers and go-to-market teams to ensure successful outcomes from onboarding to POC to scale. Market Analysis: Conduct in-depth market research and competitive analysis to identify industry landscape, best practices, emerging trends, open source efforts, and opportunities for differentiation. Pricing Strategy & Execution: Develop and implement pricing strategies considering market trends, competitive landscape, customer segmentation, and product value. Performance Monitoring: Define key metrics and establish robust reporting to monitor adoption, identify areas for improvement, and inform future decisions. Go-to-Market Strategy: Partner with industry partners, open-source projects (e.g., PyTorch, vLLM, llm-d), marketing, and sales teams to develop and execute effective go-to-market strategies, including positioning, messaging, and competitive differentiation. Represent CoreWeave in external conferences and industry events. Who You Are
Experience: 8+ years of professional experience, with at least 5 years in Product Management of AI/ML or infrastructure products. Former engineers, solutions architects, or researchers with deep optimization and infra experience strongly encouraged. Technical Knowledge: Deep understanding of HPC and AI/ML workloads including foundation model training, fine-tuning, inference, and RL. Domain Knowledge: Expertise in model architectures and frameworks such as PyTorch, JAX, Ray, vLLM; strong grasp of CUDA, NCCL, kernels, and low-level GPU optimizations. Infrastructure Knowledge: Strong understanding of GPUs, networking, and storage systems in distributed training/inference environments. Leadership: Proven ability to lead cross-functional initiatives and teams, with strong decision-making and product management skills. Customer-Centric Approach: Demonstrated experience working closely with customers to identify performance needs and translate them into product solutions. Communication Skills: Excellent verbal and written communication skills with the ability to influence cross-functional teams and stakeholders. Results-Oriented: Proven track record of driving business growth through innovative product solutions in the AI and infrastructure space. Hands-On: Comfortable working with engineering teams to prototype, build, and test optimizations. Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field. MBA or equivalent experience is a plus. Why CoreWeave?
We believe in investing in our people and value candidates who bring diversified experiences. We’re in an exciting stage of hyper-growth and foster an entrepreneurial, collaborative environment focused on delivering best-in-class client experiences and innovative disruption. Our Workplace
We prioritize a hybrid work environment; remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to onboarding at one of our hubs within their first month. Teams gather quarterly to support collaboration. EEO Statements: CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information. We provide reasonable accommodations for the hiring process as needed. Export Control Compliance
This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be a U.S. person or eligible to access the information with required authorization.
#J-18808-Ljbffr
We are looking for a
Staff Product Manager for AI Platform Services
to lead
performance optimization and benchmarking
for foundation model training and inference on CoreWeave. In this pivotal role, you will work closely with our top customers across AI Labs, startups, and enterprises to identify performance bottlenecks and partner with engineering to deliver product capabilities that maximize infrastructure efficiency and performance. You’ll have a direct impact on shaping the future of AI infrastructure and services. About The Role
The ideal candidate is passionate about AI and infrastructure technologies, with a deep understanding of GPUs, networking, and storage systems, foundation model architectures, AI workloads, frameworks and engines (e.g., PyTorch, JAX, vLLM), cloud-native technologies, and low-level constructs such as CUDA, NCCL, and kernels. You will leverage industry and customer insights as well as technical expertise to define the product vision, roadmap, and go-to-market strategy, ensuring that CoreWeave builds on its market-segment position as the leading AI Hyperscaler. Key Responsibilities
Product Strategy: Define and evolve CoreWeave\'s strategic software offerings for performance optimization and benchmarking of foundation model development and inference. Identify new opportunities and optimize existing approaches to deliver the highest infrastructure efficiency and performance for AI workloads. Performance & Benchmarking: Drive the charter for platform capabilities that continually benchmark and monitor AI workload performance on CoreWeave. Lead submissions in industry benchmarking efforts such as MLPerf. Model Development & Customization: Support customer workflows including pre-training, fine-tuning, evaluation, RL, and inference. Solve novel problems related to scaling AI model development and inference on specialized hardware. Cross-Functional Collaboration: Partner with engineering, sales, finance, and marketing teams to ensure alignment on adoption and monetization goals, effective product launches, and seamless go-to-market execution. Customer Success: Work closely with customers and go-to-market teams to ensure successful outcomes from onboarding to POC to scale. Market Analysis: Conduct in-depth market research and competitive analysis to identify industry landscape, best practices, emerging trends, open source efforts, and opportunities for differentiation. Pricing Strategy & Execution: Develop and implement pricing strategies considering market trends, competitive landscape, customer segmentation, and product value. Performance Monitoring: Define key metrics and establish robust reporting to monitor adoption, identify areas for improvement, and inform future decisions. Go-to-Market Strategy: Partner with industry partners, open-source projects (e.g., PyTorch, vLLM, llm-d), marketing, and sales teams to develop and execute effective go-to-market strategies, including positioning, messaging, and competitive differentiation. Represent CoreWeave in external conferences and industry events. Who You Are
Experience: 8+ years of professional experience, with at least 5 years in Product Management of AI/ML or infrastructure products. Former engineers, solutions architects, or researchers with deep optimization and infra experience strongly encouraged. Technical Knowledge: Deep understanding of HPC and AI/ML workloads including foundation model training, fine-tuning, inference, and RL. Domain Knowledge: Expertise in model architectures and frameworks such as PyTorch, JAX, Ray, vLLM; strong grasp of CUDA, NCCL, kernels, and low-level GPU optimizations. Infrastructure Knowledge: Strong understanding of GPUs, networking, and storage systems in distributed training/inference environments. Leadership: Proven ability to lead cross-functional initiatives and teams, with strong decision-making and product management skills. Customer-Centric Approach: Demonstrated experience working closely with customers to identify performance needs and translate them into product solutions. Communication Skills: Excellent verbal and written communication skills with the ability to influence cross-functional teams and stakeholders. Results-Oriented: Proven track record of driving business growth through innovative product solutions in the AI and infrastructure space. Hands-On: Comfortable working with engineering teams to prototype, build, and test optimizations. Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field. MBA or equivalent experience is a plus. Why CoreWeave?
We believe in investing in our people and value candidates who bring diversified experiences. We’re in an exciting stage of hyper-growth and foster an entrepreneurial, collaborative environment focused on delivering best-in-class client experiences and innovative disruption. Our Workplace
We prioritize a hybrid work environment; remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to onboarding at one of our hubs within their first month. Teams gather quarterly to support collaboration. EEO Statements: CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information. We provide reasonable accommodations for the hiring process as needed. Export Control Compliance
This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be a U.S. person or eligible to access the information with required authorization.
#J-18808-Ljbffr