Orbis Group
Base Pay Range
$200,000.00/yr - $240,000.00/yr
Location San Fran, Bay Area
About the Company This is a high‑growth, AI scale‑up trusted by Oracle, Nvidia, AMD, Intel, and AWS to build and deploy high‑performance AI applications. They’ve raised over $240M in funding and are valued at over $1B.
Their platform enables developers to train, validate, fine‑tune, and deploy a variety of AI/ML models. Through various tools, it helps developers understand how models work under the hood, and test model performance, to iterate quickly to production‑ready quality.
Their mission is to bring transparency, safety, and intelligence to some of the world’s most complex digital environments.
About this Role Senior Product Manager for Explainability Tools , you’ll own the product strategy, vision, and roadmap for the platform’s core developer experience. You’ll sit at the intersection of AI research, ML engineering, and product, shaping how AI/ML teams understand and control the behavior of their language models.
You’ll translate the needs of advanced AI practitioners into simple, powerful tools and APIs, working closely with internal experts and the broader developer community to define what best‑in‑class explainability looks like for modern LLM applications.
What Sets This Role Apart
High technical bar, real product ownership
– deeply involved in how LLM explainability is designed, exposed, and used by developers, with ownership over a critical product surface.
Category‑defining space
– explainability for LLMs is still being invented; shape standards and patterns for how AI teams debug, trust, and govern their models.
Close to the frontier
– work directly with experienced AI/ML experts and see how cutting‑edge LLM technologies are applied in high‑stakes, enterprise environments.
Impactful customers
– your work will help teams deploying AI in sensitive domains (e.g., regulated industries, public sector) build safer, more transparent systems.
Key Responsibilities
Own the product strategy & roadmap for explainability tools, ensuring the platform evolves with the needs of AI/ML developers building LLM‑powered applications.
Leverage your understanding of language models and ML systems to guide product decisions and the integration of proprietary explainability technologies, tooling, and processes.
Engage deeply with the AI/ML developer community to uncover pain points, gather feedback, and shape solutions that meaningfully improve their development and debugging workflows.
Lead cross‑functional teams including AI/ML experts, engineers, and designers to deliver robust, scalable, and intuitive tools, SDKs, and APIs for LLM evaluation and explainability.
Drive and participate in technical discussions with AI/ML practitioners using your technical fluency to challenge assumptions, refine designs, and push product innovation.
Prioritize features and enhancements using customer feedback, market and competitive research, and emerging technical capabilities in LLMs and evaluation.
Collaborate with Marketing and Sales on go‑to‑market strategies, launch plans, and positioning to ensure strong adoption, clear messaging, and commercial impact.
Technical Skills & Required Expertise AI / ML & LLMs
Strong working knowledge of modern LLMs and ML systems: how they’re trained, fine‑tuned, evaluated, and deployed.
Familiarity with techniques to modify LLM behavior (prompt engineering, system prompts, fine‑tuning, RAG, guardrails, evaluators, safety filters, etc.).
Experience designing or working with LLM‑based solution architectures (pipelines, agents, evaluators, monitoring).
Ability to read and discuss code, especially in Python (bonus: you’ve written scripts, notebooks, or small services yourself).
Comfort collaborating with engineers on APIs, SDKs, schemas, and data models for developer‑facing products.
Experience building products for technical users (ML engineers, data scientists, platform teams, infra/dev‑tools users, etc.).
6+ years in Product Management, with at least 2–3 years on AI/ML, data, infra, or developer tools products.
Demonstrated ability to own a product area end‑to‑end: vision, roadmap, requirements, execution, launch, and iteration.
Strong discovery skills: interviewing technical users, synthesizing insights, and turning them into clear problem statements and PRDs.
Experience defining metrics and evaluation frameworks (e.g., quality metrics, reliability, adoption, and engagement) and using them to drive decision‑making.
Benefits Medical insurance
Vision insurance
401(k)
Paid maternity leave
Pension plan
Referrals increase your chances of interviewing at Orbis Group by 2x.
#J-18808-Ljbffr
Location San Fran, Bay Area
About the Company This is a high‑growth, AI scale‑up trusted by Oracle, Nvidia, AMD, Intel, and AWS to build and deploy high‑performance AI applications. They’ve raised over $240M in funding and are valued at over $1B.
Their platform enables developers to train, validate, fine‑tune, and deploy a variety of AI/ML models. Through various tools, it helps developers understand how models work under the hood, and test model performance, to iterate quickly to production‑ready quality.
Their mission is to bring transparency, safety, and intelligence to some of the world’s most complex digital environments.
About this Role Senior Product Manager for Explainability Tools , you’ll own the product strategy, vision, and roadmap for the platform’s core developer experience. You’ll sit at the intersection of AI research, ML engineering, and product, shaping how AI/ML teams understand and control the behavior of their language models.
You’ll translate the needs of advanced AI practitioners into simple, powerful tools and APIs, working closely with internal experts and the broader developer community to define what best‑in‑class explainability looks like for modern LLM applications.
What Sets This Role Apart
High technical bar, real product ownership
– deeply involved in how LLM explainability is designed, exposed, and used by developers, with ownership over a critical product surface.
Category‑defining space
– explainability for LLMs is still being invented; shape standards and patterns for how AI teams debug, trust, and govern their models.
Close to the frontier
– work directly with experienced AI/ML experts and see how cutting‑edge LLM technologies are applied in high‑stakes, enterprise environments.
Impactful customers
– your work will help teams deploying AI in sensitive domains (e.g., regulated industries, public sector) build safer, more transparent systems.
Key Responsibilities
Own the product strategy & roadmap for explainability tools, ensuring the platform evolves with the needs of AI/ML developers building LLM‑powered applications.
Leverage your understanding of language models and ML systems to guide product decisions and the integration of proprietary explainability technologies, tooling, and processes.
Engage deeply with the AI/ML developer community to uncover pain points, gather feedback, and shape solutions that meaningfully improve their development and debugging workflows.
Lead cross‑functional teams including AI/ML experts, engineers, and designers to deliver robust, scalable, and intuitive tools, SDKs, and APIs for LLM evaluation and explainability.
Drive and participate in technical discussions with AI/ML practitioners using your technical fluency to challenge assumptions, refine designs, and push product innovation.
Prioritize features and enhancements using customer feedback, market and competitive research, and emerging technical capabilities in LLMs and evaluation.
Collaborate with Marketing and Sales on go‑to‑market strategies, launch plans, and positioning to ensure strong adoption, clear messaging, and commercial impact.
Technical Skills & Required Expertise AI / ML & LLMs
Strong working knowledge of modern LLMs and ML systems: how they’re trained, fine‑tuned, evaluated, and deployed.
Familiarity with techniques to modify LLM behavior (prompt engineering, system prompts, fine‑tuning, RAG, guardrails, evaluators, safety filters, etc.).
Experience designing or working with LLM‑based solution architectures (pipelines, agents, evaluators, monitoring).
Ability to read and discuss code, especially in Python (bonus: you’ve written scripts, notebooks, or small services yourself).
Comfort collaborating with engineers on APIs, SDKs, schemas, and data models for developer‑facing products.
Experience building products for technical users (ML engineers, data scientists, platform teams, infra/dev‑tools users, etc.).
6+ years in Product Management, with at least 2–3 years on AI/ML, data, infra, or developer tools products.
Demonstrated ability to own a product area end‑to‑end: vision, roadmap, requirements, execution, launch, and iteration.
Strong discovery skills: interviewing technical users, synthesizing insights, and turning them into clear problem statements and PRDs.
Experience defining metrics and evaluation frameworks (e.g., quality metrics, reliability, adoption, and engagement) and using them to drive decision‑making.
Benefits Medical insurance
Vision insurance
401(k)
Paid maternity leave
Pension plan
Referrals increase your chances of interviewing at Orbis Group by 2x.
#J-18808-Ljbffr