Signify Technology
Senior Product Manager - Data Labelling and Evals
Signify Technology, San Francisco, California, United States, 94199
Senior Product Manager - Data Labelling and Evals
Join to apply for the
Senior Product Manager - Data Labelling and Evals
role at
Signify Technology Location:
San Fran, CA (On-site, Full-time) Department:
Engineering About The Role We are seeking a
Senior Product Manager
to lead the development of our evaluation and data generation platform for large-scale AI systems. This role is central to ensuring the reliability, quality, and impact of our models by driving how training and testing datasets are created, managed, and optimized. You’ll work across engineering, research, and data operations teams to design the infrastructure and workflows that ensure model performance in complex, high-stakes environments. Key Responsibilities
Define the strategy, metrics, and architecture for model evaluation across AI agent behaviors Partner with ML engineers, data scientists, and domain experts to design and maintain robust benchmarks Build and manage workflows for labeling, QA, and data generation — both internal and with external vendors Monitor dataset quality, identify gaps, and iterate on tools and processes to improve efficiency Collaborate closely with training teams to align data feedback loops with product outcomes Qualifications
3+ years of product management experience in AI/ML evaluation, labeling platforms, or data pipeline systems Strong understanding of LLM or ML dataset development, especially for sensitive or high-impact applications Hands-on experience with labeling operations, data QA, or vendor management for annotation workflows Attention to detail in process design for human-in-the-loop systems Ability to work cross-functionally in fast-moving, technical environments Why Join
Opportunity to own critical infrastructure at the heart of advanced AI development Work alongside engineers and researchers shaping the future of safe, scalable AI systems High-growth environment with the chance to define processes from the ground up Collaborative, in-person culture with a focus on innovation and impact
#J-18808-Ljbffr
Join to apply for the
Senior Product Manager - Data Labelling and Evals
role at
Signify Technology Location:
San Fran, CA (On-site, Full-time) Department:
Engineering About The Role We are seeking a
Senior Product Manager
to lead the development of our evaluation and data generation platform for large-scale AI systems. This role is central to ensuring the reliability, quality, and impact of our models by driving how training and testing datasets are created, managed, and optimized. You’ll work across engineering, research, and data operations teams to design the infrastructure and workflows that ensure model performance in complex, high-stakes environments. Key Responsibilities
Define the strategy, metrics, and architecture for model evaluation across AI agent behaviors Partner with ML engineers, data scientists, and domain experts to design and maintain robust benchmarks Build and manage workflows for labeling, QA, and data generation — both internal and with external vendors Monitor dataset quality, identify gaps, and iterate on tools and processes to improve efficiency Collaborate closely with training teams to align data feedback loops with product outcomes Qualifications
3+ years of product management experience in AI/ML evaluation, labeling platforms, or data pipeline systems Strong understanding of LLM or ML dataset development, especially for sensitive or high-impact applications Hands-on experience with labeling operations, data QA, or vendor management for annotation workflows Attention to detail in process design for human-in-the-loop systems Ability to work cross-functionally in fast-moving, technical environments Why Join
Opportunity to own critical infrastructure at the heart of advanced AI development Work alongside engineers and researchers shaping the future of safe, scalable AI systems High-growth environment with the chance to define processes from the ground up Collaborative, in-person culture with a focus on innovation and impact
#J-18808-Ljbffr