Waymo
Software Quality Operations Evaluations Specialist
Waymo, Mountain View, California, us, 94039
Software Quality Operations Evaluations Specialist
Join to apply for the Software Quality Operations Evaluations Specialist role at Waymo
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
The Software Quality Operations (SWQOPS) team is at the heart of ensuring the safety, reliability, and quality of the Waymo Driver. Our mission is to build an adaptable and scalable operation, powered by AI, to deliver the crucial insights necessary to confidently deploy and grow Waymo's autonomous vehicle service.
Waymo is experiencing unprecedented growth, rapidly expanding into new cities and launching new vehicle platforms. SWQOps, our Technical Specialists, are critical to this expansion, allowing us to scale safely and efficiently.
You Will
Partner with Engineering to design and deploy cutting‑edge Machine Learning (ML) and Generative AI (Gen-AI) models and tools. These models and tools drive step‑change improvements in issue discovery and detection, triage efficiency, and quality assurance.
Use AI‑powered insights and traditional triage signals to identify the latest on‑road issue trends, new risk scenarios, and edge cases. Develop and refine data‑driven strategies for issue discovery and monitoring, enhanced by ML model outputs.
Serve as the main link between AI/ML development and operational execution by defining and documenting new policies and Standard Operating Procedures (SOPs) that integrate AI tools and insights into daily vendor workflows.
Design and implement robust quality control processes for both human and AI‑generated outputs, performing meta‑quality checks, validating the integrity of vendor work, and providing feedback to improve both human and model performance.
Act as the Subject Matter Expert for Software Quality Operations. You will work closely with stakeholders, program leads, and vendor teams to ensure the seamless adoption and maximum impact of AI/ML advancements in our quality processes.
Be the trusted source for creating and updating technical policies, guidelines, and standard operating procedures for new scopes, platforms, and driving signals.
Provide technical leadership and consultation to stakeholders to enhance workflows and quality by identifying and escalating tool issues, providing technical requirements to engineering, and driving user testing to support the development and deployment of new tooling features.
You Have
BS/BA degree or 4 years of relevant work experience in AV Software Quality Operations
Increased competency in supporting all phases of the machine learning development lifecycle, from data preparation and training to validation, deployment, and monitoring.
Experience with ML testing and validation, including dataset quality assurance, bias detection, edge‑case scenario testing, and performance evaluation using statistical metrics.
Ability to quickly learn and implement new concepts and use proprietary tools. Experience with driving rules and regulations.
A proven ability to work in a fast‑paced, high‑stress environment while maintaining good judgment
Excellent communication and interpersonal skills to collaborate with multiple individuals in a diverse and dynamic work environment
Demonstrated strong execution with an ability to improve outcomes
Basic SQL querying and PLX coding experience
Experience assessing AV safety performance
Experience communications with partners
We Prefer
Experience working with offshore teams or managing multiple local operations hubs.
Competency in LLM / transformer models, and/or ML experience in the robotics domain.
Ability to use subject matter expertise for results analysis and direct customer consultation in the development of new and improved solutions.
Self‑motivated, with foundational skills in task planning and time management.
Experience with ML testing and validation, including dataset quality assurance, bias detection, edge‑case scenario testing, and performance evaluation using statistical metrics.
Competency in supporting all phases of the machine learning development lifecycle, from data preparation and training to validation, deployment, and monitoring.
Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range: $48.56—$61.06 USD
#J-18808-Ljbffr
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.
The Software Quality Operations (SWQOPS) team is at the heart of ensuring the safety, reliability, and quality of the Waymo Driver. Our mission is to build an adaptable and scalable operation, powered by AI, to deliver the crucial insights necessary to confidently deploy and grow Waymo's autonomous vehicle service.
Waymo is experiencing unprecedented growth, rapidly expanding into new cities and launching new vehicle platforms. SWQOps, our Technical Specialists, are critical to this expansion, allowing us to scale safely and efficiently.
You Will
Partner with Engineering to design and deploy cutting‑edge Machine Learning (ML) and Generative AI (Gen-AI) models and tools. These models and tools drive step‑change improvements in issue discovery and detection, triage efficiency, and quality assurance.
Use AI‑powered insights and traditional triage signals to identify the latest on‑road issue trends, new risk scenarios, and edge cases. Develop and refine data‑driven strategies for issue discovery and monitoring, enhanced by ML model outputs.
Serve as the main link between AI/ML development and operational execution by defining and documenting new policies and Standard Operating Procedures (SOPs) that integrate AI tools and insights into daily vendor workflows.
Design and implement robust quality control processes for both human and AI‑generated outputs, performing meta‑quality checks, validating the integrity of vendor work, and providing feedback to improve both human and model performance.
Act as the Subject Matter Expert for Software Quality Operations. You will work closely with stakeholders, program leads, and vendor teams to ensure the seamless adoption and maximum impact of AI/ML advancements in our quality processes.
Be the trusted source for creating and updating technical policies, guidelines, and standard operating procedures for new scopes, platforms, and driving signals.
Provide technical leadership and consultation to stakeholders to enhance workflows and quality by identifying and escalating tool issues, providing technical requirements to engineering, and driving user testing to support the development and deployment of new tooling features.
You Have
BS/BA degree or 4 years of relevant work experience in AV Software Quality Operations
Increased competency in supporting all phases of the machine learning development lifecycle, from data preparation and training to validation, deployment, and monitoring.
Experience with ML testing and validation, including dataset quality assurance, bias detection, edge‑case scenario testing, and performance evaluation using statistical metrics.
Ability to quickly learn and implement new concepts and use proprietary tools. Experience with driving rules and regulations.
A proven ability to work in a fast‑paced, high‑stress environment while maintaining good judgment
Excellent communication and interpersonal skills to collaborate with multiple individuals in a diverse and dynamic work environment
Demonstrated strong execution with an ability to improve outcomes
Basic SQL querying and PLX coding experience
Experience assessing AV safety performance
Experience communications with partners
We Prefer
Experience working with offshore teams or managing multiple local operations hubs.
Competency in LLM / transformer models, and/or ML experience in the robotics domain.
Ability to use subject matter expertise for results analysis and direct customer consultation in the development of new and improved solutions.
Self‑motivated, with foundational skills in task planning and time management.
Experience with ML testing and validation, including dataset quality assurance, bias detection, edge‑case scenario testing, and performance evaluation using statistical metrics.
Competency in supporting all phases of the machine learning development lifecycle, from data preparation and training to validation, deployment, and monitoring.
Waymo employees are also eligible to participate in Waymo’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.
Salary Range: $48.56—$61.06 USD
#J-18808-Ljbffr