Logo
Vimo

QA Lead (AI Focus)

Vimo, Mountain View, California, us, 94039

Save Job

GetInsured is a market leading company that is transforming government IT infrastructures with our proven SaaS and AI technology. Our innovative approach to health insurance shopping and enrollment has expanded beyond exchanges, and we’re now reinventing the way states administer safety net programs such as Medicaid, SNAP (food stamps), child care, and unemployment insurance. We are looking for a QA Lead (AI Focus) to join our GetInsured team. GetInsured is the leading provider for state-based marketplace technology with more experience than any technology provider transitioning states off healthcare.gov and implementing exchanges. About the Role: As a QA Lead, you will lead QA strategy and execution for voice and AI-driven call center applications in the HHS domain. Responsibilities include: Develop testing strategies for conversational AI (GenAI) experiences: context retention, policy accuracy, hallucination checks, and fallback behaviors. Collaborate with AI/ML teams to define evaluation datasets (golden sets), define testing coverage, and monitor regression. Create reusable test cases across multiple call flows and edge cases for eligibility interviews, application processing, and account updates. Drive test data creation, synthetic scenario generation, and manage tooling across multiple environments (UAT, staging, prod). Own defect lifecycle and work closely with Product, Engineering, and Business Process teams to prioritize and resolve issues. Qualifications: Required Skills: 6+ years of experience in Quality Assurance with at least 2 years in a lead role. Strong hands-on experience in test automation frameworks. Understanding of conversational AI and GenAI evaluation methods: semantic similarity, grounding checks, behavior prediction. Knowledge of API testing and integration points. Preferred Skills: Experience with GenAI test techniques (prompt evaluation, hallucination detection, golden datasets, guardrails). Experience testing in call centers, especially for government or regulated industries. Prior work with public sector or HHS programs (SNAP, TANF, Medicaid) is strongly preferred. Understanding of conversational AI and GenAI evaluation methods: semantic similarity, grounding checks, behavior prediction. Experience integrating QA into CI/CD pipelines. Familiarity with AI observability tools (e.g., LangSmith, Arize, Weights & Biases). Exposure to Genesys, NICE, or other contact center platforms. Seniority level: Mid-Senior level Employment type: Full-time Job function: Quality Assurance Industries: Technology, Information and Internet

#J-18808-Ljbffr