WillDom Global, LLC.
Overview
Role: Senior QA Experimentation Engineer Location: Remote Company, the worlds largest B2B online parts locator service for the aviation, aerospace and defense industries with more than 7,000 corporate customers across 130 countries. We are seeking a Senior QA Experimentation Engineer to join our AI Innovation team. This role combines the discipline of QA engineering with the agility of experimentation and the technical knowledge of GTM workflows. The candidate will be responsible for validating AI-driven products, ensuring consistent performance, and guiding experimentation to deliver reliable, high-quality solutions. Responsibilities
Define QA strategies and test plans for AI features, web apps, APIs, and integrations. Design and automate test cases for functional, regression, UI, performance, and security testing. Validate AI models and workflows, including LLM outputs, prompts, and automation pipelines. Test GTM workflows across tools such as n8n, HubSpot, Apollo.io, Clay, and Mailchimp. Run A/B and multivariate tests to measure AI feature performance and user impact. Collaborate in Agile teams, ensuring QA is integrated from requirements through release. Manage defect lifecycle, track quality metrics, and report results to stakeholders. Champion QA best practices and foster a culture of experimentation and continuous improvement. Requirements
Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience). 5+ years of QA experience, including 2+ years in a senior or lead role. Proven experience testing AI/ML solutions, including OpenAI API and LLM-based systems. Proficiency in test automation frameworks (Selenium, Cypress, Playwright, or similar). Strong knowledge of QA methodologies, Agile/Scrum practices, and defect management. Experience with performance and basic security testing. Hands-on experience with GTM platforms and automation tools (HubSpot, Apollo, Mailchimp, n8n, Zapier). Familiarity with A/B testing, experimentation frameworks, and data-driven analysis. VWO experience is nice to have. Excellent analytical, communication, and problem-solving skills. Fluent in English and Spanish language.
#J-18808-Ljbffr
Role: Senior QA Experimentation Engineer Location: Remote Company, the worlds largest B2B online parts locator service for the aviation, aerospace and defense industries with more than 7,000 corporate customers across 130 countries. We are seeking a Senior QA Experimentation Engineer to join our AI Innovation team. This role combines the discipline of QA engineering with the agility of experimentation and the technical knowledge of GTM workflows. The candidate will be responsible for validating AI-driven products, ensuring consistent performance, and guiding experimentation to deliver reliable, high-quality solutions. Responsibilities
Define QA strategies and test plans for AI features, web apps, APIs, and integrations. Design and automate test cases for functional, regression, UI, performance, and security testing. Validate AI models and workflows, including LLM outputs, prompts, and automation pipelines. Test GTM workflows across tools such as n8n, HubSpot, Apollo.io, Clay, and Mailchimp. Run A/B and multivariate tests to measure AI feature performance and user impact. Collaborate in Agile teams, ensuring QA is integrated from requirements through release. Manage defect lifecycle, track quality metrics, and report results to stakeholders. Champion QA best practices and foster a culture of experimentation and continuous improvement. Requirements
Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience). 5+ years of QA experience, including 2+ years in a senior or lead role. Proven experience testing AI/ML solutions, including OpenAI API and LLM-based systems. Proficiency in test automation frameworks (Selenium, Cypress, Playwright, or similar). Strong knowledge of QA methodologies, Agile/Scrum practices, and defect management. Experience with performance and basic security testing. Hands-on experience with GTM platforms and automation tools (HubSpot, Apollo, Mailchimp, n8n, Zapier). Familiarity with A/B testing, experimentation frameworks, and data-driven analysis. VWO experience is nice to have. Excellent analytical, communication, and problem-solving skills. Fluent in English and Spanish language.
#J-18808-Ljbffr