Lumeris
AQ Automation Lead, AI & Data Platforms – Lumeris
The QA Automation Lead will design and drive the automation strategy for AI‑driven healthcare services, including AI agents, Best Next Action (BNA), and supporting data pipelines. They will ensure that testing automation frameworks align with engineering standards and regulatory requirements for safe, explainable AI in healthcare. Acting as a bridge between software engineering and quality assurance, the QA Automation Lead will enhance the reliability and scalability of AI systems through robust test frameworks, automation suites, and CI/CD integration.
Responsibilities
Design and implement end‑to‑end automation frameworks for AI/ML services and APIs.
Lead automation coverage across patient store, data ingestion, and communication pipelines.
Develop Python‑based or TypeScript test suites integrated with ADO Actions, Jenkins, or similar.
Collaborate with developers and data science to embed testing early in the delivery lifecycle.
Integrate synthetic and production‑like data for consistent AI validation.
Establish metrics and dashboards (coverage, pass rate, execution time).
Mentor QA engineers on automation best practices and code review standards.
Qualifications
Bachelor’s in Computer Science, Engineering, or equivalent.
5+ years in QA/QE automation.
Strong Python or JavaScript/TypeScript experience.
Familiar with RESTful APIs, Postman, and cloud (AWS/GCP).
Experience with frameworks like PyTest, Cypress, Playwright, or Robot Framework.
Knowledge of AI testing, data validation, or model QA a strong plus.
Excellent understanding of CI/CD, Docker, and test data management.
Knowledge of AI risk management frameworks (ISO 42001, NIST AI RMF).
Pay Transparency Factors that may be used to determine your actual pay rate include your specific skills, experience, qualifications, location, and comparison to other employees already in this role. In addition to the base salary, certain roles may qualify for a performance‑based incentive and/or equity, with eligibility depending on the position.
The hiring range for this position is: $122,335.00 – $166,114.75
Benefits of Working at Lumeris
Medical, Vision and Dental Plans
Tax‑Advantage Savings Accounts (FSA & HSA)
Life Insurance and Disability Insurance
Paid Time Off (PTO, Sick Time, Paid Leave, Volunteer & Wellness Days)
Employee Assistance Program
401k with company match
Employee Resource Groups
Employee Discount Program
Learning and Development Opportunities
And much more...
Member Facing Position No – Not Member or Patient Facing Position
Location Massachusetts
Time Type Full time
Disclaimer The job description describes the general nature and level of work being performed by people assigned to this job and is not intended to be an exhaustive list of all responsibilities, duties and skills required. The physical activities, demands and working conditions represent those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individual with disabilities to perform the essential job duties and responsibilities.
Lumeris is an EEO/AA employer M/F/V/D.
#J-18808-Ljbffr
Responsibilities
Design and implement end‑to‑end automation frameworks for AI/ML services and APIs.
Lead automation coverage across patient store, data ingestion, and communication pipelines.
Develop Python‑based or TypeScript test suites integrated with ADO Actions, Jenkins, or similar.
Collaborate with developers and data science to embed testing early in the delivery lifecycle.
Integrate synthetic and production‑like data for consistent AI validation.
Establish metrics and dashboards (coverage, pass rate, execution time).
Mentor QA engineers on automation best practices and code review standards.
Qualifications
Bachelor’s in Computer Science, Engineering, or equivalent.
5+ years in QA/QE automation.
Strong Python or JavaScript/TypeScript experience.
Familiar with RESTful APIs, Postman, and cloud (AWS/GCP).
Experience with frameworks like PyTest, Cypress, Playwright, or Robot Framework.
Knowledge of AI testing, data validation, or model QA a strong plus.
Excellent understanding of CI/CD, Docker, and test data management.
Knowledge of AI risk management frameworks (ISO 42001, NIST AI RMF).
Pay Transparency Factors that may be used to determine your actual pay rate include your specific skills, experience, qualifications, location, and comparison to other employees already in this role. In addition to the base salary, certain roles may qualify for a performance‑based incentive and/or equity, with eligibility depending on the position.
The hiring range for this position is: $122,335.00 – $166,114.75
Benefits of Working at Lumeris
Medical, Vision and Dental Plans
Tax‑Advantage Savings Accounts (FSA & HSA)
Life Insurance and Disability Insurance
Paid Time Off (PTO, Sick Time, Paid Leave, Volunteer & Wellness Days)
Employee Assistance Program
401k with company match
Employee Resource Groups
Employee Discount Program
Learning and Development Opportunities
And much more...
Member Facing Position No – Not Member or Patient Facing Position
Location Massachusetts
Time Type Full time
Disclaimer The job description describes the general nature and level of work being performed by people assigned to this job and is not intended to be an exhaustive list of all responsibilities, duties and skills required. The physical activities, demands and working conditions represent those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individual with disabilities to perform the essential job duties and responsibilities.
Lumeris is an EEO/AA employer M/F/V/D.
#J-18808-Ljbffr