Logo
Tier4 Group

Senior QA Consultant - ML/AI 4512

Tier4 Group, Linthicum, Maryland, United States

Save Job

Get AI-powered advice on this job and more exclusive features. This range is provided by Tier4 Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range

$45.00/hr - $48.00/hr We are looking for a Senior QA Consultant to provide quality management for information systems using the standard methodologies, techniques, and metrics for assuring product quality and key activities in quality management. This individual is responsible for performing the following tasks: Establishing capable processes, monitoring and control of critical processes and product mechanisms for feedback of performance, implementing effective root cause analysis and corrective action system, and continuous process improvement. Providing strategic quality plans in targeted areas of the organization; Providing QA strategies to ensure continuous production of products consistent with established industry standards, government regulations, and customer requirements; and Developing and implementing life cycle and QA methodologies and educating and implementing QA metrics. Define and execute comprehensive QA strategies for AI-enabled software systems, including testing for model accuracy, bias, drift, and output consistency. Design test cases for APIs or UIs that consume predictions from NLP models, classifiers, or AI assistants. Validate data flows from ingestion pipelines through model inference and response rendering across multiple systems. Partner with data engineers and scientists to verify pre-processing logic, validate predictions, and interpret edge-case outcomes. Develop test cases and scenarios for model explainability (e.g., SHAP, LIME) and human-in-the-loop validation workflows. Participate in agile sprint activities and act as QA lead for releases involving AI/ML features. Perform database queries and SQL validation to confirm training and inference dataset consistency. Maintain and enhance automated regression and integration test suites using tools like PyTest, Postman, Cypress, JMeter, or Selenium. Support testing of user-facing AI features like chatbots, recommendations, smart prompts, or classification-driven workflows. Collaborate with developers and MLOps engineers to debug pipeline errors and track model prediction anomalies. Monitor and test AI system behavior after model retraining, deployment, or feedback loop adjustment. EDUCATION: This position requires a Bachelor’s degree from an accredited college or university in Engineering, Computer Science, Information Systems or a related discipline. EXPERIENCE: Must have at least eight (8) years of information systems quality assurance experience. Must have at least five (5) years of experience working with statistical methods and quality standards. This individual must have a working QA/process knowledge and possess superior written and verbal communication skills. (AI/ML testing or data science coursework/certification a plus. At least eight (8) years of software quality assurance experience, with increasing responsibility in testing enterprise systems. Minimum three (3) years working with or supporting projects involving AI/ML services or data science teams. Experience testing AI/ML model integration in enterprise applications (e.g., validation of model inferences, confidence scores, and response behaviors). Familiarity with ML model lifecycle, training/inference pipelines, and feedback loop workflows. Hands-on experience testing RESTful APIs, data APIs, or AWS-hosted AI services (e.g., SageMaker). Experience with automated test frameworks and performance testing tools (e.g., JMeter, PyTest, Selenium, Postman, Newman). Strong skills in writing and executing SQL for test data validation and pre/post inference checks. Experience with JSON-based payloads, OpenAPI/Swagger, and mock service tools. Ability to triage and analyze AI prediction issues related to data quality, model logic, or system design. Familiarity with ethical AI practices, including model bias testing, fairness, and transparency, is a plus. Excellent communication skills for bridging technical and non-technical stakeholders around complex AI test cases. Experience in Agile teams, working with tools like JIRA, Confluence, GitHub, TestRail, or similar. Seniority level

Seniority level Mid-Senior level Employment type

Employment type Contract Job function

Job function Quality Assurance and Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at Tier4 Group by 2x Get notified about new Senior Quality Assurance Consultant jobs in

Linthicum Heights, MD . Junior Full Stack Software Engineer (JAVA)

Annapolis Junction, MD $50,000.00-$120,000.00 6 months ago Junior Full Stack Software Engineer (Part-Time/Internship)

Hanover, MD $120,000.00-$170,000.00 2 days ago Fort Meade, MD $12,000.00-$150,000.00 4 weeks ago Columbia, MD $50,000.00-$120,000.00 1 year ago Hanover, MD $78,000.00-$250,000.00 2 weeks ago Hanover, MD $78,000.00-$250,000.00 2 weeks ago Columbia, MD $70,000.00-$190,000.00 6 days ago Junior Software Engineer - Fully Cleared (Prime)

Annapolis Junction, MD $127,000.00-$167,000.00 3 weeks ago Columbia, MD $70,000.00-$190,000.00 6 days ago Annapolis Junction, MD $3,000.00-$5,250.00 1 week ago Hanover, MD $78,000.00-$250,000.00 1 month ago Annapolis Junction, MD $130,000.00-$270,000.00 3 weeks ago Fort Meade, MD $70,000.00-$100,000.00 1 month ago Junior F/E Software Engineer (Hybrid) - 23684

Columbia, MD $89,769.00-$130,000.00 4 days ago Hanover, MD $78,000.00-$250,000.00 2 days ago Annapolis Junction, MD $130,000.00-$270,000.00 1 week ago Software Engineer (Full-Stack Developer)

Fort George G. Meade, MD $130,000.00-$200,000.00 2 weeks ago Hanover, MD $49,996.80-$290,004.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr