Vantage Point Consulting
Qa engineer with GCP experience
Vantage Point Consulting - Richardson, Texas, United States, 75085
Work at Vantage Point Consulting
Overview
- View job
Overview
JOB DESCRIPTION
Key Skills: GCP Test Automation, CI/CD, API & UI testing automation, experience with Playwright framework and exposure to GenAI for test automation use case
What you will do:
API and Integration Testing: Design, develop, and execute comprehensive API test plans and test cases for AI models and services, covering functional, performance, security, and contract testing. Conduct rigorous testing of new language models (commercial and open source) via their APIs, focusing on accuracy, performance, scalability, and cost effectiveness. Validate data integrity and consistency across various API endpoints and integrations. Implement and maintain API test automation frameworks and tools.
Automation Development and Execution: Develop and maintain automated test scripts using Python and relevant testing frameworks to maximize test coverage and efficiency. Automate the testing of containerized microservices running in Google Cloud Platform (GCP) using appropriate CI/CD pipelines. Champion automation best practices and drive continuous improvement in automation coverage. Develop and maintain performance testing scripts for API endpoints and backend services.
AI Model Evaluation Framework Validation: Ensure the evaluation framework provides a robust and reliable environment for testing the latest AI offerings via automated processes. Develop automated tests to validate the functionality and performance of the evaluation framework itself. Implement automated reporting and analysis of test results. Run automated tests against one or multiple language models simultaneously through API interfaces.
Collaboration and Communication: Work closely with software engineers, data scientists, and other stakeholders to understand requirements and ensure the delivery of high quality AI solutions. Clearly communicate technical concepts and testing results to both technical and non technical stakeholders. Continuous Improvement: Stay abreast of the latest advancements in quality engineering, API testing, and AI technologies, incorporating best practices into the AI Hubs testing processes. Continuously evaluate and improve
What you will do:
API and Integration Testing: Design, develop, and execute comprehensive API test plans and test cases for AI models and services, covering functional, performance, security, and contract testing. Conduct rigorous testing of new language models (commercial and open source) via their APIs, focusing on accuracy, performance, scalability, and cost effectiveness. Validate data integrity and consistency across various API endpoints and integrations. Implement and maintain API test automation frameworks and tools.
Automation Development and Execution: Develop and maintain automated test scripts using Python and relevant testing frameworks to maximize test coverage and efficiency. Automate the testing of containerized microservices running in Google Cloud Platform (GCP) using appropriate CI/CD pipelines. Champion automation best practices and drive continuous improvement in automation coverage. Develop and maintain performance testing scripts for API endpoints and backend services.
AI Model Evaluation Framework Validation: Ensure the evaluation framework provides a robust and reliable environment for testing the latest AI offerings via automated processes. Develop automated tests to validate the functionality and performance of the evaluation framework itself. Implement automated reporting and analysis of test results. Run automated tests against one or multiple language models simultaneously through API interfaces.
Collaboration and Communication: Work closely with software engineers, data scientists, and other stakeholders to understand requirements and ensure the delivery of high quality AI solutions. Clearly communicate technical concepts and testing results to both technical and non technical stakeholders. Continuous Improvement: Stay abreast of the latest advancements in quality engineering, API testing, and AI technologies, incorporating best practices into the AI Hubs testing processes. Continuously evaluate and improve