Junior Machine Learning Quality Engineer Join to apply for the Junior Machine Learning Quality Engineer role at Jobright.ai
Junior Machine Learning Quality Engineer 1 day ago Be among the first 25 applicants
Join to apply for the Junior Machine Learning Quality Engineer role at Jobright.ai
ServiceNow is a global market leader in AI-enhanced technology, serving over 8,100 customers. The Machine Learning Quality Engineer will evaluate AI-generated content, execute test plans, and collaborate with engineering teams to ensure the quality of AI/ML products.
Responsibilities:
Evaluate the quality, accuracy, performance, and safety of AI-generated content produced by large language models (LLMs), identifying areas for improvement
Execute test plans, track quality metrics, and log defects based on observed patterns and results
Maintain and enhance existing test automation frameworks
Contribute to the development and refinement of evaluation criteria and methodologies to strengthen AI model assessment
Design targeted, small-scale test datasets to ensure adequate coverage across use cases
Collaborate with engineering teams to troubleshoot and resolve issues in applications and development/test environments
Qualifications:
Required:
Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving. This may include using AI-powered tools, automating workflows, analyzing AI-driven insights, or exploring AIs potential impact on the function or industry
Minimum of 2 years of professional experience in software quality engineering
Bachelors degree with at least 2 years of relevant experience; or an advanced degree with no prior experience; or equivalent practical experience
Foundational understanding of AI concepts such as agentic systems, algorithms, models, and associated ethical considerations
Experience with automated testing frameworks such as Java, JUnit, Selenium, TestNG, and other open-source tools
Proficient in programming and scripting with Java and Python; experience with tools such as Eclipse, Jenkins, Maven, and Git
Familiarity with development tools including IDEs, debuggers, build tools, version control systems, and Unix/system administration utilities
Solid understanding of Agile methodologies and the software development lifecycle (SDLC)
Preferred:
Hands-on experience or strong interest in testing machine learning and Generative AI systems, including synthetic data generation and prompt engineering, is highly preferred
Company:
ServiceNow is an AI platform that delivers IT operations, field service management, and app engine solutions. Founded in 2004, the company is headquartered in Santa Clara, California, USA, with a team of 10001+ employees. The company is currently Public Company. ServiceNow has a track record of offering H1B sponsorships.
Seniority level Seniority level Entry level
Employment type Employment type Full-time
Job function Industries Software Development
Referrals increase your chances of interviewing at Jobright.ai by 2x
Inferred from the description for this job Medical insurance
Vision insurance
401(k)
Get notified about new Machine Learning Engineer jobs in Santa Clara County, CA .
AI/ML Engineer (Multiple roles and seniority levels) Software Engineer, AI Platform - New Grad Mountain View, CA $145,000.00-$170,000.00 4 days ago
Machine Learning Engineer, Early Stage Project Mountain View, CA $136,000.00-$185,000.00 1 week ago
San Jose, CA $137,500.00-$236,500.00 6 days ago
San Jose, CA $120,700.00-$228,600.00 1 week ago
New Grads 2025 - Software Engineer, Algorithm San Jose, CA $120,000.00-$165,000.00 10 months ago
San Jose, CA $118,657.00-$187,200.00 1 week ago
New Grads 2025 - Software Engineer - Computer Vision/Deep Learning San Jose, CA $120,000.00-$165,000.00 9 months ago
Software Development Engineer In Test (SDET) San Jose, CA $87,600.00-$186,000.00 3 weeks ago
Mountain View, CA $138,225.00-$207,575.00 5 days ago
San Jose, CA $120,700.00-$228,600.00 6 days ago
San Jose, CA $120,700.00-$228,600.00 1 week ago
New Grads 2025 - General Software Engineer San Jose, CA $120,000.00-$165,000.00 6 months ago
Machine Learning Engineer Intern (Search -TikTok.US) - 2025 Summer (BS/MS) Mountain View, CA $152,000.00-$228,000.00 6 days ago
Perception Engineer ML/CV and Algorithms San Jose, CA $130,000.00-$182,000.00 2 months ago
Machine Learning Research Scientist, Active Learning Mountain View, CA $152,000.00-$228,000.00 2 weeks ago
San Jose, CA $118,657.00-$187,200.00 2 weeks ago
Machine Learning Engineer Intern (E-commerce-Recommendation) - 2025 Summer/Fall (BS/MS) San Jose, CA $120,700.00-$301,200.00 1 week ago
San Jose, CA $169,500.00-$291,500.00 6 days ago
San Jose, CA $137,500.00-$236,500.00 1 month ago
Machine Learning Engineer, Monetization Engineering Sunnyvale, CA $158,200.00-$185,000.00 3 weeks ago
San Jose, CA $142,700.00-$257,600.00 1 week ago
Machine Learning Engineer Graduate (TikTok E-Commerce - Conversational AI)-2025 Start (MS) San Jose, CA $118,657.00-$187,200.00 2 weeks ago
San Jose, CA $120,000.00-$240,000.00 4 months ago
San Jose, CA $118,657.00-$259,200.00 1 week ago
Machine Learning Engineer Graduate (E-Commerce Recommendation/Search Alliance)- 2025 Start (MS) San Jose, CA $118,657.00-$187,200.00 1 week ago
Machine Learning Engineer Graduate (Ads Core Global) - 2025 Start (BS/MS) San Jose, CA $118,657.00-$259,200.00 2 weeks ago
Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
See details and apply
Junior Machine Learning Quality Engineer