Nutanix
Machine Learning Engineer (GenAI Benchmarking)
Nutanix, San Diego, California, United States, 92154
Company Qualcomm Korea YH
Interested in learning more about this job Scroll down and find out what skills, experience and educational qualifications are needed. Job Area Engineering Group, Engineering Group > Machine Learning Engineering General Summary: Job Overview As a leading technology innovator, Qualcomm pushes the boundaries of what's possible to enable next-generation experiences and drives digital transformation to help create a smarter, connected future for all. As a Qualcomm Machine Learning Engineer, you will create and implement machine learning techniques, frameworks, and tools that enable the efficient discovery and utilization of state-of-the-art machine learning solutions across mobile, edge, auto, and IoT platforms. This role offers hands-on experience with the latest generative AI models and benchmarking tools, deepens your understanding of model optimization and deployment strategies, and helps define best practices for evaluating next-generation AI solutions. Responsibilities
As a GenAI Benchmarking Engineer at Qualcomm, you will play a pivotal role in shaping the future of on-device AI by designing and implementing comprehensive benchmarking frameworks for advanced machine learning models. Your primary responsibility will be to develop, automate, and maintain robust frameworks that enable other engineers and developers to efficiently assess and validate models throughout the entire deployment pipeline, from simulation to on-device execution. Design, implement, and automate end-to-end benchmarking and verification frameworks to support evaluation of models and features throughout all deployment stages. Analyze state-of-the-art GenAI models and benchmarks, and provide guidance on selecting and applying appropriate evaluation methods for diverse use cases. Develop robust and efficient benchmarking methodologies to assess model performance, including the impact of compression and acceleration technologies. Collaborate with software and system engineers to understand requirements, plan evaluation strategies, and define key performance metrics (KPIs). Preferred Qualifications
MS or PhD in Computer Science, Engineering, or related fields with 1+ years of professional experience. 2+ years of proven experience in software development for machine learning with strong programming skills in Python and software design. Experience in benchmarking generative models, including evaluation of output quality, diversity, and latency. Familiarity with CI/CD workflows and automation tools for benchmarking and model evaluation. Familiarity with AI agent frameworks (like LangChain, LlamaIndex, Autogen). Experience in designing generalized AI solutions such as Retrieval-Augmented Generation (RAG) systems. Experience using/integrating Qualcomm AI Stack products (e.g. QNN, SNPE, QAIRT). Experience optimizing models for hardware acceleration, including quantization and deployment on embedded systems (Android/Linux). Minimum Qualifications
Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 2+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience. OR Master's degree in Computer Science, Engineering, Information Systems, or related field and 1+ year of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience. OR PhD in Computer Science, Engineering, Information Systems, or related field. Applicants
Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, Qualcomm is committed to providing an accessible process. You may inform the Qualcomm disability accommodation team that you need assistance. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries. Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law. To all Staffing and Recruiting Agencies : Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs site or to Qualcomm employees. Qualcomm is not responsible for any fees related to unsolicited resumes/applications. If you would like more information about this role, please contact Qualcomm Careers.
#J-18808-Ljbffr
Interested in learning more about this job Scroll down and find out what skills, experience and educational qualifications are needed. Job Area Engineering Group, Engineering Group > Machine Learning Engineering General Summary: Job Overview As a leading technology innovator, Qualcomm pushes the boundaries of what's possible to enable next-generation experiences and drives digital transformation to help create a smarter, connected future for all. As a Qualcomm Machine Learning Engineer, you will create and implement machine learning techniques, frameworks, and tools that enable the efficient discovery and utilization of state-of-the-art machine learning solutions across mobile, edge, auto, and IoT platforms. This role offers hands-on experience with the latest generative AI models and benchmarking tools, deepens your understanding of model optimization and deployment strategies, and helps define best practices for evaluating next-generation AI solutions. Responsibilities
As a GenAI Benchmarking Engineer at Qualcomm, you will play a pivotal role in shaping the future of on-device AI by designing and implementing comprehensive benchmarking frameworks for advanced machine learning models. Your primary responsibility will be to develop, automate, and maintain robust frameworks that enable other engineers and developers to efficiently assess and validate models throughout the entire deployment pipeline, from simulation to on-device execution. Design, implement, and automate end-to-end benchmarking and verification frameworks to support evaluation of models and features throughout all deployment stages. Analyze state-of-the-art GenAI models and benchmarks, and provide guidance on selecting and applying appropriate evaluation methods for diverse use cases. Develop robust and efficient benchmarking methodologies to assess model performance, including the impact of compression and acceleration technologies. Collaborate with software and system engineers to understand requirements, plan evaluation strategies, and define key performance metrics (KPIs). Preferred Qualifications
MS or PhD in Computer Science, Engineering, or related fields with 1+ years of professional experience. 2+ years of proven experience in software development for machine learning with strong programming skills in Python and software design. Experience in benchmarking generative models, including evaluation of output quality, diversity, and latency. Familiarity with CI/CD workflows and automation tools for benchmarking and model evaluation. Familiarity with AI agent frameworks (like LangChain, LlamaIndex, Autogen). Experience in designing generalized AI solutions such as Retrieval-Augmented Generation (RAG) systems. Experience using/integrating Qualcomm AI Stack products (e.g. QNN, SNPE, QAIRT). Experience optimizing models for hardware acceleration, including quantization and deployment on embedded systems (Android/Linux). Minimum Qualifications
Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 2+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience. OR Master's degree in Computer Science, Engineering, Information Systems, or related field and 1+ year of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience. OR PhD in Computer Science, Engineering, Information Systems, or related field. Applicants
Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, Qualcomm is committed to providing an accessible process. You may inform the Qualcomm disability accommodation team that you need assistance. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries. Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law. To all Staffing and Recruiting Agencies : Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs site or to Qualcomm employees. Qualcomm is not responsible for any fees related to unsolicited resumes/applications. If you would like more information about this role, please contact Qualcomm Careers.
#J-18808-Ljbffr