NVIDIA
Senior Solutions Architect, Generative AI Inference and Deployment
NVIDIA, California, Missouri, United States, 65018
Overview
NVIDIA is seeking outstanding AI Solutions Architects to assist and support customers that are building solutions with our newest AI technology. At NVIDIA, our solutions architects work across different teams and enjoy helping customers with the latest Accelerated Computing and Deep Learning software and hardware platforms. You will become a trusted technical advisor with customers and work on projects and proof-of-concepts focused on inference for Generative AI and Large Language Models (LLMs). You will also collaborate with internal teams on performance analysis and modeling of inference software. You should be comfortable working in a dynamic environment, and have experience with Generative AI, LLMs and GPU technologies. This role offers an opportunity to work in an interdisciplinary team at NVIDIA. What You Will Be Doing
Partnering with other solution architects, engineering, product and business teams. Understanding their strategies and technical needs and helping define high-value solutions Dynamically engaging with developers, scientific researchers, and data scientists, gaining experience across a range of technical areas Strategically partnering with lighthouse customers and industry-specific solution partners targeting our computing platform Working closely with customers to help them adopt and build creative solutions using NVIDIA technology and MLOps solutions Analyzing performance and power efficiency of AI inference workloads on Kubernetes Some travel to conferences and customers may be required (20%) What We Need To See (Qualifications)
BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, other Engineering or related fields (or equivalent experience) 8+ years of hands-on experience with Deep Learning frameworks such as PyTorch and TensorFlow Strong fundamentals in programming, optimizations, and software design, especially in Python Proficiency in problem-solving and debugging skills in GPU orchestration and Multi-Instance GPU (MIG) management within Kubernetes environments Experience with containerization and orchestration technologies, monitoring, and observability solutions for AI deployments Excellent knowledge of the theory and practice of LLM and DL inference Excellent presentation, communication and collaboration skills Ways To Stand Out
Prior experience with DL training at scale, deploying or optimizing DL inference in production Experience with NVIDIA GPUs and software libraries such as NVIDIA NIM, Dynamo, TensorRT, TensorRT-LLM Excellent C/C++ programming skills, including debugging, profiling, code optimization, performance analysis, and test design Familiarity with parallel programming and distributed computing platforms Compensation and Benefits
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD. You will also be eligible for equity and benefits. Application and Inclusion
Applications for this job will be accepted at least until September 6, 2025. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. JR1999283 Job Details
Seniority level: Mid-Senior level Employment type: Full-time Job function: Not specified Industries: Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing Referrals increase your chances of interviewing at NVIDIA by 2x. Get notified about new Senior Solutions Architect jobs in California, United States.
#J-18808-Ljbffr
NVIDIA is seeking outstanding AI Solutions Architects to assist and support customers that are building solutions with our newest AI technology. At NVIDIA, our solutions architects work across different teams and enjoy helping customers with the latest Accelerated Computing and Deep Learning software and hardware platforms. You will become a trusted technical advisor with customers and work on projects and proof-of-concepts focused on inference for Generative AI and Large Language Models (LLMs). You will also collaborate with internal teams on performance analysis and modeling of inference software. You should be comfortable working in a dynamic environment, and have experience with Generative AI, LLMs and GPU technologies. This role offers an opportunity to work in an interdisciplinary team at NVIDIA. What You Will Be Doing
Partnering with other solution architects, engineering, product and business teams. Understanding their strategies and technical needs and helping define high-value solutions Dynamically engaging with developers, scientific researchers, and data scientists, gaining experience across a range of technical areas Strategically partnering with lighthouse customers and industry-specific solution partners targeting our computing platform Working closely with customers to help them adopt and build creative solutions using NVIDIA technology and MLOps solutions Analyzing performance and power efficiency of AI inference workloads on Kubernetes Some travel to conferences and customers may be required (20%) What We Need To See (Qualifications)
BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, other Engineering or related fields (or equivalent experience) 8+ years of hands-on experience with Deep Learning frameworks such as PyTorch and TensorFlow Strong fundamentals in programming, optimizations, and software design, especially in Python Proficiency in problem-solving and debugging skills in GPU orchestration and Multi-Instance GPU (MIG) management within Kubernetes environments Experience with containerization and orchestration technologies, monitoring, and observability solutions for AI deployments Excellent knowledge of the theory and practice of LLM and DL inference Excellent presentation, communication and collaboration skills Ways To Stand Out
Prior experience with DL training at scale, deploying or optimizing DL inference in production Experience with NVIDIA GPUs and software libraries such as NVIDIA NIM, Dynamo, TensorRT, TensorRT-LLM Excellent C/C++ programming skills, including debugging, profiling, code optimization, performance analysis, and test design Familiarity with parallel programming and distributed computing platforms Compensation and Benefits
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD. You will also be eligible for equity and benefits. Application and Inclusion
Applications for this job will be accepted at least until September 6, 2025. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. We do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. JR1999283 Job Details
Seniority level: Mid-Senior level Employment type: Full-time Job function: Not specified Industries: Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing Referrals increase your chances of interviewing at NVIDIA by 2x. Get notified about new Senior Solutions Architect jobs in California, United States.
#J-18808-Ljbffr