NVIDIA
Join to apply for the
AI System Engineer – New College Grad 2025
role at
NVIDIA Join to apply for the
AI System Engineer – New College Grad 2025
role at
NVIDIA Get AI-powered advice on this job and more exclusive features. At NVIDIA, we are at the forefront of advancing the capabilities of artificial intelligence. We are seeking an ambitious and forward-thinking AI/ML System Performance Engineer to contribute to the development of next-generation inference optimizations and deliver industry-leading performance. In this role, you will investigate and prototype scalable inference strategies—driving down per-token latency and maximizing system throughput by applying cross-stack optimizations that span algorithmic innovations (e.g., attention variants, speculative decoding, inference-time scaling), system-level techniques (e.g., model sharding, pipelining, communication overlap), and hardware-level enhancements.
As NVIDIA makes significant strides in AI datacenters, our team holds a central role in maximizing the efficiency of our exponentially growing inference deployment needs and establishing a data-driven approach to algorithmic improvements, hardware design, and system software development. We collaborate extensively with teams across deep learning research, framework development, compiler and systems engineering, and silicon architecture. Thriving in this high-impact, interdisciplinary environment demands not only technical proficiency but also a growth mindset and a pragmatic attitude—qualities that fuel our collective success in shaping the future of datacenter technology. Sample projects include Helix Parallelism and Disaggregated Inference .
What You’ll Be Doing
Optimize inference deployment by pushing the Pareto frontier of Accuracy, Throughput and Interactivity at datacenter scale Develop high-fidelity performance models to prototype emerging algorithmic techniques & hardware optimizations to drive model-hardware co-design for Generative AI. Prioritize features to guide future software and hardware roadmap based on detailed performance modeling and analysis Model end-to-end performance impact of emerging GenAI workflows - such as Agentic Pipelines, Inference-time compute scaling, etc. – to understand future datacenter needs This position requires you to keep up with the latest DL research and collaborate with diverse teams, including DL researchers, hardware architects, and software engineers.
What We Need To See
Pursuing or recently completed a MS or PhD degree (or equivalent experience) in Computer Science, Electrical Engineering or related fields. Strong background in computer architecture, roofline modeling, queuing theory and statistical performance analysis techniques. Solid understanding of Machine Learning fundamentals, model parallelism and inference serving techniques. Proficiency in Python (and optionally C++) for simulator design and data analysis.
Ways To Stand Out From The Crowd
Experience in system evaluation of AI/ML workloads or performance analysis, modeling and optimizations for AI. Comfortable defining metrics, designing experiments and visualizing large performance datasets to identify resource bottlenecks. Proven track record of working in cross-functional teams, spanning algorithms, software and hardware architecture. Ability to distill complex analyses into clear recommendations for both technical and non-technical stakeholders. Experience with GPU computing (CUDA) or deep learning frameworks like PyTorch, TRT-LLM, VLLM, SGLang
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 120,000 USD - 189,750 USD for Level 2, and 148,000 USD - 235,750 USD for Level 3.
You will also be eligible for equity and benefits .
Applications for this job will be accepted at least until August 24, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
JR2001318
Seniority level
Seniority level Entry level Employment type
Employment type Full-time Job function
Industries Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing Referrals increase your chances of interviewing at NVIDIA by 2x Get notified about new System Engineer jobs in
Santa Clara, CA . Sunnyvale, CA $141,000.00-$202,000.00 2 weeks ago Fremont, CA $70,000.00-$100,000.00 1 week ago Sunnyvale, CA $141,000.00-$202,000.00 5 days ago Fremont, CA $163,000.00-$225,000.00 2 weeks ago San Jose, CA $141,000.00-$202,000.00 1 week ago Sunnyvale, CA $141,000.00-$202,000.00 3 days ago Sunnyvale, CA $141,000.00-$202,000.00 1 week ago San Jose, CA $84,000.00-$134,000.00 1 month ago Sunnyvale, CA $168,000.00-$276,000.00 3 weeks ago San Jose, CA $130,000.00-$182,000.00 6 months ago Mountain View, CA $141,000.00-$202,000.00 2 weeks ago Software Engineer III, Infrastructure, Chrome OS
San Jose, CA $141,000.00-$202,000.00 5 days ago Software Engineer, Offline Conversion Infra
Mountain View, CA $141,000.00-$202,000.00 4 days ago Software Engineer III, Full Stack, Chrome
Mountain View, CA $141,000.00-$202,000.00 2 weeks ago San Jose, CA $82,000.00-$133,000.00 3 months ago San Jose, CA $82,000.00-$133,000.00 2 weeks ago San Jose, CA $82,000.00-$133,000.00 1 month ago Sunnyvale, CA $141,000.00-$202,000.00 2 weeks ago Sunnyvale, CA $141,000.00-$202,000.00 2 weeks ago San Jose, CA $84,000.00-$134,000.00 3 weeks ago Sunnyvale, CA $141,000.00-$202,000.00 2 weeks ago Sunnyvale, CA $141,000.00-$202,000.00 4 days ago San Jose, CA $84,000.00-$134,000.00 3 weeks ago Mountain View, CA $141,000.00-$202,000.00 5 days ago Mountain View, CA $158,000.00-$200,000.00 2 weeks ago Sunnyvale, CA $141,000.00-$202,000.00 1 week ago San Jose, CA $113,400.00-$206,300.00 3 days ago Sunnyvale, CA $141,000.00-$202,000.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
AI System Engineer – New College Grad 2025
role at
NVIDIA Join to apply for the
AI System Engineer – New College Grad 2025
role at
NVIDIA Get AI-powered advice on this job and more exclusive features. At NVIDIA, we are at the forefront of advancing the capabilities of artificial intelligence. We are seeking an ambitious and forward-thinking AI/ML System Performance Engineer to contribute to the development of next-generation inference optimizations and deliver industry-leading performance. In this role, you will investigate and prototype scalable inference strategies—driving down per-token latency and maximizing system throughput by applying cross-stack optimizations that span algorithmic innovations (e.g., attention variants, speculative decoding, inference-time scaling), system-level techniques (e.g., model sharding, pipelining, communication overlap), and hardware-level enhancements.
As NVIDIA makes significant strides in AI datacenters, our team holds a central role in maximizing the efficiency of our exponentially growing inference deployment needs and establishing a data-driven approach to algorithmic improvements, hardware design, and system software development. We collaborate extensively with teams across deep learning research, framework development, compiler and systems engineering, and silicon architecture. Thriving in this high-impact, interdisciplinary environment demands not only technical proficiency but also a growth mindset and a pragmatic attitude—qualities that fuel our collective success in shaping the future of datacenter technology. Sample projects include Helix Parallelism and Disaggregated Inference .
What You’ll Be Doing
Optimize inference deployment by pushing the Pareto frontier of Accuracy, Throughput and Interactivity at datacenter scale Develop high-fidelity performance models to prototype emerging algorithmic techniques & hardware optimizations to drive model-hardware co-design for Generative AI. Prioritize features to guide future software and hardware roadmap based on detailed performance modeling and analysis Model end-to-end performance impact of emerging GenAI workflows - such as Agentic Pipelines, Inference-time compute scaling, etc. – to understand future datacenter needs This position requires you to keep up with the latest DL research and collaborate with diverse teams, including DL researchers, hardware architects, and software engineers.
What We Need To See
Pursuing or recently completed a MS or PhD degree (or equivalent experience) in Computer Science, Electrical Engineering or related fields. Strong background in computer architecture, roofline modeling, queuing theory and statistical performance analysis techniques. Solid understanding of Machine Learning fundamentals, model parallelism and inference serving techniques. Proficiency in Python (and optionally C++) for simulator design and data analysis.
Ways To Stand Out From The Crowd
Experience in system evaluation of AI/ML workloads or performance analysis, modeling and optimizations for AI. Comfortable defining metrics, designing experiments and visualizing large performance datasets to identify resource bottlenecks. Proven track record of working in cross-functional teams, spanning algorithms, software and hardware architecture. Ability to distill complex analyses into clear recommendations for both technical and non-technical stakeholders. Experience with GPU computing (CUDA) or deep learning frameworks like PyTorch, TRT-LLM, VLLM, SGLang
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 120,000 USD - 189,750 USD for Level 2, and 148,000 USD - 235,750 USD for Level 3.
You will also be eligible for equity and benefits .
Applications for this job will be accepted at least until August 24, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
JR2001318
Seniority level
Seniority level Entry level Employment type
Employment type Full-time Job function
Industries Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing Referrals increase your chances of interviewing at NVIDIA by 2x Get notified about new System Engineer jobs in
Santa Clara, CA . Sunnyvale, CA $141,000.00-$202,000.00 2 weeks ago Fremont, CA $70,000.00-$100,000.00 1 week ago Sunnyvale, CA $141,000.00-$202,000.00 5 days ago Fremont, CA $163,000.00-$225,000.00 2 weeks ago San Jose, CA $141,000.00-$202,000.00 1 week ago Sunnyvale, CA $141,000.00-$202,000.00 3 days ago Sunnyvale, CA $141,000.00-$202,000.00 1 week ago San Jose, CA $84,000.00-$134,000.00 1 month ago Sunnyvale, CA $168,000.00-$276,000.00 3 weeks ago San Jose, CA $130,000.00-$182,000.00 6 months ago Mountain View, CA $141,000.00-$202,000.00 2 weeks ago Software Engineer III, Infrastructure, Chrome OS
San Jose, CA $141,000.00-$202,000.00 5 days ago Software Engineer, Offline Conversion Infra
Mountain View, CA $141,000.00-$202,000.00 4 days ago Software Engineer III, Full Stack, Chrome
Mountain View, CA $141,000.00-$202,000.00 2 weeks ago San Jose, CA $82,000.00-$133,000.00 3 months ago San Jose, CA $82,000.00-$133,000.00 2 weeks ago San Jose, CA $82,000.00-$133,000.00 1 month ago Sunnyvale, CA $141,000.00-$202,000.00 2 weeks ago Sunnyvale, CA $141,000.00-$202,000.00 2 weeks ago San Jose, CA $84,000.00-$134,000.00 3 weeks ago Sunnyvale, CA $141,000.00-$202,000.00 2 weeks ago Sunnyvale, CA $141,000.00-$202,000.00 4 days ago San Jose, CA $84,000.00-$134,000.00 3 weeks ago Mountain View, CA $141,000.00-$202,000.00 5 days ago Mountain View, CA $158,000.00-$200,000.00 2 weeks ago Sunnyvale, CA $141,000.00-$202,000.00 1 week ago San Jose, CA $113,400.00-$206,300.00 3 days ago Sunnyvale, CA $141,000.00-$202,000.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr