NVIDIA
Senior Software Architect - Deep Learning and HPC Communications
NVIDIA, Santa Clara, California, us, 95053
Senior Software Architect - Deep Learning and HPC Communications
Join to apply for the
Senior Software Architect - Deep Learning and HPC Communications
role at
NVIDIA Senior Software Architect - Deep Learning and HPC Communications
1 week ago Be among the first 25 applicants Join to apply for the
Senior Software Architect - Deep Learning and HPC Communications
role at
NVIDIA Get AI-powered advice on this job and more exclusive features. Direct message the job poster from NVIDIA Sr. Technical Recruiter @ Nvidia (CUDA, DGX & Cloud Computing SW, Autonomous Vehicles, AI/DL/ML)
NVIDIA is leading groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU -- our invention -- serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables groundbreaking creativity and discovery, and powers inventions that were once considered science fiction, including artificial intelligence to autonomous cars. We are the GPU Communications Libraries and Networking team at NVIDIA. We build communication libraries like NCCL, NVSHMEM, and UCX that are crucial for scaling Deep Learning and HPC. We're seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software.
DL and HPC applications have a huge compute demands and already run at scales of up to tens of thousands of GPUs. GPUs are connected with high-speed interconnects (e.g. NVLink, PCIe) within a node and with high-speed networking (e.g. InfiniBand, Ethernet) across nodes. Efficient and fast communication between GPUs directly impacts end-to-end application performance. This impact continues to grow with the increasing scale of next generation systems. This is an outstanding opportunity to advance the state-of-the-art, break performance barriers, and deliver platforms the world has never seen before. Are you ready to build the new and innovative technologies that will help realize NVIDIA's vision?
What You Will Be Doing
Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems. Design and implement new communication technologies to accelerate AI and HPC workloads. Explore innovative solutions in HW and SW for our next generation platforms as part of co-design efforts involving GPU, Networking, and SW architects. Build proofs-of-concept, conduct experiments, and perform quantitive modeling to evaluate and drive new innovations. Use simulation to explore performance of large GPU clusters (think scales of 100s of 1000s of GPUs)
What We Need To See
M.S./Ph.D. degree in CS/CE or equivalent experience. 5+ years of relevant experience. Excellent C/C++ programming and debugging skills. Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC). Deep understanding of operating systems, computer and system architecture. Solid in fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads. Strong experience with Linux. Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment.
Ways To Stand Out From The Crowd
Expertise in related technology and passion for what you do. Experience with CUDA programming and NVIDIA GPUs. Knowledge of high-performance networks like InfiniBand, RoCE, NVLink, etc. Experience with Deep Learning Frameworks such PyTorch, TensorFlow, etc. Knowledge of deep learning parallelisms and mapping to the communication subsystem. Experience with HPC applications. Strong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic and multi-functional environment.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.
You will also be eligible for equity and benefits .
Applications for this job will be accepted at least until August 2, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
JR2001099
Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Industries Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing Referrals increase your chances of interviewing at NVIDIA by 2x Sign in to set job alerts for “Senior Software Architect” roles.
Mountain View, CA $145,000.00-$170,000.00 4 days ago Mountain View, CA $138,225.00-$207,575.00 5 days ago Software Engineer, AI Platform - New Grad
Mountain View, CA $145,000.00-$170,000.00 4 days ago Software Engineer (L4), Content & Business Products
San Jose, CA $100,500.00-$173,250.00 1 week ago Palo Alto, CA $140,000.00-$185,000.00 2 weeks ago Mountain View, CA $130,000.00-$176,000.00 3 weeks ago San Jose, CA $113,400.00-$206,300.00 1 week ago Software Engineer (L5) - Open Connect Platform
San Jose, CA $113,400.00-$206,300.00 1 week ago San Jose, CA $100,500.00-$173,250.00 2 weeks ago San Jose, CA $113,400.00-$206,300.00 1 week ago Frontend Software Engineer - University Graduate 2025
San Mateo, CA $120,000.00-$165,000.00 3 days ago San Jose, CA $113,400.00-$206,300.00 1 week ago eCommerce Full Stack Developer (React / Shopify) - On Site
Software Engineer, Google Store, Front End
Mountain View, CA $141,000.00-$202,000.00 2 weeks ago Palo Alto, CA $122,800.00-$153,500.00 2 weeks ago Menlo Park, CA $157,000.00-$230,000.00 2 weeks ago San Jose, CA $93,200.00-$170,600.00 4 days ago San Jose, CA $113,400.00-$206,300.00 1 week ago Palo Alto, CA $140,000.00-$265,000.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Join to apply for the
Senior Software Architect - Deep Learning and HPC Communications
role at
NVIDIA Senior Software Architect - Deep Learning and HPC Communications
1 week ago Be among the first 25 applicants Join to apply for the
Senior Software Architect - Deep Learning and HPC Communications
role at
NVIDIA Get AI-powered advice on this job and more exclusive features. Direct message the job poster from NVIDIA Sr. Technical Recruiter @ Nvidia (CUDA, DGX & Cloud Computing SW, Autonomous Vehicles, AI/DL/ML)
NVIDIA is leading groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU -- our invention -- serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables groundbreaking creativity and discovery, and powers inventions that were once considered science fiction, including artificial intelligence to autonomous cars. We are the GPU Communications Libraries and Networking team at NVIDIA. We build communication libraries like NCCL, NVSHMEM, and UCX that are crucial for scaling Deep Learning and HPC. We're seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software.
DL and HPC applications have a huge compute demands and already run at scales of up to tens of thousands of GPUs. GPUs are connected with high-speed interconnects (e.g. NVLink, PCIe) within a node and with high-speed networking (e.g. InfiniBand, Ethernet) across nodes. Efficient and fast communication between GPUs directly impacts end-to-end application performance. This impact continues to grow with the increasing scale of next generation systems. This is an outstanding opportunity to advance the state-of-the-art, break performance barriers, and deliver platforms the world has never seen before. Are you ready to build the new and innovative technologies that will help realize NVIDIA's vision?
What You Will Be Doing
Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems. Design and implement new communication technologies to accelerate AI and HPC workloads. Explore innovative solutions in HW and SW for our next generation platforms as part of co-design efforts involving GPU, Networking, and SW architects. Build proofs-of-concept, conduct experiments, and perform quantitive modeling to evaluate and drive new innovations. Use simulation to explore performance of large GPU clusters (think scales of 100s of 1000s of GPUs)
What We Need To See
M.S./Ph.D. degree in CS/CE or equivalent experience. 5+ years of relevant experience. Excellent C/C++ programming and debugging skills. Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC). Deep understanding of operating systems, computer and system architecture. Solid in fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads. Strong experience with Linux. Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment.
Ways To Stand Out From The Crowd
Expertise in related technology and passion for what you do. Experience with CUDA programming and NVIDIA GPUs. Knowledge of high-performance networks like InfiniBand, RoCE, NVLink, etc. Experience with Deep Learning Frameworks such PyTorch, TensorFlow, etc. Knowledge of deep learning parallelisms and mapping to the communication subsystem. Experience with HPC applications. Strong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic and multi-functional environment.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.
You will also be eligible for equity and benefits .
Applications for this job will be accepted at least until August 2, 2025.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
JR2001099
Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Industries Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing Referrals increase your chances of interviewing at NVIDIA by 2x Sign in to set job alerts for “Senior Software Architect” roles.
Mountain View, CA $145,000.00-$170,000.00 4 days ago Mountain View, CA $138,225.00-$207,575.00 5 days ago Software Engineer, AI Platform - New Grad
Mountain View, CA $145,000.00-$170,000.00 4 days ago Software Engineer (L4), Content & Business Products
San Jose, CA $100,500.00-$173,250.00 1 week ago Palo Alto, CA $140,000.00-$185,000.00 2 weeks ago Mountain View, CA $130,000.00-$176,000.00 3 weeks ago San Jose, CA $113,400.00-$206,300.00 1 week ago Software Engineer (L5) - Open Connect Platform
San Jose, CA $113,400.00-$206,300.00 1 week ago San Jose, CA $100,500.00-$173,250.00 2 weeks ago San Jose, CA $113,400.00-$206,300.00 1 week ago Frontend Software Engineer - University Graduate 2025
San Mateo, CA $120,000.00-$165,000.00 3 days ago San Jose, CA $113,400.00-$206,300.00 1 week ago eCommerce Full Stack Developer (React / Shopify) - On Site
Software Engineer, Google Store, Front End
Mountain View, CA $141,000.00-$202,000.00 2 weeks ago Palo Alto, CA $122,800.00-$153,500.00 2 weeks ago Menlo Park, CA $157,000.00-$230,000.00 2 weeks ago San Jose, CA $93,200.00-$170,600.00 4 days ago San Jose, CA $113,400.00-$206,300.00 1 week ago Palo Alto, CA $140,000.00-$265,000.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr