AMD
Staff Software Development Engineer - AI/ML Frameworks, C/C++/Python
AMD, San Jose, California, United States, 95199
Staff Software Development Engineer – AI/ML Frameworks, C/C++/Python
5 days ago | Apply now (first 25 applicants will be reviewed first)
We offer a competitive base salary based on skills and experience.
About AMD WHAT YOU DO AT AMD CHANGES EVERYTHING
At AMD, our mission is to build great products that accelerate next‑generation computing experiences—from AI and data centers to PCs, gaming, and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary.
Role Overview The Role
AMD is looking for a world‑class AI frameworks engineer who can provide technical leadership in the development of various AI frameworks in the AMD ecosystem. You will play a pivotal role in developing and optimizing deep learning frameworks for AMD GPUs, engaging with internal GPU library teams and open‑source maintainers to ensure seamless integration of optimizations.
The Person
We are looking for individuals passionate about AI/ML frameworks, software architecture, and/or compilers. You will work on core areas such as AI/ML frameworks (PyTorch, vLLM, SGLang), runtime components, and optimization tooling to accelerate workloads on AMD GPUs.
Key Responsibilities
Optimize Deep Learning Frameworks: Enhance and optimize frameworks like PyTorch, vLLM, SGLang for AMD GPUs in open‑source repositories.
Develop GPU Kernels: Create and optimize GPU kernels to maximize performance for specific AI operations.
Develop & Optimize Models: Design and optimize deep learning models using quantization specifically for AMD GPU performance.
Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improve training and inference performance on AMD GPUs.
Collaborate with Open‑Source Maintainers: Engage with framework maintainers to ensure code changes are aligned with requirements and integrated upstream.
Apply Software Engineering Best Practices: Apply sound engineering principles to ensure robust, maintainable solutions.
Preferred Experience
GPU Kernel Development & Optimization: Experience designing and optimizing GPU kernels for deep learning on AMD GPUs using HIP, CUDA, and assembly.
AI software framework expertise: PyTorch, vLLM, SGLang, benchmarking and profiling.
Profiling and benchmarking tools for large models.
Model optimization: low‑precision quantization, sparsity.
Solid understanding of model architectures (LLMs, MoE, diffusion).
Proficiency in C++ and Python.
Team player willing to work with a geographically distributed team.
Academic Credentials BS, MS or PhD in Computer Science, Computer Engineering, Electrical Engineering, or related technical fields.
Benefits Benefits offered are described as AMD benefits at a glance.
Equal Opportunity Employer AMD and its subsidiaries are equal‑opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
Additional Information Referrals increase your chances of interviewing at AMD by 2x.
This role is not eligible for visa sponsorship.
Seniority: Mid‑Senior level | Employment Type: Full‑time | Industry: Semiconductor Manufacturing
#J-18808-Ljbffr
We offer a competitive base salary based on skills and experience.
About AMD WHAT YOU DO AT AMD CHANGES EVERYTHING
At AMD, our mission is to build great products that accelerate next‑generation computing experiences—from AI and data centers to PCs, gaming, and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary.
Role Overview The Role
AMD is looking for a world‑class AI frameworks engineer who can provide technical leadership in the development of various AI frameworks in the AMD ecosystem. You will play a pivotal role in developing and optimizing deep learning frameworks for AMD GPUs, engaging with internal GPU library teams and open‑source maintainers to ensure seamless integration of optimizations.
The Person
We are looking for individuals passionate about AI/ML frameworks, software architecture, and/or compilers. You will work on core areas such as AI/ML frameworks (PyTorch, vLLM, SGLang), runtime components, and optimization tooling to accelerate workloads on AMD GPUs.
Key Responsibilities
Optimize Deep Learning Frameworks: Enhance and optimize frameworks like PyTorch, vLLM, SGLang for AMD GPUs in open‑source repositories.
Develop GPU Kernels: Create and optimize GPU kernels to maximize performance for specific AI operations.
Develop & Optimize Models: Design and optimize deep learning models using quantization specifically for AMD GPU performance.
Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improve training and inference performance on AMD GPUs.
Collaborate with Open‑Source Maintainers: Engage with framework maintainers to ensure code changes are aligned with requirements and integrated upstream.
Apply Software Engineering Best Practices: Apply sound engineering principles to ensure robust, maintainable solutions.
Preferred Experience
GPU Kernel Development & Optimization: Experience designing and optimizing GPU kernels for deep learning on AMD GPUs using HIP, CUDA, and assembly.
AI software framework expertise: PyTorch, vLLM, SGLang, benchmarking and profiling.
Profiling and benchmarking tools for large models.
Model optimization: low‑precision quantization, sparsity.
Solid understanding of model architectures (LLMs, MoE, diffusion).
Proficiency in C++ and Python.
Team player willing to work with a geographically distributed team.
Academic Credentials BS, MS or PhD in Computer Science, Computer Engineering, Electrical Engineering, or related technical fields.
Benefits Benefits offered are described as AMD benefits at a glance.
Equal Opportunity Employer AMD and its subsidiaries are equal‑opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third‑party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
Additional Information Referrals increase your chances of interviewing at AMD by 2x.
This role is not eligible for visa sponsorship.
Seniority: Mid‑Senior level | Employment Type: Full‑time | Industry: Semiconductor Manufacturing
#J-18808-Ljbffr