EY
Senior Manager - AI Infrastructure & GPU Engineering
EY, Alpharetta, Georgia, United States, 30239
Senior Manager - AI Infrastructure & GPU Engineering
Location: Alpharetta, Atlanta, GA
EY is all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help build a better working world.
Opportunity We’re seeking a seasoned Senior Manager to architect and lead the development of GPU-based infrastructure for scalable AI workloads. This role is ideal for a technical leader with deep expertise in infrastructure and DevOps, who thrives in high-performance environments and is passionate about enabling reliable, production‑grade AI systems.
Your Key Responsibilities
Architect and manage GPU infrastructure to support scalable AI workloads.
Lead implementation of NVIDIA enterprise software including CUDA, Triton Inference Server, and NIM/NCP services.
Provide DevOps and AIOps leadership across CI/CD, observability, and reliability engineering practices.
Mentor infrastructure-focused Managers on system performance optimization and best practices.
Skills And Attributes for Success
Strategic thinking with hands‑on technical leadership.
Strong troubleshooting and performance tuning capabilities.
Ability to lead cross‑functional teams and drive infrastructure excellence.
Passion for innovation and continuous improvement in AI systems.
Embrace emerging technologies and digital tools to enhance collaboration, streamline workflows, and improve service delivery.
Promote a culture of continuous learning and adaptability in a hybrid work environment.
Lead with insight and analytical vigor.
Apply complex problem solving and critical thinking to evaluate data, identify trends, and make informed decisions.
Translate insights into actionable strategies that drive measurable outcomes.
Qualification(s)
8–12+ years of experience in infrastructure or platform engineering.
Strong knowledge of the NVIDIA GPU ecosystem, including MIG, Run.ai, and Kubernetes operators.
Experience with Terraform, Ansible, Helm, and monitoring stacks such as Prometheus and Grafana.
Familiarity with hybrid cloud environments (Azure, AWS, GCP) for GPU workloads.
Ideally, You’ll Also Have
Experience deploying and scaling AI infrastructure in enterprise settings.
Knowledge of security and compliance considerations for AI platforms.
Excellent communication and stakeholder engagement skills.
What We Offer EY offers a comprehensive compensation and benefits package. The base salary range for this job in all geographic locations in the US is $144,000 to $329,100. For the New York City Metro Area, Washington State, and California (excluding Sacramento) the range is $172,800 to $374,000. Individual salaries within those ranges are determined through a wide variety of factors including education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.
Join us in our team-led and leader-enabled hybrid model. Most people in client-serving roles work together in person 40–60% of the time over the course of a year.
Under our flexible vacation policy, you’ll decide how much vacation time you need based on your own personal circumstances. You’ll also be granted time off for designated EY Paid Holidays, winter/summer breaks, personal/family care, and other leaves of absence.
Additional Information EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information.
Equal Employment Opportunity and Disability Accommodation EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities, including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at ssc.customersupport@ey.com.
#J-18808-Ljbffr
EY is all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help build a better working world.
Opportunity We’re seeking a seasoned Senior Manager to architect and lead the development of GPU-based infrastructure for scalable AI workloads. This role is ideal for a technical leader with deep expertise in infrastructure and DevOps, who thrives in high-performance environments and is passionate about enabling reliable, production‑grade AI systems.
Your Key Responsibilities
Architect and manage GPU infrastructure to support scalable AI workloads.
Lead implementation of NVIDIA enterprise software including CUDA, Triton Inference Server, and NIM/NCP services.
Provide DevOps and AIOps leadership across CI/CD, observability, and reliability engineering practices.
Mentor infrastructure-focused Managers on system performance optimization and best practices.
Skills And Attributes for Success
Strategic thinking with hands‑on technical leadership.
Strong troubleshooting and performance tuning capabilities.
Ability to lead cross‑functional teams and drive infrastructure excellence.
Passion for innovation and continuous improvement in AI systems.
Embrace emerging technologies and digital tools to enhance collaboration, streamline workflows, and improve service delivery.
Promote a culture of continuous learning and adaptability in a hybrid work environment.
Lead with insight and analytical vigor.
Apply complex problem solving and critical thinking to evaluate data, identify trends, and make informed decisions.
Translate insights into actionable strategies that drive measurable outcomes.
Qualification(s)
8–12+ years of experience in infrastructure or platform engineering.
Strong knowledge of the NVIDIA GPU ecosystem, including MIG, Run.ai, and Kubernetes operators.
Experience with Terraform, Ansible, Helm, and monitoring stacks such as Prometheus and Grafana.
Familiarity with hybrid cloud environments (Azure, AWS, GCP) for GPU workloads.
Ideally, You’ll Also Have
Experience deploying and scaling AI infrastructure in enterprise settings.
Knowledge of security and compliance considerations for AI platforms.
Excellent communication and stakeholder engagement skills.
What We Offer EY offers a comprehensive compensation and benefits package. The base salary range for this job in all geographic locations in the US is $144,000 to $329,100. For the New York City Metro Area, Washington State, and California (excluding Sacramento) the range is $172,800 to $374,000. Individual salaries within those ranges are determined through a wide variety of factors including education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.
Join us in our team-led and leader-enabled hybrid model. Most people in client-serving roles work together in person 40–60% of the time over the course of a year.
Under our flexible vacation policy, you’ll decide how much vacation time you need based on your own personal circumstances. You’ll also be granted time off for designated EY Paid Holidays, winter/summer breaks, personal/family care, and other leaves of absence.
Additional Information EY accepts applications for this position on an on-going basis. For those living in California, please click here for additional information.
Equal Employment Opportunity and Disability Accommodation EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities, including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at ssc.customersupport@ey.com.
#J-18808-Ljbffr