Join to apply for the Machine Learning Compiler Engineer, Annapurna Labs role at Amazon Web Services (AWS)
Join to apply for the Machine Learning Compiler Engineer, Annapurna Labs role at Amazon Web Services (AWS)
Get AI-powered advice on this job and more exclusive features.
Description
The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX. Your role will involve working closely with our custom-built Machine Learning accelerators, including Inferentia/Trainium, which represent the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI.
Description
The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX. Your role will involve working closely with our custom-built Machine Learning accelerators, including Inferentia/Trainium, which represent the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI.
In this role as a ML Compiler engineer, you'll be instrumental in designing, developing, and optimizing features for our compiler. Your responsibilities will involve tackling crucial challenges alongside a talented engineering team, contributing to leading-edge design and research in compiler technology and deep-learning systems software. Additionally, you'll collaborate closely with cross-functional team members from the Runtime, Frameworks, and Hardware teams to ensure system-wide performance optimization.
As part of the Backend team, you'll play a significant role in designing and developing various aspects of our system. This includes but is not limited to instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programing, code generation, Instruction Set Architectures, new hardware bring-up, and hardware-software co-design.
Key job responsibilities
Our Engineers Collaborate Across Diverse Teams, Projects, And Environments To Have a Firsthand Impact On Our Global Customer Base. You Will
Solve challenging technical problems, often ones not solved before, at every layer of the stack.
Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
Research implementations that deliver the best possible experiences for customers.
A day in the life
As You Design And Code Solutions To Help Our Team Drive Efficiencies In Software Architecture, You’ll Create Metrics, Implement Automation And Other Improvements, And Resolve The Root Cause Of Software Defects. You’ll Also
Build high-impact solutions to deliver to our large customer base.
Participate in design discussions, code review, and communicate with internal and external stakeholders.
Work cross-functionally to help drive business decisions with your technical input.
Work in a startup-like development environment, where you’re always working on the most important stuff.
Basic Qualifications
- B.S. or M.S. in computer science or related field
- Proficiency with 1 or more of the following programming languages: C++ (preferred), Python
- 3+ years of non-internship professional software development experience
- 2+ years of experience developing compiler optimization, graph-theory, hardware bring-up, FPGA placement and routing algorithms, or hardware resource management
- M.S. or Ph.D. in computer science or related field
- Strong knowledge in one or more of the areas of: compiler design, instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programing, code generation, Instruction Set Architectures, new hardware bring-up, and hardware-software co-design
- Experience with LLVM and/or MLIR
- Experience with developing algorithms for simulation tools
- Experience is TensorFlow, PyTorch, and/or JAX
- Experience in LLM, Vision or other deep-learning models
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $129,300/year in our lowest geographic market up to $223,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.
Company - Annapurna Labs (U.S.) Inc.
Job ID: A3006684
Seniority level
Seniority level
Not Applicable
Employment type
Employment type
Full-time
Job function
Job function
Information Technology, Consulting, and EngineeringIndustries
IT Services and IT Consulting
Referrals increase your chances of interviewing at Amazon Web Services (AWS) by 2x
Sign in to set job alerts for “Machine Learning Engineer” roles.
AI/ML Engineer (Multiple roles and seniority levels)
San Jose, CA $120,700.00-$228,600.00 1 week ago
San Jose, CA $120,700.00-$228,600.00 1 week ago
New Grads 2025 - Software Engineer - Computer Vision/Deep Learning
San Jose, CA $120,000.00-$165,000.00 9 months ago
San Jose, CA $137,500.00-$236,500.00 20 hours ago
San Jose, CA $137,500.00-$236,500.00 3 weeks ago
Software Engineer, Machine Learning, YouTube Ads
Mountain View, CA $141,000.00-$202,000.00 5 days ago
Sunnyvale, CA $158,200.00-$185,000.00 2 weeks ago
New Grads 2025 - Software Engineer, Algorithm
San Jose, CA $120,000.00-$165,000.00 10 months ago
Machine Learning Engineer (I, II, or Sr.)
San Jose, CA $142,700.00-$257,600.00 2 weeks ago
Software Engineer, AI Platform - New Grad
Mountain View, CA $145,000.00-$170,000.00 2 weeks ago
San Jose, CA $119,000.00-$177,000.00 5 days ago
Sunnyvale, CA $167,000.00-$185,500.00 2 weeks ago
San Jose, CA $120,700.00-$228,600.00 1 week ago
Sunnyvale, CA $167,000.00-$185,500.00 4 weeks ago
Machine Learning Engineer (I, II, or Sr.)
San Jose, CA $169,500.00-$291,500.00 20 hours ago
San Jose, CA $113,500.00-$250,000.00 1 week ago
San Jose, CA $120,000.00-$240,000.00 4 months ago
San Jose, CA $120,700.00-$301,200.00 1 week ago
Redwood City, CA $167,200.00-$250,800.00 5 days ago
San Jose, CA $130,000.00-$182,000.00 11 months ago
New Grads 2025 - General Software Engineer
San Jose, CA $120,000.00-$165,000.00 5 months ago
Menlo Park, CA $180,000.00-$200,000.00 1 month ago
San Jose, CA $137,500.00-$236,500.00 3 months ago
Sunnyvale, CA $167,000.00-$185,500.00 1 week ago
Machine Learning Engineer- Data Scientist
San Jose, CA $120,000.00-$220,000.00 5 months ago
Machine Learning Engineer, Monetization Engineering
Machine Learning Research Scientist, Active Learning
Mountain View, CA $152,000.00-$228,000.00 1 week ago
Palo Alto, CA $120,000.00-$140,000.00 1 month ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr