Software Development Engineer, AI & Robotics Optimization

Join the cutting-edge Frontier AI & Robotics team at Amazon, where you'll play a key role in revolutionizing robotics through groundbreaking foundation models deployed at scale. As a Software Development Engineer embedded within our science team, you'll transform innovative research into high-performance production systems. In this dynamic position, you'll work closely with scientists to optimize large-scale transformer architectures for robotics applications. Your expertise in CUDA and TensorRT will be pivotal in achieving extraordinary inference efficiency at Amazon's expansive scale. Key Responsibilities: Drive inference optimization strategies for large-scale foundation models using TensorRT, CUDA, and other NVIDIA tools. Collaborate with scientists to influence model architectures for optimal hardware performance. Design and implement efficient compilation pipelines for intricate transformer architectures. Develop benchmarking frameworks to measure and enhance model performance. Build robust monitoring solutions for reliable model serving at scale. Explore and evaluate emerging optimization techniques, including ONNX Runtime and various ML compilers. Maintain high engineering standards through thorough testing, documentation, and code reviews. A Day in the Life: Optimize transformer blocks using custom CUDA kernels and TensorRT. Partner with scientists to analyze model architectures and propose efficiency enhancements. Implement and benchmark various optimization strategies for large-scale models. Debug performance bottlenecks using NVIDIA profiling tools. Engage in technical discussions regarding new model architectures with the science team. Design and maintain performance monitoring systems for production deployment. Prototype new acceleration approaches utilizing emerging compilation frameworks. At Frontier AI & Robotics, we are not just advancing robotics; we are reimagining it. Our team's mission is to build the future of intelligent robotics through pioneering foundation models and end-to-end learned systems. We confront some of the most significant challenges in AI and robotics, developing sophisticated perception systems and adaptive manipulation strategies for complex, real-world environments. If you are passionate about pushing the boundaries of robotics, collaborating with world-class researchers, and witnessing your innovations deployed on a massive scale, we invite you to join us! Basic Qualifications: 3+ years of professional software development experience. 2+ years of experience in system design or architecture, including design patterns and reliability. Proficiency in at least one programming language. Preferred Qualifications: 3+ years of full software development life cycle experience, including coding standards, code reviews, and testing. Bachelor's degree in computer science or a related field. This position is located in Los Angeles County, and duties include maintaining a collaborative and professional work environment while adhering to all company policies and legal standards. Amazon is an equal opportunity employer. Compensation ranges from $129,300/year in lower markets to $223,600/year in the highest markets, influenced by job-related knowledge, skills, and experience. We offer a comprehensive benefits package.