Senior Data Engineer - Infrastructure Supply Chain Automation

Description: AWS Infrastructure Services is at the forefront of designing, planning, delivering, and operating the global infrastructure that powers Amazon Web Services (AWS). We are the team that keeps the cloud up and running, ensuring that all AWS data centers run smoothly. Our work involves tackling some of the most complex challenges in supply chain management, impacting a multitude of variables in our operations. As a Senior Data Engineer, you will be part of a diverse team comprising software developers, hardware engineers, network specialists, supply chain experts, security analysts, and operations managers. You will collaborate with various AWS teams to maintain high standards of safety and security, while providing expansive capacity to our customers at minimal cost. Join us in cultivating an inclusive culture that values bold ideas and propels them to fruition. We are looking for a Senior Data Engineer to enhance our Data Lake and Data Warehouse Systems using a serverless architecture built exclusively on native AWS components, including Redshift Spectrum, Athena, S3, Lambda, Glue, EMR, Kinesis, SNS, and CloudWatch. Our world-class data lake is essential for making significant multi-billion dollar decisions, and we seek to optimize data filling with minimal human intervention while democratizing access to this data. Your role will involve: Developing and maintaining automated ETL pipelines (with monitoring) using scripting languages such as Python, Spark, SQL, and AWS services like S3, Glue, Lambda, SNS, SQS, and KMS. Implementing and supporting analytics and reporting infrastructure for internal customers. Establishing data security measures for large-scale data warehouse and lake implementations, including data encryption and user access controls. Creating data objects for business analytics through effective data modeling techniques. Optimizing data warehouse and lake tables by applying best practices in DDL, partitioning, and other methodologies. Maintaining metadata, a data catalog, and user documentation for internal stakeholders. Collaborating with internal clients and software teams to gather requirements for data services and analytics. About the team: Here at AWS, we celebrate diverse experiences. We encourage everyone to apply, regardless of whether you meet all listed qualifications. If your journey has taken a non-traditional route, we value your unique insights. At Amazon Web Services, we are the leading cloud platform globally, having pioneered cloud computing innovation, earning the trust of startups and Global 500 companies alike. We are committed to a culture of inclusion and continuous learning, offering mentorship and various career advancement resources. Enjoy a healthy work-life balance with a flexible working environment where your contributions are valued, and your well-being is prioritized. Basic Qualifications: 5+ years of experience as a data engineer. Proficiency in data modeling, warehousing, and developing ETL pipelines. Solid understanding of SQL. Experience with at least one modern programming language (Python, Java, Scala, or NodeJS). Ability to mentor team members on best practices. Preferred Qualifications: Experience with big data technologies like Hadoop, Hive, Spark, or EMR. Proficient in operating large data warehouses. Amazon is an equal opportunity employer and prohibits discrimination based on protected veteran status, disability, or other legally protected conditions. Our diverse culture empowers individuals to excel and achieve the best results for our customers. For more information on workplace accommodations or assistance during the application process, please visit our dedicated resources. The compensation for this position ranges from $139,100/year in lower geographic markets to $240,500/year in higher markets. Compensation will be based on factors including market location and may also involve additional forms of remuneration such as equity and sign-on bonuses, as well as a comprehensive benefits package. This position will remain open until filled. Please apply through our career site.