Amazon
Senior Data Engineer, AWS Infrastructure Supply Chain Automation
Amazon, Herndon, Virginia, United States, 22070
Senior Data Engineer, AWS Infrastructure Supply Chain Automation
AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, were the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain and were looking for talented people who want to help. Overview
Youll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. Youll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. Youll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. Responsibilities
Develop and maintain automated ETL pipelines (with monitoring) using scripting languages such as Python, Spark, SQL and AWS services such as S3, Glue, Lambda, SNS, SQS, KMS. Implement and support reporting and analytics infrastructure for internal business customers. Develop and maintain data security and permissions solutions for enterprise-scale data warehouse and data lake implementations including data encryption and database user access controls and logging. Develop data objects for business analytics using data modeling techniques. Develop and optimize data warehouse and data lake tables using best practices for DDL, physical and logical tables, data partitioning, compression, and parallelization. Develop and maintain data warehouse and data lake metadata, data catalog, and user documentation for internal business customers. Work with internal business customers and software development teams to gather and document requirements for data publishing and data consumption via data warehouse, data lake, and analytics solutions. Basic Qualifications
5+ years of data engineering experience Experience with data modeling, warehousing and building ETL pipelines Experience with SQL Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS Experience mentoring team members on best practices Preferred Qualifications
Experience with big data technologies such as Hadoop, Hive, Spark, EMR Experience operating large data warehouses Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit the Amazon.jobs accommodations page for more information. If the country/region youre applying in isnt listed, please contact your Recruiting Partner. Job ID: A3068805 #J-18808-Ljbffr
AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, were the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain and were looking for talented people who want to help. Overview
Youll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. Youll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. Youll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion. Responsibilities
Develop and maintain automated ETL pipelines (with monitoring) using scripting languages such as Python, Spark, SQL and AWS services such as S3, Glue, Lambda, SNS, SQS, KMS. Implement and support reporting and analytics infrastructure for internal business customers. Develop and maintain data security and permissions solutions for enterprise-scale data warehouse and data lake implementations including data encryption and database user access controls and logging. Develop data objects for business analytics using data modeling techniques. Develop and optimize data warehouse and data lake tables using best practices for DDL, physical and logical tables, data partitioning, compression, and parallelization. Develop and maintain data warehouse and data lake metadata, data catalog, and user documentation for internal business customers. Work with internal business customers and software development teams to gather and document requirements for data publishing and data consumption via data warehouse, data lake, and analytics solutions. Basic Qualifications
5+ years of data engineering experience Experience with data modeling, warehousing and building ETL pipelines Experience with SQL Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS Experience mentoring team members on best practices Preferred Qualifications
Experience with big data technologies such as Hadoop, Hive, Spark, EMR Experience operating large data warehouses Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit the Amazon.jobs accommodations page for more information. If the country/region youre applying in isnt listed, please contact your Recruiting Partner. Job ID: A3068805 #J-18808-Ljbffr