U.S. Bank
Join to apply for the
Senior Data Engineering Specialist
role at
U.S. Bank .
At U.S. Bank, we’re on a journey to help our customers and businesses make smarter financial decisions and support the communities we serve. We believe in bringing shared ambition to life and celebrating the unique potential of each person. A career with U.S. Bank offers a wide range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills, and discover what you excel at—all from Day One.
Job Description
Guide the team to migrate from on-prem Cloudera to an Azure cloud environment.
Design, implement, and optimize scalable data lake solutions using Snowflake and Databricks. Develop and optimize ingestion, transformation, and storage pipelines.
Manage data governance, quality, and security across cloud environments. Implement performance tuning, automation, and CI/CD for data workflows.
Collaborate with cross‑functional teams to support cloud migration activities.
Install, configure, and manage Cloudera Hadoop clusters, ensuring high availability, performance, and security.
Tune Hadoop, Hive, and Spark jobs and configurations for optimal performance, efficiency, and resource utilization.
Diagnose and resolve issues related to Linux servers, networks, cluster health, job failures, and performance bottlenecks. Provide on‑call support and collaborate with other teams.
Implement and manage security measures within the Cloudera environment, including Kerberos, Apache Ranger, and Atlas.
Set up and manage HashiCorp Vault for secure keys and secrets management.
Utilize CyberArk for privileged access management and secure administrative tasks on the cluster.
Migrate Hadoop, Hive, and Spark data and applications to Azure Synapse Analytics, Azure Databricks, or Snowflake, ensuring data integrity, performance tuning, and validation.
Develop scripts (shell, Ansible, Python) for automating administrative tasks, deployments, and monitoring.
Create and maintain documentation for system configurations, operational procedures, and troubleshooting knowledge bases.
Work closely with the Cloudera vendor to stay current with the latest releases, perform upgrades, and address vulnerabilities.
Basic Qualifications
Advanced degree in Computer Science, Engineering, or related field.
10+ years of hands‑on experience in Data Engineering, Cloud platform management, and performance optimization.
Deep expertise in Hadoop, Hive, Spark, and migration of Big Data into Azure cloud services.
Experience with Databricks and Snowflake platforms and data lake architecture.
Working knowledge of Microsoft Azure cloud and big data migration.
Experience with HashiCorp Vault for secrets and keys management.
Experience with CyberArk for privileged access and administrative security tasks.
Proficiency in Linux, clustering, and distributed systems.
Expertise in Hive and Spark for data processing and analytics, and in Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, and Sqoop.
Proficiency in programming languages such as shell, Ansible, C/C++, Java, Python, Pyspark, and related automation tools.
Strong problem‑solving skills and the ability to diagnose and resolve system failures and performance bottlenecks.
Excellent communication and collaboration skills for working effectively with cross‑functional teams.
Preferred Skills and Experience
Strong experience with Cloudera Hadoop distribution administration.
Deep understanding of banking, operations, risk, and compliance.
Experience with PCI/PII data requirements and change management.
Experience in cloud‑native architectures (Azure/AWS), Kubernetes, Docker, and containerized workflows.
Experience in implementing secure systems with secure API design, IAM integration, Kerberos, Active Directory, and Azure SSO.
Hybrid or flexible schedule availability.
Benefits
Healthcare (medical, dental, vision)
Basic term and optional term life insurance
Short‑term and long‑term disability
Pregnancy disability and parental leave
401(k) and employer‑funded retirement plan
Paid vacation (2‑5 weeks depending on salary grade and tenure)
Up to 11 paid holiday opportunities
Adoption assistance
Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law
Equal Employment Opportunity U.S. Bank is an equal opportunity employer. We consider all qualified applicants without regard to race, religion, color, sex, national origin, age, sexual orientation, gender identity, disability, veteran status, or other factors protected under applicable law.
Pay Range Pay Range: $105,400.00 - $124,000.00.
#J-18808-Ljbffr
Senior Data Engineering Specialist
role at
U.S. Bank .
At U.S. Bank, we’re on a journey to help our customers and businesses make smarter financial decisions and support the communities we serve. We believe in bringing shared ambition to life and celebrating the unique potential of each person. A career with U.S. Bank offers a wide range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills, and discover what you excel at—all from Day One.
Job Description
Guide the team to migrate from on-prem Cloudera to an Azure cloud environment.
Design, implement, and optimize scalable data lake solutions using Snowflake and Databricks. Develop and optimize ingestion, transformation, and storage pipelines.
Manage data governance, quality, and security across cloud environments. Implement performance tuning, automation, and CI/CD for data workflows.
Collaborate with cross‑functional teams to support cloud migration activities.
Install, configure, and manage Cloudera Hadoop clusters, ensuring high availability, performance, and security.
Tune Hadoop, Hive, and Spark jobs and configurations for optimal performance, efficiency, and resource utilization.
Diagnose and resolve issues related to Linux servers, networks, cluster health, job failures, and performance bottlenecks. Provide on‑call support and collaborate with other teams.
Implement and manage security measures within the Cloudera environment, including Kerberos, Apache Ranger, and Atlas.
Set up and manage HashiCorp Vault for secure keys and secrets management.
Utilize CyberArk for privileged access management and secure administrative tasks on the cluster.
Migrate Hadoop, Hive, and Spark data and applications to Azure Synapse Analytics, Azure Databricks, or Snowflake, ensuring data integrity, performance tuning, and validation.
Develop scripts (shell, Ansible, Python) for automating administrative tasks, deployments, and monitoring.
Create and maintain documentation for system configurations, operational procedures, and troubleshooting knowledge bases.
Work closely with the Cloudera vendor to stay current with the latest releases, perform upgrades, and address vulnerabilities.
Basic Qualifications
Advanced degree in Computer Science, Engineering, or related field.
10+ years of hands‑on experience in Data Engineering, Cloud platform management, and performance optimization.
Deep expertise in Hadoop, Hive, Spark, and migration of Big Data into Azure cloud services.
Experience with Databricks and Snowflake platforms and data lake architecture.
Working knowledge of Microsoft Azure cloud and big data migration.
Experience with HashiCorp Vault for secrets and keys management.
Experience with CyberArk for privileged access and administrative security tasks.
Proficiency in Linux, clustering, and distributed systems.
Expertise in Hive and Spark for data processing and analytics, and in Hadoop ecosystem components such as HDFS, YARN, Hive, Spark, and Sqoop.
Proficiency in programming languages such as shell, Ansible, C/C++, Java, Python, Pyspark, and related automation tools.
Strong problem‑solving skills and the ability to diagnose and resolve system failures and performance bottlenecks.
Excellent communication and collaboration skills for working effectively with cross‑functional teams.
Preferred Skills and Experience
Strong experience with Cloudera Hadoop distribution administration.
Deep understanding of banking, operations, risk, and compliance.
Experience with PCI/PII data requirements and change management.
Experience in cloud‑native architectures (Azure/AWS), Kubernetes, Docker, and containerized workflows.
Experience in implementing secure systems with secure API design, IAM integration, Kerberos, Active Directory, and Azure SSO.
Hybrid or flexible schedule availability.
Benefits
Healthcare (medical, dental, vision)
Basic term and optional term life insurance
Short‑term and long‑term disability
Pregnancy disability and parental leave
401(k) and employer‑funded retirement plan
Paid vacation (2‑5 weeks depending on salary grade and tenure)
Up to 11 paid holiday opportunities
Adoption assistance
Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law
Equal Employment Opportunity U.S. Bank is an equal opportunity employer. We consider all qualified applicants without regard to race, religion, color, sex, national origin, age, sexual orientation, gender identity, disability, veteran status, or other factors protected under applicable law.
Pay Range Pay Range: $105,400.00 - $124,000.00.
#J-18808-Ljbffr