Qode
Senior Data Engineer
Qode - Pittsburgh, Pennsylvania, us, 15289
Work at Qode
Overview
- View job
Overview
Job Title:
Senior Data Engineer – Hadoop
Location:
Pittsburgh, PA /Cleveland,OH
Department:
Enterprise Data & Analytics
Employment Type:
Full-time
Job Summary:
PNC Bank is seeking a highly skilled
Senior Data Engineer
with extensive experience in
Hadoop-based big data ecosystems . As part of our Enterprise Data & Analytics team, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support advanced analytics and business intelligence initiatives. You will work with cross-functional teams to enable data-driven decision-making across the organization.
Key Responsibilities:
Design, build, and optimize large-scale data pipelines using Hadoop and related technologies (Hive, Pig, HDFS, Spark, Sqoop, etc.). Collaborate with data architects and business stakeholders to understand data requirements and translate them into scalable data solutions. Implement data integration and ETL processes from diverse sources into Hadoop data lake environments. Ensure data quality, data security, and governance standards are upheld across systems. Troubleshoot and resolve issues in complex data environments. Monitor and maintain performance, availability, and reliability of big data platforms. Mentor junior engineers and contribute to the development of best practices and engineering standards. Collaborate with DevOps to support CI/CD and automation processes.
Required Qualifications:
Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field. 5+ years of experience in data engineering, with a strong focus on Hadoop ecosystem tools. Strong programming skills in
Python ,
Java , or
Scala . Deep understanding of
HDFS ,
Hive ,
Spark ,
Sqoop , and
Kafka . Experience with workflow orchestration tools such as
Apache Airflow
or
Oozie . Proficient in
SQL
and working with relational and non-relational databases. Experience working in
cloud environments
(AWS/GCP/Azure) is preferred. Familiarity with data governance and security compliance in the financial services industry.
Senior Data Engineer – Hadoop
Location:
Pittsburgh, PA /Cleveland,OH
Department:
Enterprise Data & Analytics
Employment Type:
Full-time
Job Summary:
PNC Bank is seeking a highly skilled
Senior Data Engineer
with extensive experience in
Hadoop-based big data ecosystems . As part of our Enterprise Data & Analytics team, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support advanced analytics and business intelligence initiatives. You will work with cross-functional teams to enable data-driven decision-making across the organization.
Key Responsibilities:
Design, build, and optimize large-scale data pipelines using Hadoop and related technologies (Hive, Pig, HDFS, Spark, Sqoop, etc.). Collaborate with data architects and business stakeholders to understand data requirements and translate them into scalable data solutions. Implement data integration and ETL processes from diverse sources into Hadoop data lake environments. Ensure data quality, data security, and governance standards are upheld across systems. Troubleshoot and resolve issues in complex data environments. Monitor and maintain performance, availability, and reliability of big data platforms. Mentor junior engineers and contribute to the development of best practices and engineering standards. Collaborate with DevOps to support CI/CD and automation processes.
Required Qualifications:
Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field. 5+ years of experience in data engineering, with a strong focus on Hadoop ecosystem tools. Strong programming skills in
Python ,
Java , or
Scala . Deep understanding of
HDFS ,
Hive ,
Spark ,
Sqoop , and
Kafka . Experience with workflow orchestration tools such as
Apache Airflow
or
Oozie . Proficient in
SQL
and working with relational and non-relational databases. Experience working in
cloud environments
(AWS/GCP/Azure) is preferred. Familiarity with data governance and security compliance in the financial services industry.