InfoCepts
Overview
The Data Engineer / Big Data Developer role focuses on designing Hive/HCatalog data models, building Spark-based ETL frameworks, and developing Scala/Python Spark jobs. It requires strong SQL and data warehousing concepts. Employment type is Contract; seniority level is Mid-Senior level. Responsibilities
Designing Hive/HCatalog data model includes creating table definitions, file formats, compression techniques for Structured & Semi-structured data processing Implementing Spark processing based ETL frameworks Modifying the Informatica-Teradata & Unix based data pipeline Enhancing the Talend-Hive/Spark & Unix based data pipelines Develop and Deploy Scala/Python based Spark Jobs for ETL processing Strong SQL & DWH concepts Qualifications
Strong SQL & DWH concepts Experience designing Hive/HCatalog data models Experience implementing Spark-based ETL frameworks Experience modifying Informatica-Teradata and Unix based data pipelines Experience enhancing Talend-Hive/Spark and Unix based data pipelines Experience developing and deploying Scala/Python based Spark jobs Employment details
Seniority level: Mid-Senior level Employment type: Contract Job function: Information Technology Industries: IT Services and IT Consulting
#J-18808-Ljbffr
The Data Engineer / Big Data Developer role focuses on designing Hive/HCatalog data models, building Spark-based ETL frameworks, and developing Scala/Python Spark jobs. It requires strong SQL and data warehousing concepts. Employment type is Contract; seniority level is Mid-Senior level. Responsibilities
Designing Hive/HCatalog data model includes creating table definitions, file formats, compression techniques for Structured & Semi-structured data processing Implementing Spark processing based ETL frameworks Modifying the Informatica-Teradata & Unix based data pipeline Enhancing the Talend-Hive/Spark & Unix based data pipelines Develop and Deploy Scala/Python based Spark Jobs for ETL processing Strong SQL & DWH concepts Qualifications
Strong SQL & DWH concepts Experience designing Hive/HCatalog data models Experience implementing Spark-based ETL frameworks Experience modifying Informatica-Teradata and Unix based data pipelines Experience enhancing Talend-Hive/Spark and Unix based data pipelines Experience developing and deploying Scala/Python based Spark jobs Employment details
Seniority level: Mid-Senior level Employment type: Contract Job function: Information Technology Industries: IT Services and IT Consulting
#J-18808-Ljbffr