DRC Systems
Job Role - Cloud Data Engineer
Location - Minneapolis MN (Remote)
Job Details : Cloud Data Engineer with over 5 years of experience in managing structured and unstructured data performing deep data analysis and building scalable data pipelines. The ideal candidate will have hands‑on expertise in Azure Data Factory (ADF) Snowflake Databricks and Python / PySpark with a strong understanding of cloud‑based ETL processes and data normalization techniques.
Skills Used - ADF Databricks Python / Pyspark SQL Snowflake
Key Responsibilities Analyze and organize raw data from diverse sources including healthcare datasets.
Design and implement ETL pipelines using Azure Data Factory.
Develop and optimize SQL queries, stored procedures and data models in Snowflake.
Parse and flatten semi-structured data (XML JSON) using Snowflake and SQL.
Build scalable data systems and pipelines to support analytics and reporting.
Migrate on‑premise data workloads to cloud platforms preferably Snowflake.
Work with Databricks using PySpark SparkSQL and Python for data transformation.
Ensure data quality through profiling, validation and adherence to governance standards.
Collaborate in Agile development environments and contribute to continuous improvement.
Identify opportunities to enhance data architecture and storage efficiency.
Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Employment Type : Full Time
Experience : years
Vacancy : 1
#J-18808-Ljbffr
Location - Minneapolis MN (Remote)
Job Details : Cloud Data Engineer with over 5 years of experience in managing structured and unstructured data performing deep data analysis and building scalable data pipelines. The ideal candidate will have hands‑on expertise in Azure Data Factory (ADF) Snowflake Databricks and Python / PySpark with a strong understanding of cloud‑based ETL processes and data normalization techniques.
Skills Used - ADF Databricks Python / Pyspark SQL Snowflake
Key Responsibilities Analyze and organize raw data from diverse sources including healthcare datasets.
Design and implement ETL pipelines using Azure Data Factory.
Develop and optimize SQL queries, stored procedures and data models in Snowflake.
Parse and flatten semi-structured data (XML JSON) using Snowflake and SQL.
Build scalable data systems and pipelines to support analytics and reporting.
Migrate on‑premise data workloads to cloud platforms preferably Snowflake.
Work with Databricks using PySpark SparkSQL and Python for data transformation.
Ensure data quality through profiling, validation and adherence to governance standards.
Collaborate in Agile development environments and contribute to continuous improvement.
Identify opportunities to enhance data architecture and storage efficiency.
Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Employment Type : Full Time
Experience : years
Vacancy : 1
#J-18808-Ljbffr