Bull City Talent Group
Position Summary:
Bull City Talent Group's direct client has an immediate need for a MS Azure Developer to assist with an ongoing data integration initiative. The primary goal is to support the transition from a legacy SAP data extraction system to a new pipeline using Azure and Databricks. This role will be responsible for finalizing the backlog of Azure and Databricks development tasks and integrating extracted SAP data into the clients established data models, while ensuring all downstream reporting remains fully functional.
Job Duties & Responsibilities
Develop and maintain raw data tables in the Bronze and Silver layers of Azure Databricks Perform data cleansing and transformation processes using Azure Data Factory (ADF) Integrate new data sources into existing Gold-layer data models, replacing outdated systems Ensure data consistency, accuracy, and availability across all layers Collaborate with data analysts, engineers, and reporting teams to maintain seamless operation of higher-level reporting Monitor and resolve data quality or integrity issues during integration Contribute to performance optimization and scalability of the data pipeline Required Skills & Experience
8+ years of hands-on IT experience in the ETL/data integration space 5+ years of hands-on experience with MS Azure Strong experience in MS Azure services, especially Azure Databricks and Azure Data Factory Proven track record of integrating and managing data pipelines in a Lakehouse architecture (Bronze, Silver, Gold model) Experience with SAP data extraction and transformation is a strong plus Solid understanding of ETL/ELT workflows, data modeling, and data warehousing concepts Proficiency in SQL, PySpark, or Python for data engineering tasks Strong attention to detail with a focus on data quality and reliability Ability to work independently, manage priorities, and deliver high-quality results on time
#J-18808-Ljbffr
Develop and maintain raw data tables in the Bronze and Silver layers of Azure Databricks Perform data cleansing and transformation processes using Azure Data Factory (ADF) Integrate new data sources into existing Gold-layer data models, replacing outdated systems Ensure data consistency, accuracy, and availability across all layers Collaborate with data analysts, engineers, and reporting teams to maintain seamless operation of higher-level reporting Monitor and resolve data quality or integrity issues during integration Contribute to performance optimization and scalability of the data pipeline Required Skills & Experience
8+ years of hands-on IT experience in the ETL/data integration space 5+ years of hands-on experience with MS Azure Strong experience in MS Azure services, especially Azure Databricks and Azure Data Factory Proven track record of integrating and managing data pipelines in a Lakehouse architecture (Bronze, Silver, Gold model) Experience with SAP data extraction and transformation is a strong plus Solid understanding of ETL/ELT workflows, data modeling, and data warehousing concepts Proficiency in SQL, PySpark, or Python for data engineering tasks Strong attention to detail with a focus on data quality and reliability Ability to work independently, manage priorities, and deliver high-quality results on time
#J-18808-Ljbffr