Purple Drive
Role: Azure Data Bricks Developer
Location:
LOUISVILLE, KY
Key Responsibilities:
Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark Integrate data from various sources including Azure Data Lake, Azure Blob Storage, SQL Server, and external APIs Implement ETL/ELT processes to support data ingestion, transformation, and loading Collaborate with data scientists, analysts, and business stakeholders to understand data requirements Optimize data workflows for performance and cost-efficiency Ensure data quality, integrity, and security across all pipelines Monitor and troubleshoot data pipeline issues in production environments Document data flow processes and maintain technical documentation
Location:
LOUISVILLE, KY
Key Responsibilities:
Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark Integrate data from various sources including Azure Data Lake, Azure Blob Storage, SQL Server, and external APIs Implement ETL/ELT processes to support data ingestion, transformation, and loading Collaborate with data scientists, analysts, and business stakeholders to understand data requirements Optimize data workflows for performance and cost-efficiency Ensure data quality, integrity, and security across all pipelines Monitor and troubleshoot data pipeline issues in production environments Document data flow processes and maintain technical documentation