Compunnel
We are seeking an experienced Azure Developer to design and implement highly performant data ingestion pipelines from multiple sources using Azure Databricks.
The ideal candidate will develop scalable and reusable frameworks to efficiently ingest varied data sets and formats, supporting our data integration and analytics initiatives.
Key Responsibilities
Design and implement efficient data ingestion pipelines using Azure Databricks.
Develop scalable, reusable frameworks to handle diverse data sets and formats.
Collaborate with data engineering and analytics teams to ensure seamless data flow and integration.
Optimize data pipelines for performance, reliability, and maintainability.
Required Qualifications
Expertise in Azure Databricks and Apache PySpark. Proficient with Azure Data Factory (ADF) for orchestrating data workflows. Experience working with Azure Data Lake Storage (ADLS) and Azure Key Vault for secure data management. Preferred Qualifications
Experience with other Azure services related to data engineering and security. Knowledge of best practices in cloud data architecture and pipeline design.
#J-18808-Ljbffr
Expertise in Azure Databricks and Apache PySpark. Proficient with Azure Data Factory (ADF) for orchestrating data workflows. Experience working with Azure Data Lake Storage (ADLS) and Azure Key Vault for secure data management. Preferred Qualifications
Experience with other Azure services related to data engineering and security. Knowledge of best practices in cloud data architecture and pipeline design.
#J-18808-Ljbffr