Soni Resources
Microsoft Azure Data Engineer
Soni Resources - Camden, New Jersey, United States, 08100
Work at Soni Resources
Overview
- View job
Overview
We're seeking an Azure Data Analytics Engineer to lead the development and optimization of cloud-based business intelligence solutions. This role serves as the Azure SME, driving advanced analytics and managing data integrations across multiple sources including on-prem Oracle, Dynamics CRM, and telematics.
Key Responsibilities:
Data Engineering & Ingestion: Build scalable pipelines using Azure Data Factory, Databricks (PySpark), and develop ETL/ELT processes into Azure Data Lake and SQL.
Architecture & Governance: Design solutions using Lakehouse Architecture; apply Unity Catalog for enterprise-wide data governance.
Data Integration: Integrate data from diverse sources (on-prem, cloud, APIs, telematics) ensuring accuracy and reliability.
Development & Deployment: Use GitHub for version control, CI/CD workflows, and collaborative development practices.
Cross-Functional Collaboration: Work with Data Science, EDW, and business teams to deliver scalable solutions and mentor junior engineers. Required Skills:
Proficiency with Azure Data Factory, Databricks, Synapse, Python, and PySpark
Experience with Oracle data integration and cloud-based data architecture
Knowledge of Unity Catalog, GitHub, and Infrastructure as Code (ARM/Terraform)
Strong problem-solving, collaboration, and communication skills
Qualifications: BA/BS or 4-6 years of relevant experience (or equivalent)
Key Responsibilities:
Data Engineering & Ingestion: Build scalable pipelines using Azure Data Factory, Databricks (PySpark), and develop ETL/ELT processes into Azure Data Lake and SQL.
Architecture & Governance: Design solutions using Lakehouse Architecture; apply Unity Catalog for enterprise-wide data governance.
Data Integration: Integrate data from diverse sources (on-prem, cloud, APIs, telematics) ensuring accuracy and reliability.
Development & Deployment: Use GitHub for version control, CI/CD workflows, and collaborative development practices.
Cross-Functional Collaboration: Work with Data Science, EDW, and business teams to deliver scalable solutions and mentor junior engineers. Required Skills:
Proficiency with Azure Data Factory, Databricks, Synapse, Python, and PySpark
Experience with Oracle data integration and cloud-based data architecture
Knowledge of Unity Catalog, GitHub, and Infrastructure as Code (ARM/Terraform)
Strong problem-solving, collaboration, and communication skills
Qualifications: BA/BS or 4-6 years of relevant experience (or equivalent)