ExecutivePlacements.com
Be among the first 25 applicants.
Overview At KAYGEN, we are looking for a dynamic, experienced Data Engineer to design and implement Microsoft Fabric Lakehouse architecture. This role focuses on building high-performance data pipelines, ensuring data governance, and integrating with Power BI for advanced analytics.
Key Responsibilities
Design and implement Lakehouse architecture using Microsoft Fabric.
Develop and optimize data engineering pipelines for large-scale data ingestion and transformation.
Work extensively with Delta tables and Direct Lake mode for high-performance analytics.
Ensure data security, governance and compliance within Microsoft Fabric environment.
Integrate Microsoft Fabric with Power BI for advanced reporting and visualization.
Handle multiple source systems including Amazon S, SAP and SQL Database using inbuilt connectors and queries.
Implement Medallion architecture for structured data organization.
Compare and evaluate Fabric vs Databricks and Fabric vs ADF for solution design.
Develop custom transformations and scripts using Python, PySpark and SQL for data processing.
Manage end-to-end project delivery independently, including architecture, development and deployment.
Required Skills
Expertise in Microsoft Fabric components including Lakehouse, Dataflows and Pipelines.
Strong knowledge of Delta tables, Direct Lake mode and Medallion architecture.
Proficiency in Power BI integration and advanced data modeling.
Experience with Azure Data Factory and data orchestration.
Ability to ingest and process data from multiple sources (Amazon S, SAP, SQL Database).
Understanding of data security, governance and compliance frameworks.
Strong programming skills in Python, PySpark and SQL for data engineering tasks.
Preferred Skills
Familiarity with Databricks and advanced big data concepts.
Experience in performance tuning and optimization of data pipelines.
Ability to write efficient queries and transformations using PySpark and SQL.
Strong analytical and problem-solving skills with ability to work independently.
Recruitment We invite you to join our team of talented IT professionals. Apply now to take part in our team-oriented culture grounded in respect, honesty and integrity.
#J-18808-Ljbffr
Overview At KAYGEN, we are looking for a dynamic, experienced Data Engineer to design and implement Microsoft Fabric Lakehouse architecture. This role focuses on building high-performance data pipelines, ensuring data governance, and integrating with Power BI for advanced analytics.
Key Responsibilities
Design and implement Lakehouse architecture using Microsoft Fabric.
Develop and optimize data engineering pipelines for large-scale data ingestion and transformation.
Work extensively with Delta tables and Direct Lake mode for high-performance analytics.
Ensure data security, governance and compliance within Microsoft Fabric environment.
Integrate Microsoft Fabric with Power BI for advanced reporting and visualization.
Handle multiple source systems including Amazon S, SAP and SQL Database using inbuilt connectors and queries.
Implement Medallion architecture for structured data organization.
Compare and evaluate Fabric vs Databricks and Fabric vs ADF for solution design.
Develop custom transformations and scripts using Python, PySpark and SQL for data processing.
Manage end-to-end project delivery independently, including architecture, development and deployment.
Required Skills
Expertise in Microsoft Fabric components including Lakehouse, Dataflows and Pipelines.
Strong knowledge of Delta tables, Direct Lake mode and Medallion architecture.
Proficiency in Power BI integration and advanced data modeling.
Experience with Azure Data Factory and data orchestration.
Ability to ingest and process data from multiple sources (Amazon S, SAP, SQL Database).
Understanding of data security, governance and compliance frameworks.
Strong programming skills in Python, PySpark and SQL for data engineering tasks.
Preferred Skills
Familiarity with Databricks and advanced big data concepts.
Experience in performance tuning and optimization of data pipelines.
Ability to write efficient queries and transformations using PySpark and SQL.
Strong analytical and problem-solving skills with ability to work independently.
Recruitment We invite you to join our team of talented IT professionals. Apply now to take part in our team-oriented culture grounded in respect, honesty and integrity.
#J-18808-Ljbffr