CORP - Sr Data Engineer

Job Summary We are seeking a seasoned Data Engineer with deep expertise in Microsoft Dynamics 365 (D365), the Power Platform, and enterprise data lifecycle management. This role will focus on designing and implementing scalable data solutions, with a strong emphasis on purging, archiving, supporting data retention policies, and delivering impactful reporting through Power BI. The ideal candidate will also leverage AI and automation to enhance data quality, streamline processes, and enable predictive insights, while supporting historical reporting environments in Databricks and Google Cloud Platform (GCP). Key Responsibilities • Design and implement robust data pipelines and ETL processes using Microsoft technologies • Integrate data from Microsoft D365 with other enterprise systems and databases • Develop and maintain Power Platform solutions (Power BI, Power Automate, Power Apps) • Build and optimize Power BI dashboards and reports • Apply AI/ML techniques to improve data quality, detect anomalies, and forecast trends • Collaborate with stakeholders to understand data requirements • Ensure data governance, security, and compliance • Document data architecture, processes, and workflows Strategic Responsibilities • Champion the use of AI and automation to streamline data operations • Identify opportunities for intelligent automation across reporting and integration workflows • Lead initiatives embedding machine learning into business processes • Align data engineering efforts with the company's AI-first strategy Specialized Skills & Responsibilities • Design and implement data purging strategies in Dataverse and D365 F&O • Develop archiving frameworks using Microsoft tools • Support and enforce data retention policies • Utilize Dataverse APIs and Power Platform connectors for automation • Implement machine learning models for data pattern analysis • Support historical reporting using Databricks and GCP • Monitor system performance and manage data volumes • Ensure compliance with governance and security standards • Maintain documentation and audit trails Required Qualifications • Bachelor's degree in Computer Science, Information Systems, or related field • 6-8 years of experience in data engineering or related roles • Strong experience with Microsoft D365 data structures and APIs • Proficiency in Power Platform tools (Power BI, Power Automate, Power Apps) • Experience building Power BI dashboards and data models • Experience with SQL, Azure Data Factory, and Microsoft cloud services • Hands-on experience with AI/ML tools (e.g., Azure ML, Python) • Experience with Databricks and GCP for historical reporting • Familiarity with data governance and compliance standards Preferred Skills • Experience with Azure Synapse, Dataverse, and Common Data Service • Knowledge of CI/CD pipelines and DataOps practices • Experience with Microsoft Purview or similar governance tools • Experience with automated data orchestration tools (e.g., Azure Data Factory, Apache Airflow) • Exposure to MLOps practices • Strong problem-solving and communication skills • Ability to work cross-functionally with business, IT, and analytics teams