Pyxus International, Inc.
Job Description
We are seeking a skilled and innovative Data Engineer with expertise in Microsoft Fabric to design, build, and optimize data pipelines and analytical solutions that empower business decision-making. This role will be instrumental in shaping our modern data architecture, integrating diverse data sources, and enabling advanced analytics across the organization.
JOB SCOPE
The scope of this position includes data architecture & engineering, data integration, transformation, semantic modeling, optimization, monitoring and troubleshooting, along with contributing to data governance & strategy, architecture reviews, and innovation initiatives.
Responsibilities
Design and implement scalable data pipelines using Microsoft Fabric, including Data Factory, OneLake, Dataflows Gen2, and Lakehouses. Develop and maintain Data Engineering notebooks and transformations. Collaborate with Data Insights team, data analysts, and business stakeholders to deliver high-impact data solutions. Integrate structured and unstructured data from various sources including cloud, on-premises, and third-party APIs. Ensure data quality, governance, and security across all data assets. Optimize performance of data models and queries for Power BI reporting and dashboarding. Support real-time and batch data processing needs using Fabric's native capabilities. Support configuration changes using Azure DevOps, Git and CI/CD principles. Stay current with Microsoft Fabric updates and best practices and advocate for their adoption across teams. Organize, create and maintain critical technical and functional documentation for solutions, including technical specifications, test plans and training materials. Diagnose and resolve application bottlenecks and performance issues via performance tuning/optimization. Diagnose and resolve production support issues with the environment. Provide technical overviews and tool demonstrations to BI Power Users, Key Business users and Functional owners. Qualifications
BA/BS degree and 8+ years of experience in Information Technology Proven success as a Data Engineer (5+ years) in a multi-national organization using Microsoft Fabric in an Azure cloud environment Extensive Knowledge of Azure Data Factory, data warehousing, data engineering, data modeling, data pipelines, and notebooks 3-5 years' experience and strong understanding of data lakehouse architecture, ETL/ELT processes, and data modeling. Experience with CI/CD pipelines, Git, and DevOps practices for data solutions Excellent problem-solving, communication, and collaboration skills Understands Data Governance policies and procedures, using Purview Strong leadership with the ability to motivate and teach others
We are seeking a skilled and innovative Data Engineer with expertise in Microsoft Fabric to design, build, and optimize data pipelines and analytical solutions that empower business decision-making. This role will be instrumental in shaping our modern data architecture, integrating diverse data sources, and enabling advanced analytics across the organization.
JOB SCOPE
The scope of this position includes data architecture & engineering, data integration, transformation, semantic modeling, optimization, monitoring and troubleshooting, along with contributing to data governance & strategy, architecture reviews, and innovation initiatives.
Responsibilities
Design and implement scalable data pipelines using Microsoft Fabric, including Data Factory, OneLake, Dataflows Gen2, and Lakehouses. Develop and maintain Data Engineering notebooks and transformations. Collaborate with Data Insights team, data analysts, and business stakeholders to deliver high-impact data solutions. Integrate structured and unstructured data from various sources including cloud, on-premises, and third-party APIs. Ensure data quality, governance, and security across all data assets. Optimize performance of data models and queries for Power BI reporting and dashboarding. Support real-time and batch data processing needs using Fabric's native capabilities. Support configuration changes using Azure DevOps, Git and CI/CD principles. Stay current with Microsoft Fabric updates and best practices and advocate for their adoption across teams. Organize, create and maintain critical technical and functional documentation for solutions, including technical specifications, test plans and training materials. Diagnose and resolve application bottlenecks and performance issues via performance tuning/optimization. Diagnose and resolve production support issues with the environment. Provide technical overviews and tool demonstrations to BI Power Users, Key Business users and Functional owners. Qualifications
BA/BS degree and 8+ years of experience in Information Technology Proven success as a Data Engineer (5+ years) in a multi-national organization using Microsoft Fabric in an Azure cloud environment Extensive Knowledge of Azure Data Factory, data warehousing, data engineering, data modeling, data pipelines, and notebooks 3-5 years' experience and strong understanding of data lakehouse architecture, ETL/ELT processes, and data modeling. Experience with CI/CD pipelines, Git, and DevOps practices for data solutions Excellent problem-solving, communication, and collaboration skills Understands Data Governance policies and procedures, using Purview Strong leadership with the ability to motivate and teach others