Data Analyst Job at Saige Consulting in New York

Job Summary 

We are seeking an experienced Data Analyst to support a data migration project from on-premise SQL Server to Azure Cloud, utilizing Azure SQL, Azure Data Lake, Databricks, and Azure Data Factory. The Data Analyst will play a critical role in ensuring the accuracy, consistency, and usability of data by leveraging Python to automate processes in the migration effort and will collaborate closely with data engineers and other analysts to define requirements, validate data models, and support business intelligence initiatives using Power BI in the new Azure environment. The ideal candidate will also be responsible for building and optimizing Power BI reports and dashboards to support business decision-making in the newly migrated system. 

Key Responsibilities 

• Work closely with technical teams to gather and document data requirements for the migration project. 
• Perform detailed data analysis and profiling on existing on-premise SQL Server datasets to understand the structure, data quality, and transformation needs. 
• Leverage Python to create scripts for data extraction, transformation, loading (ETL), and automation of data workflows. 
• Collaborate with development teams to understand required data transforming to new schema 
• Identify data quality issues and collaborate with data engineers to implement data cleaning and transformation processes. 
• Design and execute data validation tests to verify data integrity and consistency before and after migration 
• Develop data validation scripts in Python and automated testing processes to compare migrated data in Azure SQL and Azure Data Lake against the original source data. 
• Collaborate with other data analysts to define and standardize reporting formats, data dictionaries, and KPI definitions. 
• Build and optimize Power BI reports and dashboards ensuring the accurate representation of data across multiple dimensions. 
• Coordinate with data engineers on implementing external data source integration using Azure Data Factory and Databricks, ensuring a seamless flow of third-party data into the new Azure environment. 
• Participate in joint troubleshooting sessions to resolve data-related issues and support continuous improvement in data migration processes. 
• Assist in defining and implementing data governance policies, including data classification, lineage tracking, and access control in collaboration with security and compliance teams. 
• Create detailed documentation for data models, validation processes, and business rules for the migrated environment. 

Qualifications 

• Proven experience as a Data Analyst in migrating large on prem databases to cloud  
• Proficiency in Python for data scripting, automation, and analysis 
• Strong knowledge of Azure data services such as Azure SQL, Azure DataLake, Azure DataBricks, Azure Cosmos DB 
• Proven experience in designing, building, and optimizing Power BI reports, including DAX calculations, data modeling, and visualizations. 
• Understanding of ETL/ELT processes and data migration strategies, with experience collaborating with data engineers on large data transformation projects. 
• Proficiency in SQL, Power BI, and data exploration tools such as Databricks notebooks data validation and data quality validation tools such as Great Expectations 
• Strong knowledge of data modeling principles, schema design, and building analytical models. 
• High level of attention to detail for data validation, quality assurance, and issue resolution. 
• Knowledge of data security and compliance practices in a cloud environment. 
• Strong communication and collaboration abilities.  
• Ability to work independently and as part of a collaborative team. 

Education and Experience 

• Bachelor's degree in Computer Science, Information Technology, or a related field.  
• 5+ years of experience in Data engineering or a related field  
• Certification in Microsoft Azure Data Fundamentals, Azure Data Analyst, or related certification an asset