Genesis10
Cloud Data Engineer - QA & Migration Specialist
Genesis10, Eden Prairie, Minnesota, United States, 55344
Overview
Genesis10
is currently seeking a Cloud Data Engineer - QA & Migration Specialist for a 5 month contract with our healthcare client in Eden Prairie, MN. This role is 100% remote. Description:
We are seeking a skilled and experienced Senior Cloud Data Engineer to join our team for a Cloud Data Modernization project. The successful candidate will be responsible for migrating our on-premises Enterprise Data Warehouse (SQL Server) to a modern cloud-based data platform utilizing Azure Cloud data tools and Snowflake. Responsibilities
Design, develop, and implement data platform solutions using Azure Data Factory (ADF), Self-hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), Blob Storage, and Snowflake. Review and analyze existing on-premises ETL processes developed in SSIS and T-SQL. Implement DevOps practices and CI/CD pipelines using GitHub Actions. Collaborate with cross-functional teams to ensure seamless integration and data flow. Optimize and troubleshoot data pipelines and workflows. Ensure data security and compliance with industry standards. Perform data validation testing and QA to ensure consistency between on-premises SQL Server and cloud-based Azure and Snowflake environments.
Required Skills
Minimum of 5+ years of experience as a Cloud Data Engineer. Hands-on experience with Azure Cloud data tools (ADF, SHIR, Logic Apps, ADLS Gen2, Blob Storage) and Snowflake. Strong experience in ETL development using SQL Server, SSIS, and T-SQL. Experience with Python or other scripting languages for data processing. Proficiency in DevOps and CI/CD practices, particularly using GitHub Actions. Experience with Agile methodologies. Excellent problem-solving skills and the ability to work independently. Strong communication and collaboration skills. Strong analytical skills and attention to detail. Ability to adapt to new technologies and learn quickly. Proven experience in data validation and quality assurance, especially in data migration projects using Python and SQL. Experience with standard unit testing and documenting results. High attention to detail and ability to identify data inconsistencies.
Desired Skills
Experience with data modeling and database design. Knowledge of data governance and data quality best practices. Experience developing in Databricks for data engineering and analytics workloads. Familiarity with other cloud platforms, such as AWS and Google Cloud. Certification in Azure or Snowflake is a plus.
Compensation
Hourly W2 pay: $60.00 to $67.00/hour We have access to additional contract, contract-to-hire, and direct hire positions with various rate ranges. Benefits of Working with Genesis10
Access to hundreds of clients, many with long-standing relationships with Genesis10. Opportunities for a long-term working relationship within Genesis10. Access to an experienced recruiting team. Medical, Dental, Vision Health Savings Account Voluntary Hospital Indemnity (Critical Illness & Accident) Voluntary Term Life Insurance 401K Sick Pay (for applicable states/municipalities) Commuter Benefits (Dallas, NYC, SF, and Illinois) Remote opportunities available Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. #LI-TJ1 #J-18808-Ljbffr
Genesis10
is currently seeking a Cloud Data Engineer - QA & Migration Specialist for a 5 month contract with our healthcare client in Eden Prairie, MN. This role is 100% remote. Description:
We are seeking a skilled and experienced Senior Cloud Data Engineer to join our team for a Cloud Data Modernization project. The successful candidate will be responsible for migrating our on-premises Enterprise Data Warehouse (SQL Server) to a modern cloud-based data platform utilizing Azure Cloud data tools and Snowflake. Responsibilities
Design, develop, and implement data platform solutions using Azure Data Factory (ADF), Self-hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), Blob Storage, and Snowflake. Review and analyze existing on-premises ETL processes developed in SSIS and T-SQL. Implement DevOps practices and CI/CD pipelines using GitHub Actions. Collaborate with cross-functional teams to ensure seamless integration and data flow. Optimize and troubleshoot data pipelines and workflows. Ensure data security and compliance with industry standards. Perform data validation testing and QA to ensure consistency between on-premises SQL Server and cloud-based Azure and Snowflake environments.
Required Skills
Minimum of 5+ years of experience as a Cloud Data Engineer. Hands-on experience with Azure Cloud data tools (ADF, SHIR, Logic Apps, ADLS Gen2, Blob Storage) and Snowflake. Strong experience in ETL development using SQL Server, SSIS, and T-SQL. Experience with Python or other scripting languages for data processing. Proficiency in DevOps and CI/CD practices, particularly using GitHub Actions. Experience with Agile methodologies. Excellent problem-solving skills and the ability to work independently. Strong communication and collaboration skills. Strong analytical skills and attention to detail. Ability to adapt to new technologies and learn quickly. Proven experience in data validation and quality assurance, especially in data migration projects using Python and SQL. Experience with standard unit testing and documenting results. High attention to detail and ability to identify data inconsistencies.
Desired Skills
Experience with data modeling and database design. Knowledge of data governance and data quality best practices. Experience developing in Databricks for data engineering and analytics workloads. Familiarity with other cloud platforms, such as AWS and Google Cloud. Certification in Azure or Snowflake is a plus.
Compensation
Hourly W2 pay: $60.00 to $67.00/hour We have access to additional contract, contract-to-hire, and direct hire positions with various rate ranges. Benefits of Working with Genesis10
Access to hundreds of clients, many with long-standing relationships with Genesis10. Opportunities for a long-term working relationship within Genesis10. Access to an experienced recruiting team. Medical, Dental, Vision Health Savings Account Voluntary Hospital Indemnity (Critical Illness & Accident) Voluntary Term Life Insurance 401K Sick Pay (for applicable states/municipalities) Commuter Benefits (Dallas, NYC, SF, and Illinois) Remote opportunities available Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. #LI-TJ1 #J-18808-Ljbffr