Brooksource
Direct message the job poster from Brooksource
Professional Technical Recruiter | Empowering Fortune 500 Companies with Exceptional IT Talent Contract – Full Time
100% Remote
Position Overview Brooksource is currently seeking an experienced Cloud & Data Engineer to play a key role in our Cloud Data Modernization initiative. The ideal candidate will have a strong background in cloud data engineering, ETL development, and data quality assurance. This role will focus on migrating an on-premises Enterprise Data Warehouse (SQL Server) to a modern, cloud-based architecture leveraging Azure and Snowflake. The Cloud & Data Engineer will design and implement scalable data pipelines, ensure seamless integration between systems, and drive automation through modern DevOps and CI/CD practices.
Key Responsibilities
Design, develop, and implement data platform solutions using Azure Data Factory (ADF), Self-Hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), Blob Storage, and Snowflake.
Analyze and refactor existing on-premises ETL processes built in SSIS and T-SQL for migration to Azure/Snowflake.
Build and optimize data pipelines, ensuring scalability, reliability, and performance across environments.
Implement DevOps and CI/CD processes using GitHub Actions to automate testing and deployment.
Collaborate closely with cross-functional teams, including data architects, analysts, and business stakeholders, to define requirements and deliver high-quality solutions.
Perform data validation and QA to ensure accuracy and consistency of data across legacy and cloud systems.
Troubleshoot data integration issues, optimize query performance, and ensure data governance and security compliance.
Contribute to data modeling, metadata management, and data quality best practices within the modern data platform.
Required Qualifications
5+ years of professional experience as a Cloud Data Engineer or Data Platform Engineer.
Hands-on experience with Azure Cloud data tools, including ADF, SHIR, Logic Apps, ADLS Gen2, and Blob Storage.
Proficiency in Snowflake for data warehousing and analytics.
Strong experience in ETL design and development using SQL Server, SSIS, and T-SQL.
Proficiency in Python or other scripting languages for automation and data processing.
Experience with DevOps/CI/CD practices, particularly using GitHub Actions.
Working knowledge of Agile methodologies and sprint-based delivery.
Excellent problem-solving, analytical, and communication skills.
Proven experience performing data validation and quality assurance, especially in data migration or modernization projects.
Ability to work independently, manage priorities, and adapt quickly to new tools and technologies.
Preferred Qualifications
Experience with Databricks for data engineering and analytics workloads.
Familiarity with other cloud platforms, such as AWS or Google Cloud.
Knowledge of data governance, data modeling, and data quality best practices.
Experience implementing unit testing frameworks and documenting results.
Certifications in Azure, Snowflake, or related cloud technologies.
Azure, Snowflake, SQL Server, SSIS, T-SQL, Python, ADF, SHIR, Logic Apps, ADLS Gen2, Blob Storage, GitHub Actions, Databricks, AWS, Google Cloud, CI/CD, Agile
Eight Eleven Group provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, national origin, age, sex, citizenship, disability, genetic information, gender, sexual orientation, gender identity, marital status, amnesty or status as a covered veteran in accordance with applicable federal, state, and local laws.
#J-18808-Ljbffr
Professional Technical Recruiter | Empowering Fortune 500 Companies with Exceptional IT Talent Contract – Full Time
100% Remote
Position Overview Brooksource is currently seeking an experienced Cloud & Data Engineer to play a key role in our Cloud Data Modernization initiative. The ideal candidate will have a strong background in cloud data engineering, ETL development, and data quality assurance. This role will focus on migrating an on-premises Enterprise Data Warehouse (SQL Server) to a modern, cloud-based architecture leveraging Azure and Snowflake. The Cloud & Data Engineer will design and implement scalable data pipelines, ensure seamless integration between systems, and drive automation through modern DevOps and CI/CD practices.
Key Responsibilities
Design, develop, and implement data platform solutions using Azure Data Factory (ADF), Self-Hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), Blob Storage, and Snowflake.
Analyze and refactor existing on-premises ETL processes built in SSIS and T-SQL for migration to Azure/Snowflake.
Build and optimize data pipelines, ensuring scalability, reliability, and performance across environments.
Implement DevOps and CI/CD processes using GitHub Actions to automate testing and deployment.
Collaborate closely with cross-functional teams, including data architects, analysts, and business stakeholders, to define requirements and deliver high-quality solutions.
Perform data validation and QA to ensure accuracy and consistency of data across legacy and cloud systems.
Troubleshoot data integration issues, optimize query performance, and ensure data governance and security compliance.
Contribute to data modeling, metadata management, and data quality best practices within the modern data platform.
Required Qualifications
5+ years of professional experience as a Cloud Data Engineer or Data Platform Engineer.
Hands-on experience with Azure Cloud data tools, including ADF, SHIR, Logic Apps, ADLS Gen2, and Blob Storage.
Proficiency in Snowflake for data warehousing and analytics.
Strong experience in ETL design and development using SQL Server, SSIS, and T-SQL.
Proficiency in Python or other scripting languages for automation and data processing.
Experience with DevOps/CI/CD practices, particularly using GitHub Actions.
Working knowledge of Agile methodologies and sprint-based delivery.
Excellent problem-solving, analytical, and communication skills.
Proven experience performing data validation and quality assurance, especially in data migration or modernization projects.
Ability to work independently, manage priorities, and adapt quickly to new tools and technologies.
Preferred Qualifications
Experience with Databricks for data engineering and analytics workloads.
Familiarity with other cloud platforms, such as AWS or Google Cloud.
Knowledge of data governance, data modeling, and data quality best practices.
Experience implementing unit testing frameworks and documenting results.
Certifications in Azure, Snowflake, or related cloud technologies.
Azure, Snowflake, SQL Server, SSIS, T-SQL, Python, ADF, SHIR, Logic Apps, ADLS Gen2, Blob Storage, GitHub Actions, Databricks, AWS, Google Cloud, CI/CD, Agile
Eight Eleven Group provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, national origin, age, sex, citizenship, disability, genetic information, gender, sexual orientation, gender identity, marital status, amnesty or status as a covered veteran in accordance with applicable federal, state, and local laws.
#J-18808-Ljbffr