Cloud Hybrid Technologies, LLC
Overview
We are seeking a highly skilled Snowflake Data Engineer with expertise in Matillion ETL to join our client's dynamic data engineering team. The ideal candidate will play a crucial role in designing, building, and maintaining scalable and high-performance data pipelines within the Snowflake ecosystem using Matillion. This role requires expertise in data modeling, data transformation, and cloud technologies while focusing on ensuring quality, performance, and accuracy for data-driven decision-making. Responsibilities
Design and Build Data Pipelines: Create, implement, and optimize ETL/ELT pipelines using Matillion for ingesting and processing data from multiple sources into Snowflake. Snowflake Architecture Design: Develop and maintain scalable Snowflake environments, including database design, warehouse management, and performance tuning to support complex queries. Data Transformation: Develop and maintain robust transformations in Matillion to ensure that raw data is cleansed, enriched, and modeled for business consumption. Data Integration: Collaborate with stakeholders to integrate a variety of data sources (e.g., APIs, flat files, databases) into Snowflake and ensure data is stored accurately and securely. Performance Optimization: Monitor and manage performance of ETL pipelines, optimize the use of compute resources in Snowflake, and improve query performance to enhance speed and efficiency. Collaboration: Work closely with cross-functional teams, including Data Scientists, Analysts, and Developers, to deliver data solutions that meet business needs. Quality Assurance: Ensure data quality through rigorous testing, validation, and adherence to best practices for data governance and security requirements. Documentation: Maintain detailed documentation of ETL workflows, data models, and processes to ensure transparency and facilitate support. Qualifications and Required Skills
7+ years of experience working as a Data Engineer Expertise in Snowflake: Strong experience with Snowflake data warehouse platform, including architecture, performance tuning, and security. Matillion ETL Expertise: Hands-on experience with Matillion for developing and managing scalable data pipelines. SQL Proficiency: Advanced proficiency in SQL, including query optimization and debugging. Data Modeling: Strong knowledge of dimensional and relational database modeling principles for building efficient Snowflake databases. Cloud Technologies: Experience with cloud platforms (Azure Preferred but not a requirement) like AWS, Azure, or Google Cloud, including relevant services (e.g., S3, Lambda, Data Factory, BigQuery). Experience with APIs and Data Integration: Familiarity with integrating REST APIs and other data sources into the Snowflake ecosystem. Pipeline Automation: Knowledge of pipeline orchestration tools or workflows (e.g., Airflow, DBT). Problem-Solving Skills: Ability to troubleshoot data-related issues, identify root causes, and implement solutions. Soft Skills: Strong communication and collaboration skills to interact with technical and non-technical stakeholders. Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract
#J-18808-Ljbffr
We are seeking a highly skilled Snowflake Data Engineer with expertise in Matillion ETL to join our client's dynamic data engineering team. The ideal candidate will play a crucial role in designing, building, and maintaining scalable and high-performance data pipelines within the Snowflake ecosystem using Matillion. This role requires expertise in data modeling, data transformation, and cloud technologies while focusing on ensuring quality, performance, and accuracy for data-driven decision-making. Responsibilities
Design and Build Data Pipelines: Create, implement, and optimize ETL/ELT pipelines using Matillion for ingesting and processing data from multiple sources into Snowflake. Snowflake Architecture Design: Develop and maintain scalable Snowflake environments, including database design, warehouse management, and performance tuning to support complex queries. Data Transformation: Develop and maintain robust transformations in Matillion to ensure that raw data is cleansed, enriched, and modeled for business consumption. Data Integration: Collaborate with stakeholders to integrate a variety of data sources (e.g., APIs, flat files, databases) into Snowflake and ensure data is stored accurately and securely. Performance Optimization: Monitor and manage performance of ETL pipelines, optimize the use of compute resources in Snowflake, and improve query performance to enhance speed and efficiency. Collaboration: Work closely with cross-functional teams, including Data Scientists, Analysts, and Developers, to deliver data solutions that meet business needs. Quality Assurance: Ensure data quality through rigorous testing, validation, and adherence to best practices for data governance and security requirements. Documentation: Maintain detailed documentation of ETL workflows, data models, and processes to ensure transparency and facilitate support. Qualifications and Required Skills
7+ years of experience working as a Data Engineer Expertise in Snowflake: Strong experience with Snowflake data warehouse platform, including architecture, performance tuning, and security. Matillion ETL Expertise: Hands-on experience with Matillion for developing and managing scalable data pipelines. SQL Proficiency: Advanced proficiency in SQL, including query optimization and debugging. Data Modeling: Strong knowledge of dimensional and relational database modeling principles for building efficient Snowflake databases. Cloud Technologies: Experience with cloud platforms (Azure Preferred but not a requirement) like AWS, Azure, or Google Cloud, including relevant services (e.g., S3, Lambda, Data Factory, BigQuery). Experience with APIs and Data Integration: Familiarity with integrating REST APIs and other data sources into the Snowflake ecosystem. Pipeline Automation: Knowledge of pipeline orchestration tools or workflows (e.g., Airflow, DBT). Problem-Solving Skills: Ability to troubleshoot data-related issues, identify root causes, and implement solutions. Soft Skills: Strong communication and collaboration skills to interact with technical and non-technical stakeholders. Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract
#J-18808-Ljbffr