Dataman Ltd
DatamanUSA has an exciting opportunity for a talented
Sr. Data Engineer
to work with one of our direct clients in
Durham, NC.
We love referrals! Please refer us to your friends, family, and colleagues for this opportunity. DatamanUSA gives referral bonuses (up to $500) if they get selected and perform well for our clients.
Job Details:
Title:
Sr. Data Engineer
Duration:
12+ Months (with high possibility of extension)
Location:
RTP, Durham, NC, (Hybrid)
(Please Note: Interview can be Webcam or In Person, so high preference would be given to local candidates.
Short Description:
*) DHHS-ITD is seeking a Senior Data Engineer to lead the development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics, ensuring data accessibility, performance, and security for the Child Welfare Program.
Complete Description:
*) The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer.
*) The primary purpose of this position is to lead the development and optimization of our data pipelines, analytics solutions, and cloud-based data platforms.
*) This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.
Key Responsibilities:
Synapse
*) Design, develop, and maintain data models in Synapse to support reporting and analytics.
*) Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
*) Analyze the source system and design the ETL data load.
*) Ability to create and configure Azure Synapse Analytics workspace.
*) Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform, and Load data from different sources like Salesforce.
*) Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
*) Power BI Tools
*0 Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.
Skill Required/Desired/Amount of Experience:
*) Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows Required 5Years.
*) Programming Languages: Strong proficiency in Python or Scala for data processing Required 3Years.
*) SQL Mastery: Advanced query writing, performance tuning, and optimization Required 7Years.
*) Experience with Data Modeling and Warehousing (star schema, snowflake schema) Required 4Years.
*) Experience with ETL/ELT processes Required 5Years.
*) Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database) Highly desired 4Years.
*) Familiarity with Event Hubs, Azure Stream Analytics, and Azure Functions, Desired 4Years.
*) Experience with Programming and Scripting (SQL, T-SQL, and data query optimization) Desired 1Years.
*) Experience with cloud platforms (e.g., AWS and Azure) and associated services for data processing and storage Desired 5Years.
*) Experience with Power BI, Nice to have 1Years.
Skills:
Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows Required 5Years
Sr. Data Engineer
to work with one of our direct clients in
Durham, NC.
We love referrals! Please refer us to your friends, family, and colleagues for this opportunity. DatamanUSA gives referral bonuses (up to $500) if they get selected and perform well for our clients.
Job Details:
Title:
Sr. Data Engineer
Duration:
12+ Months (with high possibility of extension)
Location:
RTP, Durham, NC, (Hybrid)
(Please Note: Interview can be Webcam or In Person, so high preference would be given to local candidates.
Short Description:
*) DHHS-ITD is seeking a Senior Data Engineer to lead the development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics, ensuring data accessibility, performance, and security for the Child Welfare Program.
Complete Description:
*) The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer.
*) The primary purpose of this position is to lead the development and optimization of our data pipelines, analytics solutions, and cloud-based data platforms.
*) This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.
Key Responsibilities:
Synapse
*) Design, develop, and maintain data models in Synapse to support reporting and analytics.
*) Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
*) Analyze the source system and design the ETL data load.
*) Ability to create and configure Azure Synapse Analytics workspace.
*) Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform, and Load data from different sources like Salesforce.
*) Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
*) Power BI Tools
*0 Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.
Skill Required/Desired/Amount of Experience:
*) Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows Required 5Years.
*) Programming Languages: Strong proficiency in Python or Scala for data processing Required 3Years.
*) SQL Mastery: Advanced query writing, performance tuning, and optimization Required 7Years.
*) Experience with Data Modeling and Warehousing (star schema, snowflake schema) Required 4Years.
*) Experience with ETL/ELT processes Required 5Years.
*) Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database) Highly desired 4Years.
*) Familiarity with Event Hubs, Azure Stream Analytics, and Azure Functions, Desired 4Years.
*) Experience with Programming and Scripting (SQL, T-SQL, and data query optimization) Desired 1Years.
*) Experience with cloud platforms (e.g., AWS and Azure) and associated services for data processing and storage Desired 5Years.
*) Experience with Power BI, Nice to have 1Years.
Skills:
Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows Required 5Years