Procentrix
Overview
As a
Data Engineer
at Procentrix, you will play a key role in modernizing our data ecosystem by leading efforts to migrate on-premise data sources—including Informix databases and binary objects—into Dataverse and Azure storage. You will design, implement, and maintain Azure Data Factory (ADF) pipelines that enable seamless data movement while ensuring reliability, scalability, and compliance with security standards. This role requires direct interaction with customers to review and confirm requirements, validate data migration needs, and ensure proper configuration and connectivity of the Self-hosted Integration Runtime (SHIR) for secure on-prem to cloud integration. You will collaborate with stakeholders to ensure data quality, troubleshoot issues, and provide guidance on best practices for pipeline automation, scheduling, and error handling. Your work will include building and managing data pipelines, performing transformations, handling error detection and recovery, and ensuring data is delivered efficiently for use across applications and services. Additionally, you will be responsible for configuring integrations with Dataverse, managing blob storage for binary data, and implementing automation and scheduling to support ongoing operational needs.
Responsibilities
Design, implement, and maintain Azure Data Factory pipelines (data movement, transformations, data flows, and integration runtime setup).
Migrate on-premise data sources (e.g., Informix) to cloud environments, ensuring data quality and integrity.
Configure and manage Dataverse integrations via API or OData connectors.
Configure and manage blob storage for binary/object data.
Implement robust error handling, logging, and retry policies in ADF pipelines.
Develop automation and scheduling to support ongoing data operations and reliability.
Collaborate with stakeholders to validate requirements and ensure secure, scalable data solutions.
Qualifications
Strong hands-on experience with Azure Data Factory (ADF), including pipeline design, data flows, and integration runtime setup.
Experience with on-premise databases (e.g., Informix) and migrating data into cloud environments.
Proficiency in SQL for data transformation and schema alignment.
Knowledge of Dataverse integration using API or OData connectors.
Experience implementing error handling, logging, and retry policies in ADF pipelines.
Familiarity with Azure Blob Storage and management of binary/object data.
Experience with scheduling and automation of pipelines in ADF.
Strong problem-solving skills, attention to detail, and ability to work independently and as part of a team.
Desirable Skills
Experience with Microsoft Power Platform and working with Dataverse in enterprise environments.
Familiarity with Azure DevOps or similar CI/CD tools for pipeline deployment and management.
Knowledge of SharePoint integration for binary data movement.
Background in cloud security and access control best practices.
Prior experience supporting large-scale data migration or modernization projects.
Additional Information Procentrix is an Equal Opportunity employer and does not discriminate on the basis of race, color, religion, gender, national origin, age, marital or veteran status, the presence of a non-job related medical condition or handicap, or any other legally protected status.
Job Details
Seniority level: Mid-Senior level
Employment type: Full-time
Job function: Information Technology
Industries: IT Services and IT Consulting
#J-18808-Ljbffr
As a
Data Engineer
at Procentrix, you will play a key role in modernizing our data ecosystem by leading efforts to migrate on-premise data sources—including Informix databases and binary objects—into Dataverse and Azure storage. You will design, implement, and maintain Azure Data Factory (ADF) pipelines that enable seamless data movement while ensuring reliability, scalability, and compliance with security standards. This role requires direct interaction with customers to review and confirm requirements, validate data migration needs, and ensure proper configuration and connectivity of the Self-hosted Integration Runtime (SHIR) for secure on-prem to cloud integration. You will collaborate with stakeholders to ensure data quality, troubleshoot issues, and provide guidance on best practices for pipeline automation, scheduling, and error handling. Your work will include building and managing data pipelines, performing transformations, handling error detection and recovery, and ensuring data is delivered efficiently for use across applications and services. Additionally, you will be responsible for configuring integrations with Dataverse, managing blob storage for binary data, and implementing automation and scheduling to support ongoing operational needs.
Responsibilities
Design, implement, and maintain Azure Data Factory pipelines (data movement, transformations, data flows, and integration runtime setup).
Migrate on-premise data sources (e.g., Informix) to cloud environments, ensuring data quality and integrity.
Configure and manage Dataverse integrations via API or OData connectors.
Configure and manage blob storage for binary/object data.
Implement robust error handling, logging, and retry policies in ADF pipelines.
Develop automation and scheduling to support ongoing data operations and reliability.
Collaborate with stakeholders to validate requirements and ensure secure, scalable data solutions.
Qualifications
Strong hands-on experience with Azure Data Factory (ADF), including pipeline design, data flows, and integration runtime setup.
Experience with on-premise databases (e.g., Informix) and migrating data into cloud environments.
Proficiency in SQL for data transformation and schema alignment.
Knowledge of Dataverse integration using API or OData connectors.
Experience implementing error handling, logging, and retry policies in ADF pipelines.
Familiarity with Azure Blob Storage and management of binary/object data.
Experience with scheduling and automation of pipelines in ADF.
Strong problem-solving skills, attention to detail, and ability to work independently and as part of a team.
Desirable Skills
Experience with Microsoft Power Platform and working with Dataverse in enterprise environments.
Familiarity with Azure DevOps or similar CI/CD tools for pipeline deployment and management.
Knowledge of SharePoint integration for binary data movement.
Background in cloud security and access control best practices.
Prior experience supporting large-scale data migration or modernization projects.
Additional Information Procentrix is an Equal Opportunity employer and does not discriminate on the basis of race, color, religion, gender, national origin, age, marital or veteran status, the presence of a non-job related medical condition or handicap, or any other legally protected status.
Job Details
Seniority level: Mid-Senior level
Employment type: Full-time
Job function: Information Technology
Industries: IT Services and IT Consulting
#J-18808-Ljbffr