Randstad Digital Americas
Join to apply for the
Data | ETL Architect
role at
Randstad Digital Americas .
1 day ago Be among the first 25 applicants.
Base pay range $80.00/hr - $90.00/hr
Job Summary Scope of Work/Job Characteristics: The Data Architects, under the working job title of Extract, Transform, Load (ETL) Architects, will serve as the principal line of communication for the project team. The ETL Architects will drive the development of data integration pipelines, enabling efficient, reliable access to critical data within the Correction Information Management System (CIMS) Data Warehouse/Data Lake on Azure. They will work with Azure Data Factory (ADF), Azure Databricks, Azure Synapse, Power BI, and Azure Purview. The ETL Architects will be at the forefront of transforming complex data into actionable insights, ensuring data integrity, security, and performance while meeting mission‑critical needs.
Specific duties and responsibilities include:
ETL Pipeline Design And Development : Lead the design and development of high‑performing ETL processes to integrate and transform data across disparate sources; deliver efficient, reliable pipelines that meet business needs and maintain the highest standards of security; utilize ADF to automate and streamline data workflows, ensuring smooth transitions from source to target.
Data Integration and Transformation : Build and manage complex ETL workflows that extract, transform, and load data for downstream analytics and reporting, ensuring data is accurate, timely, and secure; take ownership of data quality and validation by creating resilient ETL processes that ensure only trusted data reaches its destination.
Cloud Platform Expertise : Leverage the full power of the Azure ecosystem—ADF, Databricks, Synapse, and Purview—to manage and process high volumes of structured and unstructured data, delivering solutions that are scalable and performance‑optimized; integrate large datasets into Azure Synapse Analytics, enabling analytics teams to deliver data‑driven insights that support the Department's mission.
Performance Optimization : Continuously optimize ETL jobs to minimize latency and maximize throughput; ensure the architecture supports fast, reliable data access for end‑users and systems, meeting stringent performance metrics.
Security and Compliance : Embed security and compliance best practices in every step of the ETL process; protect sensitive data by adhering to industry standards and ensuring compliance with the Department's data governance policies; use Azure Purview to enforce data governance, track data lineage, and ensure data handling meets the highest standards of integrity.
Collaboration and Stakeholder Engagement : Partner with cross‑functional teams (data engineers, analysts, business stakeholders, and security experts) to design and implement ETL solutions that meet the Department's evolving needs; act as a technical leader and mentor, guiding junior team members and providing expert guidance on data processing and transformation best practices.
Documentation and Best Practices : Develop and maintain clear, detailed documentation for ETL processes, ensuring the team can consistently deliver high‑quality, reliable solutions; establish and enforce best practices for data handling, ETL development, and security to drive a culture of excellence and accountability.
Required Qualifications
A bachelor’s degree in Computer Science, Information Systems, or a related field, or equivalent work experience (SOA and Microsoft Azure Cloud Solutions). At least 7 years of experience in ETL development and data engineering.
3+ years hands‑on experience with ADF, Azure Cloud, Azure Databricks, Azure Synapse Analytics, and Azure Purview.
Proven track record of building and optimizing large‑scale ETL pipelines for high‑performance, high‑availability environments.
Extensive expertise in Spark, Python, and/or Scala for large‑scale data transformations.
Strong SQL proficiency and experience with complex data structures.
In‑depth knowledge of data governance, security protocols, and role‑based access control (RBAC) within Azure.
Ability to design resilient, efficient, and fully compliant ETL processes.
Preferred Qualifications
Microsoft Office Certifications such as Azure Data Engineer Associate, Azure Solutions Architect Expert, and Azure Fundamentals.
Azure Databricks Certification as a Data Engineer Associate.
NOTE: Any successful candidate with access to the Department's network is required to complete the Department's Security Awareness Training within 30 calendar days of hire. In addition to the above list, the selected candidate must successfully complete a Level II Background Check.
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status. At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
#J-18808-Ljbffr
Data | ETL Architect
role at
Randstad Digital Americas .
1 day ago Be among the first 25 applicants.
Base pay range $80.00/hr - $90.00/hr
Job Summary Scope of Work/Job Characteristics: The Data Architects, under the working job title of Extract, Transform, Load (ETL) Architects, will serve as the principal line of communication for the project team. The ETL Architects will drive the development of data integration pipelines, enabling efficient, reliable access to critical data within the Correction Information Management System (CIMS) Data Warehouse/Data Lake on Azure. They will work with Azure Data Factory (ADF), Azure Databricks, Azure Synapse, Power BI, and Azure Purview. The ETL Architects will be at the forefront of transforming complex data into actionable insights, ensuring data integrity, security, and performance while meeting mission‑critical needs.
Specific duties and responsibilities include:
ETL Pipeline Design And Development : Lead the design and development of high‑performing ETL processes to integrate and transform data across disparate sources; deliver efficient, reliable pipelines that meet business needs and maintain the highest standards of security; utilize ADF to automate and streamline data workflows, ensuring smooth transitions from source to target.
Data Integration and Transformation : Build and manage complex ETL workflows that extract, transform, and load data for downstream analytics and reporting, ensuring data is accurate, timely, and secure; take ownership of data quality and validation by creating resilient ETL processes that ensure only trusted data reaches its destination.
Cloud Platform Expertise : Leverage the full power of the Azure ecosystem—ADF, Databricks, Synapse, and Purview—to manage and process high volumes of structured and unstructured data, delivering solutions that are scalable and performance‑optimized; integrate large datasets into Azure Synapse Analytics, enabling analytics teams to deliver data‑driven insights that support the Department's mission.
Performance Optimization : Continuously optimize ETL jobs to minimize latency and maximize throughput; ensure the architecture supports fast, reliable data access for end‑users and systems, meeting stringent performance metrics.
Security and Compliance : Embed security and compliance best practices in every step of the ETL process; protect sensitive data by adhering to industry standards and ensuring compliance with the Department's data governance policies; use Azure Purview to enforce data governance, track data lineage, and ensure data handling meets the highest standards of integrity.
Collaboration and Stakeholder Engagement : Partner with cross‑functional teams (data engineers, analysts, business stakeholders, and security experts) to design and implement ETL solutions that meet the Department's evolving needs; act as a technical leader and mentor, guiding junior team members and providing expert guidance on data processing and transformation best practices.
Documentation and Best Practices : Develop and maintain clear, detailed documentation for ETL processes, ensuring the team can consistently deliver high‑quality, reliable solutions; establish and enforce best practices for data handling, ETL development, and security to drive a culture of excellence and accountability.
Required Qualifications
A bachelor’s degree in Computer Science, Information Systems, or a related field, or equivalent work experience (SOA and Microsoft Azure Cloud Solutions). At least 7 years of experience in ETL development and data engineering.
3+ years hands‑on experience with ADF, Azure Cloud, Azure Databricks, Azure Synapse Analytics, and Azure Purview.
Proven track record of building and optimizing large‑scale ETL pipelines for high‑performance, high‑availability environments.
Extensive expertise in Spark, Python, and/or Scala for large‑scale data transformations.
Strong SQL proficiency and experience with complex data structures.
In‑depth knowledge of data governance, security protocols, and role‑based access control (RBAC) within Azure.
Ability to design resilient, efficient, and fully compliant ETL processes.
Preferred Qualifications
Microsoft Office Certifications such as Azure Data Engineer Associate, Azure Solutions Architect Expert, and Azure Fundamentals.
Azure Databricks Certification as a Data Engineer Associate.
NOTE: Any successful candidate with access to the Department's network is required to complete the Department's Security Awareness Training within 30 calendar days of hire. In addition to the above list, the selected candidate must successfully complete a Level II Background Check.
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status. At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
#J-18808-Ljbffr