Rose International
NEW JOB OPENING DATA ENGINEER IN WHITE PLAINS, NY, USA!
Rose International - New York, New York, us, 10261
Work at Rose International
Overview
- View job
Overview
Job Description
Education: - Bachelor's or Master's degree in a relevant field like Computer science, Data Engineering or related technical field.
Preferred certifications: - Azure Data Engineer associate - SAP Certified Associate - Integration Developer
Required Skills & Experience: - 7+ years of experience in Data Engineering, ETL, and SQL development. - Hands-on experience with SAP BTP Integration Suite for SAP and non-SAP integrations. - Strong expertise in Pentaho (PDI), Microsoft ADF, and API development. - Proficiency in SQL (stored procedures, query optimization, performance tuning). - Experience working with Azure DevOps, GitHub, and CI/CD for data pipelines. - Good understanding of data governance tools (Ataccama, Collibra) and data quality management. - Experience working with AWS, Azure, and Google Cloud (GCP) for data integration and cloud-based workflows. - Strong problem-solving skills and ability to work independently in a fast-paced environment.
Preferred Qualifications: - Experience working on SAP S/4HANA and cloud-based ERP implementations. - Familiarity with Python, PySpark for data processing and automation. - Experience working on Pentaho, Microsoft ADF/or equivalent ETL tools - Knowledge of event-driven architectures - Familiarity with CI/CD for data pipelines (Azure DevOps, GitHub Actions, etc.).
Project Overview Client current on-premises Enterprise Resource Planning (ERP) system, SAP ECC 6.0, has been in use for over a decade and is nearing technological obsolescence resulting in Client requirement to select and implement a new ERP system. The objective for deploying a new ERP system, is to successfully implement a system that integrates all business functions, including finance, operations, and human resources into a cohesive platform. This implementation aims to enhance organizational efficiency, improve data accuracy, and provide real-time reporting capabilities. The goal is to streamline processes, reduce operational costs, and support informed decision-making across all departments.
Job Functions and Responsibilities Cloud Data Engineering & Integration: - Design and implement data pipelines across AWS, Azure, and Google Cloud. - Develop SAP BTP integrations with cloud and on-premise systems. - Ensure seamless data movement and storage between cloud platforms.
ETL & Data Pipeline Development: - Develop and optimize ETL workflows using Pentaho and Microsoft ADF /or equivalent ETL tools. - Design scalable and efficient data transformation, movement, and ingestion processes. - Monitor and troubleshoot ETL jobs to ensure high availability and performance.
API Development & Data Integration: - Develop and integrate RESTful APIs to support data exchange between SAP and other platforms. - Work with API gateways and authentication methods like OAuth, JWT, API keys. - Implement API-based data extractions and real-time event-driven architectures.
Data Analysis & SQL Development: - Write and optimize SQL queries, stored procedures, and scripts for data analysis, reporting, and integration. - Perform data profiling, validation, and reconciliation to ensure data accuracy and consistency. - Support data transformation logic and business rules for ERP reporting needs.
Data Governance & Quality (Ataccama, Collibra): - Work with Ataccama and Collibra to define and enforce data quality and governance policies. - Implement data lineage, metadata management, and compliance tracking across systems. - Ensure compliance with enterprise data security and governance standards.
Cloud & DevOps (AWS, Azure, GCP): - Utilize Azure DevOps and GitHub for version control, CI/CD, and deployment automation. - Deploy and manage data pipelines on AWS, Azure, and Google Cloud. - Work with serverless computing (Lambda, Azure Functions, Google Cloud Functions) to automate data workflows.
Collaboration & Documentation: - Collaborate with SAP functional teams, business analysts, and data architects to understand integration requirements. - Document ETL workflows, API specifications, data models, and governance policies. - Provide technical support and troubleshooting for data pipelines and integrations.
**Only those lawfully authorized to work in the designated country associated with the position will be considered.**
**Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client's business needs and requirements.**
Benefits: For information and details on employment benefits offered with this position, please visit here . Should you have any questions/concerns, please contact our HR Department via our secure website .
California Pay Equity: For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here .
Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.
If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department .
Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).
Education: - Bachelor's or Master's degree in a relevant field like Computer science, Data Engineering or related technical field.
Preferred certifications: - Azure Data Engineer associate - SAP Certified Associate - Integration Developer
Required Skills & Experience: - 7+ years of experience in Data Engineering, ETL, and SQL development. - Hands-on experience with SAP BTP Integration Suite for SAP and non-SAP integrations. - Strong expertise in Pentaho (PDI), Microsoft ADF, and API development. - Proficiency in SQL (stored procedures, query optimization, performance tuning). - Experience working with Azure DevOps, GitHub, and CI/CD for data pipelines. - Good understanding of data governance tools (Ataccama, Collibra) and data quality management. - Experience working with AWS, Azure, and Google Cloud (GCP) for data integration and cloud-based workflows. - Strong problem-solving skills and ability to work independently in a fast-paced environment.
Preferred Qualifications: - Experience working on SAP S/4HANA and cloud-based ERP implementations. - Familiarity with Python, PySpark for data processing and automation. - Experience working on Pentaho, Microsoft ADF/or equivalent ETL tools - Knowledge of event-driven architectures - Familiarity with CI/CD for data pipelines (Azure DevOps, GitHub Actions, etc.).
Project Overview Client current on-premises Enterprise Resource Planning (ERP) system, SAP ECC 6.0, has been in use for over a decade and is nearing technological obsolescence resulting in Client requirement to select and implement a new ERP system. The objective for deploying a new ERP system, is to successfully implement a system that integrates all business functions, including finance, operations, and human resources into a cohesive platform. This implementation aims to enhance organizational efficiency, improve data accuracy, and provide real-time reporting capabilities. The goal is to streamline processes, reduce operational costs, and support informed decision-making across all departments.
Job Functions and Responsibilities Cloud Data Engineering & Integration: - Design and implement data pipelines across AWS, Azure, and Google Cloud. - Develop SAP BTP integrations with cloud and on-premise systems. - Ensure seamless data movement and storage between cloud platforms.
ETL & Data Pipeline Development: - Develop and optimize ETL workflows using Pentaho and Microsoft ADF /or equivalent ETL tools. - Design scalable and efficient data transformation, movement, and ingestion processes. - Monitor and troubleshoot ETL jobs to ensure high availability and performance.
API Development & Data Integration: - Develop and integrate RESTful APIs to support data exchange between SAP and other platforms. - Work with API gateways and authentication methods like OAuth, JWT, API keys. - Implement API-based data extractions and real-time event-driven architectures.
Data Analysis & SQL Development: - Write and optimize SQL queries, stored procedures, and scripts for data analysis, reporting, and integration. - Perform data profiling, validation, and reconciliation to ensure data accuracy and consistency. - Support data transformation logic and business rules for ERP reporting needs.
Data Governance & Quality (Ataccama, Collibra): - Work with Ataccama and Collibra to define and enforce data quality and governance policies. - Implement data lineage, metadata management, and compliance tracking across systems. - Ensure compliance with enterprise data security and governance standards.
Cloud & DevOps (AWS, Azure, GCP): - Utilize Azure DevOps and GitHub for version control, CI/CD, and deployment automation. - Deploy and manage data pipelines on AWS, Azure, and Google Cloud. - Work with serverless computing (Lambda, Azure Functions, Google Cloud Functions) to automate data workflows.
Collaboration & Documentation: - Collaborate with SAP functional teams, business analysts, and data architects to understand integration requirements. - Document ETL workflows, API specifications, data models, and governance policies. - Provide technical support and troubleshooting for data pipelines and integrations.
**Only those lawfully authorized to work in the designated country associated with the position will be considered.**
**Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client's business needs and requirements.**
Benefits: For information and details on employment benefits offered with this position, please visit here . Should you have any questions/concerns, please contact our HR Department via our secure website .
California Pay Equity: For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here .
Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.
If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department .
Rose International has an official agreement (ID #132522), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).