KPG99 INC
Overview
We are seeking an experienced Data Engineering Manager to lead a hybrid team of onshore and offshore developers while remaining hands-on with modern data engineering tools and practices. The role will involve designing and implementing cloud-based data pipelines, modernizing legacy ETL processes, and collaborating closely with business and data science teams.
Responsibilities
- Design, implement, and manage modern data pipelines using Snowflake, DBT, Apache Airflow, and Azure Data Pipelines .
- Lead migration and modernization of legacy ETL processes (Informatica PowerCenter) to scalable cloud-based architectures.
- Integrate diverse data sources, including on-prem and cloud databases, APIs, XML feeds, and third-party systems.
- Collaborate with business stakeholders to translate requirements into efficient, well-architected data solutions.
- Develop and maintain dimensional models and robust data transformation logic aligned with business definitions.
- Lead and mentor a team of up to 4 offshore/onshore developers: assign tasks, validate deliverables, provide technical guidance, and support on-call as required.
- Maintain detailed technical documentation and contribute to architectural roadmaps.
Required Qualifications
- 5+ years of experience in data engineering or data warehousing environments.
- Strong hands-on experience with Snowflake (data modeling, optimization, performance tuning).
- Strong hands-on experience with DBT (Data Build Tool) for transformations and data testing.
- Strong hands-on experience with Apache Airflow for orchestration.
- Strong hands-on experience with Azure Data Factory / Azure DevOps Pipelines for CI/CD and integration.
- Experience with Informatica PowerCenter and migrating ETL workloads to cloud platforms.
- Bachelor’s degree in Computer Science, Information Systems, or related field.
- Prior experience leading or managing a technical team (onshore/offshore).
Preferred Qualifications
- Cloud platform experience with Azure (preferred), AWS, or GCP.
- Exposure to big data tools (Spark, Kafka, Delta Lake) and predictive analytics workflows.
- Experience working with a data science team.
- Familiarity with CI/CD and version control tools (Git, Azure Repos, etc.).
- Prior experience with Adobe Campaign or other digital marketing platforms.
Seniority level
- Mid-Senior level
Employment type
- Contract
Job function
- Information Technology
Industries
- IT Services and IT Consulting