Logo
TechDigital Group

GCP Architect

TechDigital Group, Secaucus, New Jersey, us, 07094

Save Job

General Description 8+ years of experience in Data Engineering or L3 level support in data Analytics Experience with Data Lake, data warehouse ETL pipeline development and design Hands-on experience with GCP data and analytics services such as Cloud DataProc, Cloud Dataflow, Cloud Dataprep, Apache Beam/Composer, Cloud BigQuery Data Pipeline Development: Design, develop, and maintain ETL/ELT pipelines for seamless data flow using DBT or GCP BigQuery Data Modelling: Implement and manage data models in BigQuery to support analytics and reporting Version Control: Use GIT for managing changes in data pipelines, schemas, and code Strong coding skills in SQL, Python, or Java Technical Requirements Create and support data models and implement ETL processes based on business needs Monitor data quality to ensure accuracy and availability for stakeholders Maintain company data lake (UDP) and regional platforms data streaming from Apache Kafka Develop scalable data pipelines and API integrations for increasing data volumes Collaborate with analytics and business teams to enhance data models for BI tools Write unit/integration tests, document work, and contribute to engineering wiki Troubleshoot data issues through analysis Work with frontend/backend engineers, product managers, and analysts Design data integrations and data quality frameworks Evaluate open source and vendor tools for data lineage Develop long-term data platform strategies in collaboration with business units Plan and maintain data architectures aligned with business needs Support digital projects by understanding solutions and data structures Create reports, dashboards, and datasets for business users Maintain existing reports and dashboards Soft Skills Excellent communication and presentation skills Problem-solving and critical thinking abilities Project management and organizational skills Team collaboration and leadership Market awareness and client focus Certifications (Optional) Google Professional Data Engineer Google Professional Data Architect Educational Qualifications Bachelor's Degree in Computer Science, Computer Engineering, or related field #J-18808-Ljbffr