Purple Drive Technologies LLC
Senior Data Engineer – Google Cloud Platform
Purple Drive Technologies LLC, Issaquah, Washington, United States, 98027
Overview
We are looking for a Senior Data Engineer with hands on experience in Google Cloud platform (GCP) resources such as BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Run (native) and Cloud Storage (GCS). Knowledge and setting up of Data Transformation and integration using Data Build Tool (DBT) is also a requirement to support, scheduling, and analytics flows in the Google Cloud Platform environment. Responsibilities
Coordinate with multiple offsite client teams to gather requirements in initial phase and provide hands-on technical support during offshore hours. Liaison with client teams from multiple geographies to clarify requirements and get stakeholder buy-in. Setup appropriate Data Model for requirements and design data pipelines for implementation. Provide necessary documentation to support development teams. Design and implement data pipelines in Google Cloud Platform for ingesting and transforming data from SAP and AS400 systems to BigQuery using Google Cloud Platform native resources and DBT. Optimize ETLELT workflows for performance and scalability. Implement data quality checks, schema validation, and error handling. Support batch and near-real-time data flows for operational and analytics use cases. Strong experience with Google Cloud Platform (BigQuery, Dataflow, Cloud Composer, Cloud Run (native) and Cloud Storage (GCS). Proficiency in SQL and data analysis. Experience with Pub/Sub. Familiarity with data governance and security best practices. Ability to work with large datasets and optimize for performance. Familiarity with CICD (Github and Terraform preferred). Knowledge of JSON, XML. Data Modelling concepts and Data Pipeline design. Qualifications
Strong experience with Google Cloud Platform services including BigQuery, Dataflow, Cloud Composer, Cloud Run and Cloud Storage. Proficiency in SQL and data analysis. Experience with Pub/Sub. Familiarity with data governance and security best practices. Experience with CI/CD tools (GitHub) and Infrastructure as Code (Terraform) preferred. Knowledge of JSON and XML. Data modeling concepts and data pipeline design.
#J-18808-Ljbffr
We are looking for a Senior Data Engineer with hands on experience in Google Cloud platform (GCP) resources such as BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Run (native) and Cloud Storage (GCS). Knowledge and setting up of Data Transformation and integration using Data Build Tool (DBT) is also a requirement to support, scheduling, and analytics flows in the Google Cloud Platform environment. Responsibilities
Coordinate with multiple offsite client teams to gather requirements in initial phase and provide hands-on technical support during offshore hours. Liaison with client teams from multiple geographies to clarify requirements and get stakeholder buy-in. Setup appropriate Data Model for requirements and design data pipelines for implementation. Provide necessary documentation to support development teams. Design and implement data pipelines in Google Cloud Platform for ingesting and transforming data from SAP and AS400 systems to BigQuery using Google Cloud Platform native resources and DBT. Optimize ETLELT workflows for performance and scalability. Implement data quality checks, schema validation, and error handling. Support batch and near-real-time data flows for operational and analytics use cases. Strong experience with Google Cloud Platform (BigQuery, Dataflow, Cloud Composer, Cloud Run (native) and Cloud Storage (GCS). Proficiency in SQL and data analysis. Experience with Pub/Sub. Familiarity with data governance and security best practices. Ability to work with large datasets and optimize for performance. Familiarity with CICD (Github and Terraform preferred). Knowledge of JSON, XML. Data Modelling concepts and Data Pipeline design. Qualifications
Strong experience with Google Cloud Platform services including BigQuery, Dataflow, Cloud Composer, Cloud Run and Cloud Storage. Proficiency in SQL and data analysis. Experience with Pub/Sub. Familiarity with data governance and security best practices. Experience with CI/CD tools (GitHub) and Infrastructure as Code (Terraform) preferred. Knowledge of JSON and XML. Data modeling concepts and data pipeline design.
#J-18808-Ljbffr