Purple Drive LLC
Senior Data Engineer - Google Cloud Platform
Purple Drive LLC, Issaquah, Washington, United States, 98027
Overview
We are looking for a Senior Data Engineer with hands on experience in Google Cloud platform (Google Cloud Platform) resources such as BigQuery, Dataflow, PubSub, Cloud Composer, Cloud Run (native) and Cloud Storage (GCS). Knowledge and setting up of Data Transformation and integration using Data Build Tool (DBT) is also a requirement to support, scheduling, and analytics flows in the Google Cloud Platform environment. Responsibilities
Coordinate with multiple offsite client teams to gather requirements in the initial phase and provide hands-on technical support during offshore hours. Liaise with client teams from multiple geographies to clarify requirements and get stakeholder buy-in. Set up appropriate Data Model for requirements and design data pipelines for implementation. Provide necessary documentation to support development teams. Design and implement data pipelines in Google Cloud Platform for ingesting and transforming data from SAP and AS400 systems to BigQuery using Google Cloud Platform native resources and DBT. Optimize ETLELT workflows for performance and scalability. Implement data quality checks, schema validation, and error handling. Support batch and near-real-time data flows for operational and analytics use cases. Strong experience with Google Cloud Platform (BigQuery, Dataflow, Cloud Composer, Cloud Run (native) and Cloud Storage (GCS)). Proficiency in SQL and data analysis. Experience with Pub/Sub. Familiarity with data governance and security best practices. Ability to work with large datasets and optimize for performance. Familiarity with CI/CD (GitHub and Terraform preferred). Knowledge of JSON, XML. Data Modelling concepts and Data Pipeline design. Qualifications
Experience with Google Cloud Platform services cited above (BigQuery, Dataflow, Cloud Composer, Cloud Run native, Cloud Storage). Proficiency in SQL and data analysis. Experience with Pub/Sub and data integration tools (DBT). Understanding of data governance, security best practices, and CI/CD practices (GitHub, Terraform). Ability to work with large datasets and optimize for performance. Knowledge of data modeling concepts and data pipeline design.
#J-18808-Ljbffr
We are looking for a Senior Data Engineer with hands on experience in Google Cloud platform (Google Cloud Platform) resources such as BigQuery, Dataflow, PubSub, Cloud Composer, Cloud Run (native) and Cloud Storage (GCS). Knowledge and setting up of Data Transformation and integration using Data Build Tool (DBT) is also a requirement to support, scheduling, and analytics flows in the Google Cloud Platform environment. Responsibilities
Coordinate with multiple offsite client teams to gather requirements in the initial phase and provide hands-on technical support during offshore hours. Liaise with client teams from multiple geographies to clarify requirements and get stakeholder buy-in. Set up appropriate Data Model for requirements and design data pipelines for implementation. Provide necessary documentation to support development teams. Design and implement data pipelines in Google Cloud Platform for ingesting and transforming data from SAP and AS400 systems to BigQuery using Google Cloud Platform native resources and DBT. Optimize ETLELT workflows for performance and scalability. Implement data quality checks, schema validation, and error handling. Support batch and near-real-time data flows for operational and analytics use cases. Strong experience with Google Cloud Platform (BigQuery, Dataflow, Cloud Composer, Cloud Run (native) and Cloud Storage (GCS)). Proficiency in SQL and data analysis. Experience with Pub/Sub. Familiarity with data governance and security best practices. Ability to work with large datasets and optimize for performance. Familiarity with CI/CD (GitHub and Terraform preferred). Knowledge of JSON, XML. Data Modelling concepts and Data Pipeline design. Qualifications
Experience with Google Cloud Platform services cited above (BigQuery, Dataflow, Cloud Composer, Cloud Run native, Cloud Storage). Proficiency in SQL and data analysis. Experience with Pub/Sub and data integration tools (DBT). Understanding of data governance, security best practices, and CI/CD practices (GitHub, Terraform). Ability to work with large datasets and optimize for performance. Knowledge of data modeling concepts and data pipeline design.
#J-18808-Ljbffr