Purple Drive Technologies LLC
Overview
This is a 6-month contract role in Atlanta, GA. We are looking for a Senior Data Engineer with hands-on experience in Google Cloud Platform (GCP) resources such as BigQuery, Dataflow, PubSub, Cloud Composer, Cloud Run (native), and Cloud Storage (GCS). Knowledge and setup of Data Transformation and integration using Data Build Tool (DBT) is also a requirement to support, scheduling, and analytics flows in the GCP environment. Responsibilities
Liaison with client teams from multiple geographies to clarify requirements and obtain stakeholder buy-in. Setup appropriate data models for requirements and design data pipelines for implementation. Provide necessary documentation to support development teams. Design and implement data pipelines in GCP for ingesting and transforming data from SAP and AS400 systems to BigQuery using GCP native resources and DBT. Optimize ETL/ELT workflows for performance and scalability. Implement data quality checks, schema validation, and error handling. Support batch and near-real-time data flows for operational and analytics use cases. Demonstrate strong experience with GCP (BigQuery, Dataflow, Cloud Composer, Cloud Run (native), and Cloud Storage (GCS)). Proficiency in SQL and data analysis. Experience with PubSub. Familiarity with data governance and security best practices. Ability to work with large datasets and optimize for performance. Familiarity with CI/CD (GitHub and Terraform preferred). Knowledge of JSON and XML. Data modeling concepts and data pipeline design. Company Description
Founded in 2007, Purple Drive started as a tech solutions firm and grew into a full-service consulting and talent partner, helping businesses navigate complex technology challenges and access top expertise. Purple Drive was founded to deliver smarter technology solutions by combining deep expertise with an authentic human connection.
#J-18808-Ljbffr
This is a 6-month contract role in Atlanta, GA. We are looking for a Senior Data Engineer with hands-on experience in Google Cloud Platform (GCP) resources such as BigQuery, Dataflow, PubSub, Cloud Composer, Cloud Run (native), and Cloud Storage (GCS). Knowledge and setup of Data Transformation and integration using Data Build Tool (DBT) is also a requirement to support, scheduling, and analytics flows in the GCP environment. Responsibilities
Liaison with client teams from multiple geographies to clarify requirements and obtain stakeholder buy-in. Setup appropriate data models for requirements and design data pipelines for implementation. Provide necessary documentation to support development teams. Design and implement data pipelines in GCP for ingesting and transforming data from SAP and AS400 systems to BigQuery using GCP native resources and DBT. Optimize ETL/ELT workflows for performance and scalability. Implement data quality checks, schema validation, and error handling. Support batch and near-real-time data flows for operational and analytics use cases. Demonstrate strong experience with GCP (BigQuery, Dataflow, Cloud Composer, Cloud Run (native), and Cloud Storage (GCS)). Proficiency in SQL and data analysis. Experience with PubSub. Familiarity with data governance and security best practices. Ability to work with large datasets and optimize for performance. Familiarity with CI/CD (GitHub and Terraform preferred). Knowledge of JSON and XML. Data modeling concepts and data pipeline design. Company Description
Founded in 2007, Purple Drive started as a tech solutions firm and grew into a full-service consulting and talent partner, helping businesses navigate complex technology challenges and access top expertise. Purple Drive was founded to deliver smarter technology solutions by combining deep expertise with an authentic human connection.
#J-18808-Ljbffr