HonorVet Technologies
Title: GCP Data Engineer
Location: Hybrid in Richardson, TX 75081 (3-4 times a week)
Duration: 04+ months
Required: GCP and Pyspark
Job Description
Experience with GCP services such as Compute Engine, Data Proc, Kubernetes Engine, Cloud Storage, BigQuery, PUB/SUB, Cloud Functions and Dataflow. Cloud Composer, ETL experience - working with large data sets, PySpark, Python, Spark SQL, Data Frames, PyTest Develop and implement proactive monitoring and alert mechanism for data issues. Familiarity with CI/CD pipelines and automation tools such as Jenkins, GitHub & GitHub actions. ble to write complex SQL queries for business results computation Develop architecture recommendations based on GCP best practices and industry standards. Work through all stages of a data solution life cycle: analyze/profile data, create conceptual, logical & physical data model designs, architect and design ETL, reporting, and analytics solutions. Conduct technical reviews and ensure that GCP solutions meet functional and non-functional requirements. Strong knowledge of GCP architecture and design patterns.
Required: GCP and Pyspark
Job Description
Experience with GCP services such as Compute Engine, Data Proc, Kubernetes Engine, Cloud Storage, BigQuery, PUB/SUB, Cloud Functions and Dataflow. Cloud Composer, ETL experience - working with large data sets, PySpark, Python, Spark SQL, Data Frames, PyTest Develop and implement proactive monitoring and alert mechanism for data issues. Familiarity with CI/CD pipelines and automation tools such as Jenkins, GitHub & GitHub actions. ble to write complex SQL queries for business results computation Develop architecture recommendations based on GCP best practices and industry standards. Work through all stages of a data solution life cycle: analyze/profile data, create conceptual, logical & physical data model designs, architect and design ETL, reporting, and analytics solutions. Conduct technical reviews and ensure that GCP solutions meet functional and non-functional requirements. Strong knowledge of GCP architecture and design patterns.