Sr GCP Data Engineer with Scala & Spark

Senior GCP Data Engineer with Scala & Spark] Sunnyvale, CA (Hybrid 3 Days onsite ) Long Term Mandatory Areas Must Have Skills - Hadoop- 8+ Yrs of Exp Spark - 8+ Yrs of Exp- Scala - 8+ Yrs of Exp GCP - 5+ Yrs of Exp ETL Process / Data Pipeline experience -8+ Yrs of Exp - Must Have Skills - •2+ years of recent GCP experience GCP Dataproc, GCS & BIGQuery experience 5+ years of hands-on experience Hadoop, Hive or Spark, Airflow or a workflow orchestration Python Java Scala GCP Experience •2+ years of recent GCP experience •Experience building data pipelines in GCP •GCP Dataproc, GCS & BIGQuery experience •5+ years of hands-on experience with developing data warehouse solutions and data products. •5+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required •2+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms. •Experience with programming languages: Python, Java, Scala, etc. •Experience with scripting languages: Perl, Shell, etc. •Practice working with, processing, and managing large data sets (multi TB/PB scale). •Exposure to test driven development and automated testing frameworks. •Background in Scrum/Agile development methodologies. •Capable of delivering on multiple competing priorities with little supervision. •Excellent verbal and written communication skills. •Bachelor's Degree in computer science or equivalent experience. The most successful candidates will also have experience in the following: •Gitflow •Atlassian products - BitBucket, JIRA, Confluence etc. •Continuous Integration tools such as Bamboo, Jenkins, or TFS - Thanks & Regards Sridhar Lead Recruiter O: (919) 234 7515 E: sridhar@torquetek.com