eTeam
Overall 10+ years in lead data engineer role
7+ Experience in shell script, Scala, Python is must
5+ years of experience with AWS & Snowflake
5+ Extensive knowledge in AWS , IAM, Cloudwatch, S3, AWS lambda, Airflow, AWS EMR, Snowflake, Python
Demonstrable Experience in designing and implementing modern data warehouse/data lake solution with understanding of best practices
Proficiency in writing complex SQL statements using SnowSQL and RDBMS standards
Good to have Design and implement high profile data ingestion pipelines from various sources using Java, Spark and hadoop technologies
Good to have experience in cloudera, CDP hadoop distribution
Good to have experience in troubleshooting in spark and hadoop