Logo
TechDigital Group

Lead Data Engineer

TechDigital Group, Chicago, Illinois, United States, 60290

Save Job

Job #: 406 Pay Rate: Not Specified Job type: contractor Location: Chicago, IL

Must have skill:

Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL/ELT

Job Description: Responsibilities:

Lead data warehouse development activities for a team, leading more than one project in parallel. Assign data warehouse development tasks to a team of 1-6 developers (Onsite/Offshore). Be a subject-matter expert (SME) in Data Warehouse domain and relevant business function. Work with minimal supervision and provide status updates and escalation to leadership as appropriate. Provide application support as part of an on-call rotation to work on resolving outages and user questions. Review project objectives and determine best technology to apply. Design and build large scale datasets for a wide range of consumer needs. Build, test, and implement highly efficient data pipelines using a variety of technologies. Develop best practice standards for solution design and data structures. Analyze new data sources to understand quality, availability, and content. Write technical design documentation. Conduct peer code reviews. Create and execute unit tests. Support QA team during testing. Mentor less experienced members of the development team.

Required Skills: 6-8 years+ experience on

Snowflake SQL – advanced SQL expertise 6-8 years+ experience on

data warehouse experiences

– hands-on knowledge with the methods to identify, collect, manipulate, transform, normalize, clean, and validate data, star schema, normalization/denormalization, dimensions, aggregations etc. 6-8 years+ experience working in reporting and analytics environments – development, data profiling, metric development, CICD, production deployment, troubleshooting, query tuning, Atlassian Bitbucket and Bamboo, etc. 6 years+ on

Python – advanced Python expertise 6 years+ on any cloud platform –

AWS preferred Hands-on experience on

AWS on Lambda , S3, SNS/SQS, EC2 is a bare minimum. 6 years+ on any

ETL/ELT tool

– Informatica, Fivetran, DBT, Airflow etc. - Must 6 years+ with developing functional metrics in any specific business.

#J-18808-Ljbffr