Resource Informatics Group
Data Engineer
Resource Informatics Group - Irving, Texas, United States, 75084
Work at Resource Informatics Group
Overview
- View job
Overview
Role : Data Engineer
Location: Hybrid onsite in Chicago, IL
Skill sets:
MUST HAVE
AWS (s3, redshift, EMR, EC2, lambda, SNS), unix shell scripting, python spark scala
PREFER TO HAVE
Any fullstack API Microservices
Project/ day to day:
Day to day- modernization of the data engineering platform
Run on Ab Initio and moving to sunset by end of this year Converting those jobs into cloud- AWS jobs and written in python/ scala and run on spark and emr AR flow for production support- apache airflow system (new learning for data engineers) FUTURE- goal is to take this team to the next level... Will start working on together things like data analytics and machine learning o Expanding horizon and involve in machine learning and data analytics
Training- new engineers will have 8-10 weeks of overlap with the existing contractors to transfer the knowledge
Location: Hybrid onsite in Chicago, IL
Skill sets:
MUST HAVE
AWS (s3, redshift, EMR, EC2, lambda, SNS), unix shell scripting, python spark scala
PREFER TO HAVE
Any fullstack API Microservices
Project/ day to day:
Day to day- modernization of the data engineering platform
Run on Ab Initio and moving to sunset by end of this year Converting those jobs into cloud- AWS jobs and written in python/ scala and run on spark and emr AR flow for production support- apache airflow system (new learning for data engineers) FUTURE- goal is to take this team to the next level... Will start working on together things like data analytics and machine learning o Expanding horizon and involve in machine learning and data analytics
Training- new engineers will have 8-10 weeks of overlap with the existing contractors to transfer the knowledge