Resource 1, Inc.
Sr. Data Engineer - PERM - MUST BE LOCAL (Naperville)
Resource 1, Inc., Naperville, Illinois, United States, 60564
Resource 1 is in need of a Sr. Data Engineer for a full-time/ permanent position with our client in
Naperville, IL . Candidate
must be
local to Illinois
because of future hybrid onsite in Naperville expected. Our client is an employee-owned company with excellent benefits, growth opportunities and profit-sharing bonus.
This position is focused on building modern data pipelines, integrations and back-end data solutions. Selected individual will work within cross-functional Agile teams, collaborating with product owners, business analysts and other engineers to design and deliver data solutions that power business insights and AI products.
Responsibilities:
Design and develop scalable
data pipelines
for ingestion, transformation and integration using
AWS services. Pull data from PostgreSQL and SQL Server to
migrate to
AWS. Create and modify jobs in AWS and modify logic in SQL Server. Create
SQL
queries, stored procedures and functions in
PostgreSQL
and
RedShift. Provide input on data modeling and schema design as needed. Manage infrastructure through infrastructure-as-code templates ( Serverless Framework ), supporting new data products and services in
AWS. Support inbound/ outbound data flows, including APIs,
S3 replication and secured data. Assist with data visualization/ reporting as needed. Follow an Agile development methodology, with regular workshops and standup meetings, working in two-week sprints.
Qualifications:
5+ years of data engineering experience. Experience with
AWS
and its associated array of offerings ( Glue, Redshift, Athena, S3, Lambda, Spectrum ). Strong experience with
SQL, Python and PySpark. A background in supply chain, logistics or distribution would be a plus. Experience with Power BI is a plus.
Naperville, IL . Candidate
must be
local to Illinois
because of future hybrid onsite in Naperville expected. Our client is an employee-owned company with excellent benefits, growth opportunities and profit-sharing bonus.
This position is focused on building modern data pipelines, integrations and back-end data solutions. Selected individual will work within cross-functional Agile teams, collaborating with product owners, business analysts and other engineers to design and deliver data solutions that power business insights and AI products.
Responsibilities:
Design and develop scalable
data pipelines
for ingestion, transformation and integration using
AWS services. Pull data from PostgreSQL and SQL Server to
migrate to
AWS. Create and modify jobs in AWS and modify logic in SQL Server. Create
SQL
queries, stored procedures and functions in
PostgreSQL
and
RedShift. Provide input on data modeling and schema design as needed. Manage infrastructure through infrastructure-as-code templates ( Serverless Framework ), supporting new data products and services in
AWS. Support inbound/ outbound data flows, including APIs,
S3 replication and secured data. Assist with data visualization/ reporting as needed. Follow an Agile development methodology, with regular workshops and standup meetings, working in two-week sprints.
Qualifications:
5+ years of data engineering experience. Experience with
AWS
and its associated array of offerings ( Glue, Redshift, Athena, S3, Lambda, Spectrum ). Strong experience with
SQL, Python and PySpark. A background in supply chain, logistics or distribution would be a plus. Experience with Power BI is a plus.