Revel IT
OUR GOAL:Treat our consultants and clients the way we would like others to treat us!Interested in joining our team? Check out the opportunity below and apply today!
The
Data Engineer
in this contract-to-hire role will implement and maintain key data pipelines, focusing on data ingestion, replication, and continuous integration for batch and streaming data. This position will leverage their proficiency in programming, ETL processes, and cloud data technologies to develop, maintain, test, and deploy scalable data pipelines while ensuring data quality and reliability.
This role will focus on building robust, maintainable, accessible, cost effective, and observable data pipelines between source systems and our Snowflake data lake. On-site: 3 days week (typically Tue-Thu) in Columbus, Ohio Qualifications:
Bachelor's Degree in computer science, engineering, analytics, or related field. 1-3 years hands on experience in a data engineering or related role. Knowledge, Skills, Abilities (Proficiency) High Proficiency:
Proficiency with at least one cloud based ELT technology (Fivetran, AWS Kinesis, Snowpipe, Airbyte) Experience building and operating highly available, self healing systems for data extraction, ingestion, and continuous integration and deployment. Experience with cloud-based data warehousing and data lake solutions like Snowflake, Redshift, and BigQuery Familiarity with one or more DevOps tools (Git, Jenkins, CI/CD, Jira) Medium Proficiency:
Proficiency in at least one general purpose interpreted programming language (Python preferred) Ability to think strategically and provide recommendations utilizing modern cloud architectural components based on business needs with a focus on simplicity and maintainability. Experience building data pipelines to ingest data from systems built on legacy technologies (IBM VSAM) into modern cloud-based data lake tooling (Snowflake). Ability to orchestrate complex workflows using tools like Airflow or Dagster Medium Expertise with SQL, database design/structure, and data structures (star, snowflake schemas, de-normalized designs). Experience with script-based data transformation tools (e.g., dbt, Talend) and version control tools. Desire and ability to collaborate with cross-functional teams of software engineers, product managers, and business stakeholders. Responsibilities: Essential Functions (% time):
Build scalable ETL pipelines to automate data ingestion, for both batch and streaming data processes, into a centralized data lake in Snowflake. Leverage some off-the-shelf connectors and some custom python solutions to deliver these pipelines (20%.) Develop and deploy orchestration solutions to facilitate near real time data availability for strategically important data sets (20%.) Enhance monitoring and alerting systems to proactively identify and resolve issues, minimizing downtime and ensuring data consistency, resiliency, and availability (20%.) Build security and access controls into data pipelines to enable granular Role Based access to enterprise data, including security at row and column levels (15%.) Partner with Software Engineering teams to understand their development roadmap and ensure that data pipelines are maintained and prepared for any schema or business logic changes (15%). Provide support to Analytics Engineers tasked with transforming and interpreting raw source system data into dimensional models (10%.)
Reference: 1039356
Don't meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they meet every qualification. At Revel IT, we are dedicated to building a diverse, inclusive, and authentic workplace, so if you're excited about this role, but your experience doesn't align perfectly with every qualification in the description, we encourage you to apply anyway. You might be the right candidate for this or our other open roles!
Revel IT is an Equal Opportunity Employer. Revel IT does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
#gdr4900
The
Data Engineer
in this contract-to-hire role will implement and maintain key data pipelines, focusing on data ingestion, replication, and continuous integration for batch and streaming data. This position will leverage their proficiency in programming, ETL processes, and cloud data technologies to develop, maintain, test, and deploy scalable data pipelines while ensuring data quality and reliability.
This role will focus on building robust, maintainable, accessible, cost effective, and observable data pipelines between source systems and our Snowflake data lake. On-site: 3 days week (typically Tue-Thu) in Columbus, Ohio Qualifications:
Bachelor's Degree in computer science, engineering, analytics, or related field. 1-3 years hands on experience in a data engineering or related role. Knowledge, Skills, Abilities (Proficiency) High Proficiency:
Proficiency with at least one cloud based ELT technology (Fivetran, AWS Kinesis, Snowpipe, Airbyte) Experience building and operating highly available, self healing systems for data extraction, ingestion, and continuous integration and deployment. Experience with cloud-based data warehousing and data lake solutions like Snowflake, Redshift, and BigQuery Familiarity with one or more DevOps tools (Git, Jenkins, CI/CD, Jira) Medium Proficiency:
Proficiency in at least one general purpose interpreted programming language (Python preferred) Ability to think strategically and provide recommendations utilizing modern cloud architectural components based on business needs with a focus on simplicity and maintainability. Experience building data pipelines to ingest data from systems built on legacy technologies (IBM VSAM) into modern cloud-based data lake tooling (Snowflake). Ability to orchestrate complex workflows using tools like Airflow or Dagster Medium Expertise with SQL, database design/structure, and data structures (star, snowflake schemas, de-normalized designs). Experience with script-based data transformation tools (e.g., dbt, Talend) and version control tools. Desire and ability to collaborate with cross-functional teams of software engineers, product managers, and business stakeholders. Responsibilities: Essential Functions (% time):
Build scalable ETL pipelines to automate data ingestion, for both batch and streaming data processes, into a centralized data lake in Snowflake. Leverage some off-the-shelf connectors and some custom python solutions to deliver these pipelines (20%.) Develop and deploy orchestration solutions to facilitate near real time data availability for strategically important data sets (20%.) Enhance monitoring and alerting systems to proactively identify and resolve issues, minimizing downtime and ensuring data consistency, resiliency, and availability (20%.) Build security and access controls into data pipelines to enable granular Role Based access to enterprise data, including security at row and column levels (15%.) Partner with Software Engineering teams to understand their development roadmap and ensure that data pipelines are maintained and prepared for any schema or business logic changes (15%). Provide support to Analytics Engineers tasked with transforming and interpreting raw source system data into dimensional models (10%.)
Reference: 1039356
Don't meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they meet every qualification. At Revel IT, we are dedicated to building a diverse, inclusive, and authentic workplace, so if you're excited about this role, but your experience doesn't align perfectly with every qualification in the description, we encourage you to apply anyway. You might be the right candidate for this or our other open roles!
Revel IT is an Equal Opportunity Employer. Revel IT does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
#gdr4900