Data Engineer

Data Engineer Role:

Data Engineer (6 months W2 only)

Location:

NYC NY (3 days onsite per week) - F2F interview

Core Requirement:

Horizon Core Banking knowledge is essential; experience with core banking systems required

Technical Skills

Proficient in Python (read and write)

Strong experience with Databricks for building scalable data pipelines

Data processing tools: SQL, Python, Spark

Experience with Azure and cloud integrations with Databricks

Knowledge of ETL tools and data architecture principles

Data Focus

Strong understanding of data quality, data cleansing, transformation, and aggregation

Ensures data integrity, security and compliance with regulations

Collaboration & Communication

Works closely with data scientists, analysts and business stakeholders to deliver data solutions

Effective communicator and team player

Responsibilities

Design, develop and maintain scalable data pipelines and architectures

Implement data management best practices for storage, retrieval and performance optimization

Monitor, troubleshoot and document data processes

Stay updated on latest data engineering and Databricks advancements

Perform other related duties as assigned

Qualifications

Bachelor's degree in CS, IT, Engineering or related field (or equivalent experience)

3 years experience as a Data Engineer with proven Databricks expertise

Strong problem-solving and multitasking abilities

Key Skills

Apache Hive

S3

Hadoop

Redshift

Spark

AWS

Apache Pig

NoSQL

Big Data

Data Warehouse

Kafka

Scala

Employment Type Full Time

Experience Years

Vacancy 1

#J-18808-Ljbffr