Logo
1872 Consulting

Senior Azure Data Engineer

1872 Consulting, Chicago, Illinois, United States

Save Job

Location:

Chicago, IL (Hybrid – 3 days onsite in the Loop, 2 days WFH)

Salary:

Up to $165K base + 15% annual bonus

We’re seeking a

Senior Azure Data Engineer

to design, build, and optimize data pipelines in an

Azure/Snowflake

environment using

Databricks, ADLS, Snowflake, and Python . You’ll join a growing analytics team of six and serve as one of the most senior engineers helping power our industry-leading real estate analytics platform.

Responsibilities

Design, develop, and maintain data pipelines using

Databricks

for large-scale datasets.

Write efficient, reusable

SQL

and

Python

code for ingestion, transformation, and integration.

Optimize workflows for performance, reliability, and cost-efficiency in the cloud.

Collaborate with data scientists, analysts, and business stakeholders.

Implement data governance, security, and compliance best practices.

Monitor and troubleshoot data pipelines to ensure high availability and integrity.

Leverage

Databricks

for advanced analytics, ML workflows, and real-time processing.

Integrate data from APIs, databases, blob storage, SFTP, and streaming sources.

Mentor junior data engineers and share best practices.

Drive performance tuning and optimization across the data platform.

Qualifications

5+ years of

Data Engineering

experience

2+ years working in

Azure environments

Strong

Python

and

Databricks

experience (required)

Advanced

SQL

skills

Hands-on

ELT

and

Bronze/Silver/Gold

transformation experience

Nice to Have

Snowflake

and

Azure Data Lake Storage (ADLS)

experience

Familiarity with

data modeling

(dimensions, measures, slowly changing dimensions)

Knowledge of

Inmon vs Kimball

(Star Schema vs 3NF)

Experience with

Delta Live Tables, Spark, DuckDB , or

Durable Functions

Experience with

Parquet, Delta Lake, or Iceberg

formats

Bachelor’s or Master’s in

Computer Science

or related field

Azure certifications

are a plus

Seniority Level Mid-Senior level

Employment Type Full-time

Job Function Information Technology

Referrals increase your chances of interviewing at 1872 Consulting by 2x

#J-18808-Ljbffr