Logo
NJF Global Holdings Ltd

Lead Data Engineer - Petabyte Scale - Delta Lake / Lakehouse

NJF Global Holdings Ltd, Chicago, Illinois, United States

Save Job

Principal Technology & Quant Finance Associate Lead Data Engineer / Architect - Quant Trading - Lakehouse Architecture - Chicago (Onsite)

My client is looking to hire a Lead Data Engineer to report into the Global Head of Data of a global quant trading firm. They are looking for a Tech Lead / Architect who will work 70/30% (hands‑on/managerial).

You will need to have worked at petabyte scale, strong Databricks experience (beyond migrations etc), Delta Lake, Spark and Python. This will include onboarding teams, user bases, communicating with leadership, etc.

As a critical engineering presence in Chicago, you'll directly influence local data strategy while collaborating with their Global Research and Data Platform teams.

Who you are:

5+ years of hands‑on experience in data engineering, delivering robust pipelines at scale

Proven leadership experience, building products from 0‑1

Advanced Python skills and deep experience with Apache Spark and the Databricks platform

Familiarity with Delta Lake, streaming data systems (e.g., Kafka), and distributed compute environments

Solid understanding of cloud‑native data architectures (preferably AWS) and infrastructure cost optimization principles

Proficiency in relational databases (e.g., PostgreSQL) and modern orchestration tools

If you’re ready to have an immediate impact on the data systems powering world‑class research & real‑time trading systems while shaping their Lakehouse architecture, please send your latest resume and I’ll endeavor to get in touch.

Employment details

Seniority level: Mid‑Senior level

Employment type: Full‑time

Job function: Information Technology and Finance

Industries: Financial Services, Capital Markets, and Investment Banking

Benefits

Medical insurance

Vision insurance

401(k)

Disability insurance

Location Chicago, IL – Greater Chicago Area

#J-18808-Ljbffr