Logo
The Planet Group

Lead Data Engineer - Databricks

The Planet Group, Irving, Texas, United States, 75084

Save Job

Lead Data Engineer Duration

6 months Contract to Hire

Location

3 days hybrid in Irving, TX

Rate

70-81/hour W2

Eligibility

USC/GC/H4EAD and GC EAD candidates only – client will not sponsor/transfer H1B

Key Responsibilities

Lead the design, development, and delivery of enterprise‑scale data engineering solutions.

Drive architecture across Databricks, Azure Data Factory, SQL, and data lake/delta lake environments.

Build and optimize ETL pipelines and data models to support analytics and reporting.

Implement CI/CD and Infrastructure as Code (Terraform/Pulumi) for deployment automation.

Mentor engineers, enforce coding standards, and promote best practices.

Collaborate cross‑functionally to ensure performance, reliability, and data integrity.

Qualifications

8+ years of professional data engineering experience with proven technical leadership.

Deep expertise in Azure ecosystem (Databricks, ADF, Key Vault, SQL, ADLS Gen2).

Strong skills in SQL, Python, and PySpark for data ingestion, transformation, and curation.

Experience designing data/delta lake and medallion architectures.

Hands‑on experience building scalable ETL pipelines and handling large data volumes.

Proficiency with CI/CD and IaC tools (Terraform, Pulumi).

Familiarity with Power BI/Tableau and Agile development practices.

Success in This Role You’ll be the go‑to technical leader for data design and performance across Azure and Databricks, guiding teams toward scalable, efficient solutions and a trusted analytics platform.

Job Details

Seniority level: Mid‑Senior level

Employment type: Contract

Job function: Engineering and Information Technology

#J-18808-Ljbffr