Logo
STAFFWORXS

Databricks Architect

STAFFWORXS, Detroit, Michigan, United States, 48228

Save Job

4 days ago Be among the first 25 applicants

This range is provided by STAFFWORXS. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range $65.00/hr - $75.00/hr

Direct message the job poster from STAFFWORXS

Delivery Manager @ STAFFWORXS | US IT Recruitment At

Staffworxs , we don’t just connect talent —

we power transformation . Headquartered in Frisco, TX, with teams in Bengaluru and Hyderabad, we combine global reach with deep expertise. Our Digital & Data Analytics practice drives growth and innovation for some of the world’s top CPG brands, who continue to retain us as their trusted partner.

If you’re ready to make an impact, you’re in the right place.

Title:

Databricks Architect

Location:

Detroit, MI (Onsite is a must)

Duration:

Contract

Skills Required:

Databricks, PySpark, Apache Spark, SQL/Spark SQL, Delta Lake, DLT, Unity Catalog, CI/CD (Azure DevOps), ADF/Databricks Workflows, Cloud Integration (AWS/Azure/GCP), Data Governance, Security & Architecture Design

Job Description

We are seeking a highly skilled

Databricks Architect

to lead the design and implementation of scalable, secure, and high-performance data solutions on the Databricks Lakehouse Platform. This role is ideal for a senior data engineering/architecture professional with strong hands‑on expertise in Spark, PySpark, big data ecosystems, and modern data governance frameworks.

Key Responsibilities

Architecture Design:

Lead the end‑to‑end design of scalable solutions on the Databricks Lakehouse Platform, including Delta Lake, DLT pipelines, and Unity Catalog.

Data Engineering Leadership:

Guide teams on best practices for batch and streaming ingestion, Spark optimization (PySpark/Scala), performance tuning, and CI/CD for data pipelines.

Automotive Domain Expertise:

Architect solutions for large‑scale telematics, manufacturing systems, and connected vehicle data.

Cloud Integration:

Manage and optimize Databricks deployments on AWS, Azure, or GCP; integrate with services like S3, ADLS, IAM, etc.

Governance & Security:

Implement fine‑grained access controls, lineage, auditing, and compliance frameworks using Unity Catalog and Delta Lake.

Stakeholder Collaboration:

Work closely with business leaders, data scientists, analysts, and product teams to translate needs into technical roadmaps.

Innovation:

Act as a subject matter expert, recommending emerging technologies and driving innovation in data and AI.

Core Skills & Qualifications

9–15 years of experience in Databricks, Python, Big Data, Apache Spark, SQL, and Spark SQL.

Strong hands‑on experience with

PySpark

and

Apache Spark .

Experience building

Data Governance

solutions using Unity Catalog or similar frameworks.

Expertise in creating orchestration layers using

Databricks Workflows

or

Azure Data Factory (ADF) .

Experience implementing

CI/CD for Databricks

in Azure DevOps.

Ability to process near real‑time data using

Auto Loader

and

DLT pipelines .

Strong understanding of

security layers in Delta Lake .

Ability to implement massive parallel processing using Spark SQL and PySpark.

Proven experience delivering

cost‑effective and optimized Databricks infrastructure .

Staffworxs is an Equal Opportunity Employer.

We celebrate diversity and are committed to creating an inclusive workplace for all employees, regardless of race, color, religion, gender, sexual orientation, national origin, age, disability, or veteran status.

Seniority level

Mid‑Senior level

Employment type

Contract

Job function

Other

Referrals increase your chances of interviewing at STAFFWORXS by 2x

#J-18808-Ljbffr