ZipRecruiter
Job DescriptionJob DescriptionSalary:
Seeking aDatabricks Architectto lead the design and delivery of large-scale data platforms using Databricks.
Key Responsibilities
Architect and implementDatabricks lakehouse solutions(Delta Lake, Spark, Unity Catalog, MLflow).
Design and optimizeETL/ELT pipelines, data ingestion, and real-time streaming frameworks.
Integrate Databricks withcloud services (AWS, Azure, GCP)and enterprise data systems.
Establishdata governance, security, and complianceframeworks.
Leadmigration effortsfrom legacy platforms to Databricks.
Collaborate with business stakeholders, data engineers, and data scientists to deliver end-to-end solutions.
Required Skills
Proven hands-on experience as aDatabricks Architect / Senior Data Engineer.
Strong experience with data pipelines including Cribl, Confluent and other high capacity data interchange
Strong expertise inDatabricks ecosystem(Spark, Delta Lake, SQL Analytics, MLflow).
Cloud experience (Azure Databricks , AWS/GCP acceptable).
Strong coding background inPython, PySpark, SQL, Scala.
Knowledge ofdata security, compliance, and governancestandards.
U.S. work authorization; must bebased onshore.
Databricks certifications.
Experience withBI tools(Power BI, Tableau) andautomation/DevOps(Terraform, GitHub Actions, Jenkins).
Prior consulting/enterprise implementation experience.
remote work
Seeking aDatabricks Architectto lead the design and delivery of large-scale data platforms using Databricks.
Key Responsibilities
Architect and implementDatabricks lakehouse solutions(Delta Lake, Spark, Unity Catalog, MLflow).
Design and optimizeETL/ELT pipelines, data ingestion, and real-time streaming frameworks.
Integrate Databricks withcloud services (AWS, Azure, GCP)and enterprise data systems.
Establishdata governance, security, and complianceframeworks.
Leadmigration effortsfrom legacy platforms to Databricks.
Collaborate with business stakeholders, data engineers, and data scientists to deliver end-to-end solutions.
Required Skills
Proven hands-on experience as aDatabricks Architect / Senior Data Engineer.
Strong experience with data pipelines including Cribl, Confluent and other high capacity data interchange
Strong expertise inDatabricks ecosystem(Spark, Delta Lake, SQL Analytics, MLflow).
Cloud experience (Azure Databricks , AWS/GCP acceptable).
Strong coding background inPython, PySpark, SQL, Scala.
Knowledge ofdata security, compliance, and governancestandards.
U.S. work authorization; must bebased onshore.
Databricks certifications.
Experience withBI tools(Power BI, Tableau) andautomation/DevOps(Terraform, GitHub Actions, Jenkins).
Prior consulting/enterprise implementation experience.
remote work