Dice
Title: Databricks DevOps Administrator (MUST be strong on Databricks)
Duration: 12+ months contract
*NOTE: Must be willing to go onsite from day one in Alpharetta, GA
Job Summary Note: Strong proficiency in Python, Terraform, and Azure/AWS required.
Position Overview We are seeking a seasoned Databricks Platform Administrator to design, implement, and manage our enterprise-scale Databricks environment. This role is pivotal in ensuring the platform is secure, scalable, highly available, and optimized for performance and cost. You will work closely with data engineers, data scientists, and cloud architects to administer, automate, and govern the Databricks platform across development, QA, and production environments.
Key Responsibilities
Administer and manage the Databricks environment, including workspace configuration, user management, cluster policies, and job scheduling.
Develop and maintain Infrastructure as Code (IaC) using Terraform to automate the deployment and management of Databricks workspaces and associated cloud resources.
Implement and enforce security best practices, including RBAC, data encryption, network isolation, and audit logging via Unity Catalog.
Monitor platform health, performance, and usage, and implement observability solutions using Databricks-native tools, Prometheus, and Grafana.
Optimize and tune clusters, queries, and workflows for improved performance and cost-efficiency.
Establish and manage CI/CD pipelines for Databricks asset deployment using GitHub Actions or similar tools.
Collaborate with data teams to define and implement governance, compliance, and data management policies.
Provide operational support, troubleshooting, and incident resolution for the Databricks platform.
Required Qualifications
5+ years of experience in data platform administration, with a focus on Databricks.
Hands-on experience administering Databricks (workspaces, clusters, Unity Catalog, SQL Warehouses, Delta Lake).
Proficiency in Terraform for infrastructure automation and management.
Strong scripting skills in Python or Java for automation and tooling.
Experience with cloud infrastructure (Azure or AWS) in areas such as IAM, networking, storage, and monitoring.
Knowledge of CI/CD processes and tools like GitHub Actions, GitLab CI, or Jenkins.
Familiarity with monitoring and logging tools such as Prometheus, Grafana, or Datadog.
Excellent communication skills and experience working in cross-functional teams.
Preferred Qualifications
Databricks Certification (e.g., Databricks Certified Associate Administrator).
Experience in regulated industries such as finance or healthcare.
Knowledge of Databricks REST APIs and SDKs for extensibility and automation.
Azure or AWS certifications.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
#J-18808-Ljbffr
Duration: 12+ months contract
*NOTE: Must be willing to go onsite from day one in Alpharetta, GA
Job Summary Note: Strong proficiency in Python, Terraform, and Azure/AWS required.
Position Overview We are seeking a seasoned Databricks Platform Administrator to design, implement, and manage our enterprise-scale Databricks environment. This role is pivotal in ensuring the platform is secure, scalable, highly available, and optimized for performance and cost. You will work closely with data engineers, data scientists, and cloud architects to administer, automate, and govern the Databricks platform across development, QA, and production environments.
Key Responsibilities
Administer and manage the Databricks environment, including workspace configuration, user management, cluster policies, and job scheduling.
Develop and maintain Infrastructure as Code (IaC) using Terraform to automate the deployment and management of Databricks workspaces and associated cloud resources.
Implement and enforce security best practices, including RBAC, data encryption, network isolation, and audit logging via Unity Catalog.
Monitor platform health, performance, and usage, and implement observability solutions using Databricks-native tools, Prometheus, and Grafana.
Optimize and tune clusters, queries, and workflows for improved performance and cost-efficiency.
Establish and manage CI/CD pipelines for Databricks asset deployment using GitHub Actions or similar tools.
Collaborate with data teams to define and implement governance, compliance, and data management policies.
Provide operational support, troubleshooting, and incident resolution for the Databricks platform.
Required Qualifications
5+ years of experience in data platform administration, with a focus on Databricks.
Hands-on experience administering Databricks (workspaces, clusters, Unity Catalog, SQL Warehouses, Delta Lake).
Proficiency in Terraform for infrastructure automation and management.
Strong scripting skills in Python or Java for automation and tooling.
Experience with cloud infrastructure (Azure or AWS) in areas such as IAM, networking, storage, and monitoring.
Knowledge of CI/CD processes and tools like GitHub Actions, GitLab CI, or Jenkins.
Familiarity with monitoring and logging tools such as Prometheus, Grafana, or Datadog.
Excellent communication skills and experience working in cross-functional teams.
Preferred Qualifications
Databricks Certification (e.g., Databricks Certified Associate Administrator).
Experience in regulated industries such as finance or healthcare.
Knowledge of Databricks REST APIs and SDKs for extensibility and automation.
Azure or AWS certifications.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
#J-18808-Ljbffr