Databricks Platform Administrator (w2)

Databricks Platform Administration Deploy, configure, and maintain Azure Databricks workspaces Manage clusters , pools , and jobs for optimal performance. Handle Databricks Runtime upgrades and compatibility testing. Configure Databricks notebooks, Repos, and Delta Lake for efficient workflows. Security & Access Control: Implement Identity and Access Management (IAM) using Azure AD / Azure IAM / SCIM . Set up and enforce Role-Based Access Control (RBAC) and network security . Ensure compliance with data governance policies (Unity Catalog, creation of Catalogs, schema etc.). Applying grants of catalogs and schemas Manage personal access tokens (PATs) and OAuth-based authentication . Performance Monitoring & Optimization: Monitor cluster performance, auto-scaling, and cost optimization . Analyze and fine-tune Spark jobs to improve execution efficiency. Use Databricks SQL for querying and performance diagnostics. Integration & Automation: Integrate Databricks with Azure Data Factory, Synapse, Snowflake, Kafka, and other data sources . Automate cluster management using Terraform. Implement CI/CD pipelines for Databricks notebooks using GitHub or Azure DevOps . Troubleshooting & Support: Investigate and resolve job failures, cluster crashes, and query performance issues . Provide L2/L3 support for Databricks infrastructure issues. Collaborate with Databricks support for bug fixes and escalations.

#J-18808-Ljbffr