Logo
Kyyba

Data Engineer - Databricks Unity Catalog

Kyyba, Farmington Hills, Michigan, United States

Save Job

Job Title:

(

Data Engineer - Databricks Unity Catalog

)

About Kyyba: Founded in 1998 and headquartered in Farmington Hills, MI, Kyyba has a global presence delivering high-quality resources and top-notch recruiting services, enabling businesses to effectively respond to organizational changes and technological advances. At Kyyba, the overall well-being of our employees and their families is important to us. We are proud of our work culture which embodies our core values; incorporating value, passion, excellence, empowerment, and happiness, creates a vibrant and productive atmosphere. We empower our employees with the resources, incentives, and flexibility that they need to support a healthy, balanced, and fulfilling career by providing many valuable benefits and a balanced compensation structure combined with career development.

Job Description

We are seeking a skilled and motivated Data Engineer with experience in Databricks Unity Catalog to support enterprise data governance, access control, and cataloging across our modern data platform. The ideal candidate will play a key role in the implementation, configuration, and optimization of Unity Catalog, ensuring secure and well-organized access to data assets across multiple environments.

Key Responsibilities:

Design and implement Databricks Unity Catalog to manage metadata, data access policies, lineage, and audit requirements. Work with data platform teams to integrate Unity Catalog with existing data lakes, Delta tables, and other cloud storage solutions (e.g., AWS S3, Azure Data Lake). Define and enforce fine-grained access control policies using Unity Catalog's role-based and attribute-based access models. Collaborate with Data Governance, Security, and Engineering teams to align Unity Catalog usage with enterprise compliance and data privacy requirements. Support data discovery and cataloging through creation and maintenance of well-structured, documented metadata assets. Develop automation scripts (e.g., using Python, PySpark, or Terraform) for catalog provisioning, permissioning, and metadata management. Monitor data access and lineage using Unity Catalog's audit and tracking capabilities. Provide guidance and best practices for teams onboarding to Unity Catalog and Databricks.

Required Qualifications:

8+ years of experience in Data Engineering or Platform Engineering roles. Hands-on experience with Databricks, including workspace setup, Delta Lake, and cluster management. Strong knowledge of Unity Catalog, including governance, catalog/schema/table management, and access control. Proficiency in SQL, Python, or PySpark. Familiarity with cloud platforms such as AWS, Azure, or GCP. Experience working with IAM, RBAC, and data security frameworks. Understanding of data lineage, metadata management, and catalog integration. Familiarity with tools such as Terraform, dbutils, or CI/CD pipelines is a plus.

Preferred Qualifications:

Prior experience in data governance, data security, or privacy compliance (e.g., HIPAA, GDPR). Exposure to enterprise MDM, data catalogs like Collibra, Alation, or Informatica. Databricks certification(s) such as Databricks Certified Data Engineer Associate/Professional or Unity Catalog

Administrator.Soft Skills:

Strong communication and collaboration skills. Proactive approach to problem-solving and documentation. Ability to work in a fast-paced, agile environment.

Location

: (

Farmington Hills, MI

)

Disclaimer: Kyyba is an Equal Opportunity Employer. Kyyba does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. Minorities / Females / Protected Veterans / Individuals with Disabilities are encouraged to apply. All employment is decided on the basis of qualifications, merit, and business need." It is the policy of Kyyba to provide reasonable accommodation when requested by a qualified applicant or employee with a disability, unless such accommodation would cause an undue hardship. The policy regarding requests for reasonable accommodation applies to all aspects of employment, including the application process. If reasonable accommodation is needed, please contact Kyyba at 248-813-9665

Rewards: Medical, dental, vision 401k Term life Voluntary life and disability insurance Optional Pre-paid legal plan Optional Identity theft plan Optional Medical and dependent FSA Work-visa sponsorship Opportunity for advancement Long-term assignment with opportunity for hire by client

SELECT AWARDS

An INC 5000 company for 10 years Corp! Michigan Economic Bright Spots Crain's Detroit Business Top Staffing Service Companies in Detroit TechServe Alliance Excellence Award- IT and Engineering Staffing & Solutions Best of MichBusiness winner in HR Wizards & Partnerships Metro Detroit Elite Category: Recruitment, Selection & Orientation for 101 Best & Brightest 101 Best & Brightest Companies to Work for in Michigan