Diverse Lynx
Position: Azure Data Engineer/Azure Databricks Administrator
Location : TAMPA, FL - Onsite
Type of Hire :- Long Term Contract
Job Summary: We are seeking a skilled Azure Data Engineer / Azure Databricks Administrator to join our data engineering team. The ideal candidate will have hands-on experience with Azure cloud services, specifically focusing on Azure Databricks, Azure Authentication, and connectivity setup. You will be responsible for designing and implementing data infrastructure solutions, managing secure authentication mechanisms, and enabling seamless connectivity across various Azure services. Proficiency in
PySpark
is essential. Key Responsibilities:
Design, develop, and maintain scalable data pipelines and architectures in Azure using Azure Databricks and other Azure data services. dminister Azure Databricks workspaces, clusters, and jobs with focus on security, performance, and cost optimization. Configure and manage Azure authentication mechanisms, including Azure Active Directory (AAD) integration, managed identities, service principals, and role-based access control (RBAC). Establish secure connectivity and seamless integration between Azure Databricks, Azure Data Lake Storage (ADLS) Azure Key vault and Azure SQL Database. Develop and optimize PySpark scripts and notebooks for ETL/ELT processes, data transformations & CI CD.. Collaborate with data architects, data scientists, and other engineers to ensure data accessibility, quality, and security.. Monitor and troubleshoot data pipelines, platform performance, and connectivity issues.. Document configuration, processes, and best practices related to Azure Databricks administration and authentication setups. Stay updated with the latest Azure data engineering tools, frameworks, and security best practices.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location : TAMPA, FL - Onsite
Type of Hire :- Long Term Contract
Job Summary: We are seeking a skilled Azure Data Engineer / Azure Databricks Administrator to join our data engineering team. The ideal candidate will have hands-on experience with Azure cloud services, specifically focusing on Azure Databricks, Azure Authentication, and connectivity setup. You will be responsible for designing and implementing data infrastructure solutions, managing secure authentication mechanisms, and enabling seamless connectivity across various Azure services. Proficiency in
PySpark
is essential. Key Responsibilities:
Design, develop, and maintain scalable data pipelines and architectures in Azure using Azure Databricks and other Azure data services. dminister Azure Databricks workspaces, clusters, and jobs with focus on security, performance, and cost optimization. Configure and manage Azure authentication mechanisms, including Azure Active Directory (AAD) integration, managed identities, service principals, and role-based access control (RBAC). Establish secure connectivity and seamless integration between Azure Databricks, Azure Data Lake Storage (ADLS) Azure Key vault and Azure SQL Database. Develop and optimize PySpark scripts and notebooks for ETL/ELT processes, data transformations & CI CD.. Collaborate with data architects, data scientists, and other engineers to ensure data accessibility, quality, and security.. Monitor and troubleshoot data pipelines, platform performance, and connectivity issues.. Document configuration, processes, and best practices related to Azure Databricks administration and authentication setups. Stay updated with the latest Azure data engineering tools, frameworks, and security best practices.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.