Diverse Lynx
Role name:
Engineer
Role Description:
Must have at least 8+ years of extensive Data Engineering Experience in Databricks, ETL/ELT using Data pipelines, SQL/Procedure experience.Must have 8+ Years of hands-on development proficiency in implementing Databricks solutions using Scala and Spark with Data frames and Notebooks/SQLMust have 8+ Years of hands-on development and performance tuning/enhancement experience in Scala/PySpark and SQL.Must have 8+ Years of hands-on development experience in working on Azure Cloud.Must have strong experience with Databricks, including developing and optimizing Spark jobs, data transformations, and data processing workflows.Must have experience and a good understanding on the below topicsDatabricks Delta Lake storageUnity CatalogAutoloader Lakehouse ArchitectureMedallion ArchitectureDatabricks Serverless Options.Dataset and Data frameDatabricks Clusters Configuration and SizingDatabricks Job OrchestrationSpark Structured Streaming Must have experience with complex and large volume data streaming and data transformations using Azure Databricks.Must have extensive experience in Datawarehouse/Data Lakehouse implementations.Must have experience with monitoring, debugging, and resolving issues in live Databricks jobs.Must have strong hands-on expertise in troubleshooting DevOps pipelines, Azure, and AKS services
Competencies:
Digital : Microsoft Azure, Digital : Scala, Digital : Databricks, Digital : PySpark, PL/SQL
Role name:
Engineer
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Engineer
Role Description:
Must have at least 8+ years of extensive Data Engineering Experience in Databricks, ETL/ELT using Data pipelines, SQL/Procedure experience.Must have 8+ Years of hands-on development proficiency in implementing Databricks solutions using Scala and Spark with Data frames and Notebooks/SQLMust have 8+ Years of hands-on development and performance tuning/enhancement experience in Scala/PySpark and SQL.Must have 8+ Years of hands-on development experience in working on Azure Cloud.Must have strong experience with Databricks, including developing and optimizing Spark jobs, data transformations, and data processing workflows.Must have experience and a good understanding on the below topicsDatabricks Delta Lake storageUnity CatalogAutoloader Lakehouse ArchitectureMedallion ArchitectureDatabricks Serverless Options.Dataset and Data frameDatabricks Clusters Configuration and SizingDatabricks Job OrchestrationSpark Structured Streaming Must have experience with complex and large volume data streaming and data transformations using Azure Databricks.Must have extensive experience in Datawarehouse/Data Lakehouse implementations.Must have experience with monitoring, debugging, and resolving issues in live Databricks jobs.Must have strong hands-on expertise in troubleshooting DevOps pipelines, Azure, and AKS services
Competencies:
Digital : Microsoft Azure, Digital : Scala, Digital : Databricks, Digital : PySpark, PL/SQL
Role name:
Engineer
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.