Diverse Lynx
Must Have
8+ years of experience in data engineering with Databricks and Spark Strong knowledge of Databricks architecture, tools and capabilities Experience in designing, developing, and optimizing ETL/ELT data pipelines using Databricks on AWS Good understanding of AWS native services – S3, DataSync, DMS, Lambda, SNS, SQS SQL and PySpark: strong command over querying databases and proficiency in PySpark Experience with Delta Lake and building data lakes Familiarity with CI/CD pipelines using tools such as Gitlab Good communication and presentation skills Agile trained and knowledge of JIRA Good to Have
Databricks Certified Knowledge in On-Prem (Teradata, SQL Server, etc.) and Cloud Data Platforms (RDS, Redshift, etc.) Knowledge in Data Warehousing concepts Knowledge in AWS cloud Experience in Retail & Supply Chain domain Equal Employment Opportunity Statement
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
#J-18808-Ljbffr
8+ years of experience in data engineering with Databricks and Spark Strong knowledge of Databricks architecture, tools and capabilities Experience in designing, developing, and optimizing ETL/ELT data pipelines using Databricks on AWS Good understanding of AWS native services – S3, DataSync, DMS, Lambda, SNS, SQS SQL and PySpark: strong command over querying databases and proficiency in PySpark Experience with Delta Lake and building data lakes Familiarity with CI/CD pipelines using tools such as Gitlab Good communication and presentation skills Agile trained and knowledge of JIRA Good to Have
Databricks Certified Knowledge in On-Prem (Teradata, SQL Server, etc.) and Cloud Data Platforms (RDS, Redshift, etc.) Knowledge in Data Warehousing concepts Knowledge in AWS cloud Experience in Retail & Supply Chain domain Equal Employment Opportunity Statement
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
#J-18808-Ljbffr