Diverse Lynx
Role
-
Azure Databricks Engineer Location
- New York, NY (Onsite) Experience -
10+Years
Job Description. are looking for an experienced Data Engineer with expertise in building data pipelines using Azure Databricks and other Azure Data Services. Person should have good understanding and working experience e]in Lakehouse and Medallion. He/Should should have developed and implemented of scalable, high-performance data solutions on the Databricks using Delta Lake, ADLS2. Spark, and Apache Airflow. • Experience working with Azure Services such as Azure Data Lake, Databricks, Azure Data Factory, Azure SQL DB, Azure Functions, etc. • Hands-on experience with Delta Live Tables, Unity Catalog, and Lakehouse Federation • Technical expertise with data models, data mining and analytics techniques. • Technical expertise on various storage mechanisms. • Programming skills (Either Python or .Net/C#) • SQL Database design. • Experience Working in Agile (Specifically Scrum) model • Experience Git/DevOps, implementing CI CD [Preferably Azure based) pipeline • Experience in data modelling and analysis (Best Practices and Techniques), Data Warehousing Concepts. • Strong collaboration, team ethics and experience working with remote teams • Participates and leads focus groups, working to align Business and IT organizations Responsibilities • Analyze and organize raw data • Build data systems and data pipelines • Evaluate business needs and objectives, Interpret trends and patterns • Conduct complex data analysis and report on results • Prepare data for prescriptive and predictive modeling • Build / Incorporate business rules, logic, transformations and aggregations • Combine raw information from different sources, build data pipelines across multiple data layers • Explore ways to enhance data quality and reliability, build data quality frameworks • Identify opportunities for data acquisition Preferred Qualifications:• Databricks Certified: Databricks Certified Data Engineer Professional• Prior experience in banking/finance domains is a plus.Education:• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
-
Azure Databricks Engineer Location
- New York, NY (Onsite) Experience -
10+Years
Job Description. are looking for an experienced Data Engineer with expertise in building data pipelines using Azure Databricks and other Azure Data Services. Person should have good understanding and working experience e]in Lakehouse and Medallion. He/Should should have developed and implemented of scalable, high-performance data solutions on the Databricks using Delta Lake, ADLS2. Spark, and Apache Airflow. • Experience working with Azure Services such as Azure Data Lake, Databricks, Azure Data Factory, Azure SQL DB, Azure Functions, etc. • Hands-on experience with Delta Live Tables, Unity Catalog, and Lakehouse Federation • Technical expertise with data models, data mining and analytics techniques. • Technical expertise on various storage mechanisms. • Programming skills (Either Python or .Net/C#) • SQL Database design. • Experience Working in Agile (Specifically Scrum) model • Experience Git/DevOps, implementing CI CD [Preferably Azure based) pipeline • Experience in data modelling and analysis (Best Practices and Techniques), Data Warehousing Concepts. • Strong collaboration, team ethics and experience working with remote teams • Participates and leads focus groups, working to align Business and IT organizations Responsibilities • Analyze and organize raw data • Build data systems and data pipelines • Evaluate business needs and objectives, Interpret trends and patterns • Conduct complex data analysis and report on results • Prepare data for prescriptive and predictive modeling • Build / Incorporate business rules, logic, transformations and aggregations • Combine raw information from different sources, build data pipelines across multiple data layers • Explore ways to enhance data quality and reliability, build data quality frameworks • Identify opportunities for data acquisition Preferred Qualifications:• Databricks Certified: Databricks Certified Data Engineer Professional• Prior experience in banking/finance domains is a plus.Education:• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.