Diverse Lynx
Senior Azure Data Engineer with Fabric Experience
Diverse Lynx, Newark, New Jersey, us, 07175
Qualifications
Minimum 10+ years experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, Microsoft Fabric etc.
Azure experience is preferred over other cloud platforms.
Minimum 10 + years of proven experience with SQL, schema design and dimensional data modelling.
Solid knowledge of data warehouse best practices, development standards and methodologies.
Experience with ETL/ELT tools like ADF, Azure, MS Fabric etc., and data warehousing technologies like Azure Synapse, Azure SQL, ADLS etc.
Strong experience with big data tools (Microsoft Fabric, Databricks , Spark etc..) and programming skills in PySpark and Spark SQL.
Be an independent self-learner with a let s get this done approach and ability to work in Fast paced and Dynamic environment.
Knowledge in Microsoft Fabric Data Platform
Expertise in designing application solution on Azure Data Platform for complex business needs.
Serves as key technical expert engaged on designing, architecting, deploying and maintaining cloud solutions, Data Management & Analytics.
Strong knowledge of ETL patterns for data ingestion, processing and distribution using pipelines on Azure cloud services. Leads technology proof of concepts to ensure feasibility of architecture solutions.
Provides architecture direction for engineers in support of a technical pattern.
Displays strong thought leadership in pursuit of modern data architecture principles and technology modernization.
Drives continuous technology transformation to minimize technical debt. Continuously improve efficiency and effectiveness of the architecture.
Looks for opportunities to capitalize on technology advances through analysis of key industry and technology trends to assess potential impact on the enterprise. Participates in defining target state technology architecture and roadmaps.
Ensures alignment of IT initiatives with the target state.
Roles & Responsibilities
Build and maintain new and existing applications in preparation for a large-scale architectural migration within an Agile function.
Align with the Product Owner and Scrum Master in assessing business needs and transforming them into scalable applications.
Build and maintain code to manage data received from heterogenous data formats including web- based sources, internal/external databases, flat files, heterogenous data formats (binary, ASCII).
Help build new enterprise Datawarehouse and maintain the existing one.
Design and support effective storage and retrieval of very large internal and external data set and be forward think about the convergence strategy with our Azure cloud migration.
Assess the impact of scaling up and scaling out and ensure sustained data management and data delivery performance.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
#J-18808-Ljbffr
Minimum 10+ years experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, Microsoft Fabric etc.
Azure experience is preferred over other cloud platforms.
Minimum 10 + years of proven experience with SQL, schema design and dimensional data modelling.
Solid knowledge of data warehouse best practices, development standards and methodologies.
Experience with ETL/ELT tools like ADF, Azure, MS Fabric etc., and data warehousing technologies like Azure Synapse, Azure SQL, ADLS etc.
Strong experience with big data tools (Microsoft Fabric, Databricks , Spark etc..) and programming skills in PySpark and Spark SQL.
Be an independent self-learner with a let s get this done approach and ability to work in Fast paced and Dynamic environment.
Knowledge in Microsoft Fabric Data Platform
Expertise in designing application solution on Azure Data Platform for complex business needs.
Serves as key technical expert engaged on designing, architecting, deploying and maintaining cloud solutions, Data Management & Analytics.
Strong knowledge of ETL patterns for data ingestion, processing and distribution using pipelines on Azure cloud services. Leads technology proof of concepts to ensure feasibility of architecture solutions.
Provides architecture direction for engineers in support of a technical pattern.
Displays strong thought leadership in pursuit of modern data architecture principles and technology modernization.
Drives continuous technology transformation to minimize technical debt. Continuously improve efficiency and effectiveness of the architecture.
Looks for opportunities to capitalize on technology advances through analysis of key industry and technology trends to assess potential impact on the enterprise. Participates in defining target state technology architecture and roadmaps.
Ensures alignment of IT initiatives with the target state.
Roles & Responsibilities
Build and maintain new and existing applications in preparation for a large-scale architectural migration within an Agile function.
Align with the Product Owner and Scrum Master in assessing business needs and transforming them into scalable applications.
Build and maintain code to manage data received from heterogenous data formats including web- based sources, internal/external databases, flat files, heterogenous data formats (binary, ASCII).
Help build new enterprise Datawarehouse and maintain the existing one.
Design and support effective storage and retrieval of very large internal and external data set and be forward think about the convergence strategy with our Azure cloud migration.
Assess the impact of scaling up and scaling out and ensure sustained data management and data delivery performance.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
#J-18808-Ljbffr