Data Engineer
Seven Seven Software - Newark, New Jersey, us, 07175
Work at Seven Seven Software
Overview
- View job
Overview
Qualifications:
Bachelor's degree in computer science, Software Engineering, MIS, or an equivalent combination of education and experience. Experience implementing and supporting data lakes, data warehouses, and data applications on
AWS or Microsoft Azure for large enterprises (Fabric is plus) Programming experience with
Python, Spark and SQL. Experience with Microsoft Azure services, specifically Data Factory, ADLS Gen2, Synapse Analytics, and Synapse Database, KQL. Experience in system analysis, design, development, and implementation of data ingestion pipelines in AWS or Azure. Solid experience implementing solutions on AWS or
Azure-based data lakes (preferred). Knowledge of ETL/ELT processes. Experience with end-to-end data solutions (ingest, storage, integration, processing, access) on AWS or Azure
(preferred). Architect and implement CI/CD strategies for EDP. Implement high-velocity streaming solutions. Migrate data from traditional relational database systems, onprem to Azure technologies (preferably in Onelake using Fabric technologies -
(preferred ). Develop data-based APIs Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-cases. Any Cloud Certification preferred (Azure / AWS preferred) Knowledge of Microsoft Fabric technology focusing on cost and security considerations. Requirements:
5+ years of experience as a Data Engineer/Datalakes . Experience developing business applications using NoSQL/SQL databases. Experience working with Object stores and Structured/semi-structured/unstructured data is a must. Experience with Microsoft Azure services - Data Factory, ADLS Gen2, Synapse Analytics, and Synapse Database. Develop CI/CD pipeline using Terraform and github Microsoft Fabric is plus.