Ark Solutions
Sr. Data Engineer :: Atlanta, GA (Hybrid)
Ark Solutions, Atlanta, Georgia, United States, 30383
Sr. Data Engineer - Atlanta, GA (Hybrid)
Duration: 7+ months
Seeking for a Sr Data Engineer to support the modernization of our data estate. This role involves developing data pipelines, migrating legacy systems, and maintaining scalable, secure, and efficient data solutions using modern technologies like Microsoft Fabric and Azure-based platforms.
Key Responsibilities: Design, build, and maintain ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks. Support the migration and maintenance of SSIS packages from legacy systems. Implement medallion architecture for data lifecycle and quality. Create and manage notebooks for data transformation using Python, SQL, and Spark. Build curated datasets to support Power BI dashboards. Collaborate with data analysts and business stakeholders to deliver fit-for-purpose data assets. Apply data governance policies in line with Microsoft Purview or Unity Catalog. Support monitoring, logging, and CI/CD automation using Azure DevOps. Technical Stack:
Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake) Azure Databricks SQL Server / SQL Managed Instances Power BI SSIS (migration and maintenance) LangGraph and RAG DB (for advanced data workflows) Must-Have Qualifications:
Bachelor's degree in computer science, Information Systems, or related field. 3-5 years of experience in data engineering or related roles. Proficiency in SQL, Python, Spark. Familiarity with LangGraph and RAG DB concepts. Understanding of ETL/ELT pipelines and data warehousing concepts. Knowledge of CI/CD automation with Azure DevOps. Familiarity with data governance tools (Microsoft Purview, Unity Catalog). Experience with SSIS package migration and maintenance.
Duration: 7+ months
Seeking for a Sr Data Engineer to support the modernization of our data estate. This role involves developing data pipelines, migrating legacy systems, and maintaining scalable, secure, and efficient data solutions using modern technologies like Microsoft Fabric and Azure-based platforms.
Key Responsibilities: Design, build, and maintain ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks. Support the migration and maintenance of SSIS packages from legacy systems. Implement medallion architecture for data lifecycle and quality. Create and manage notebooks for data transformation using Python, SQL, and Spark. Build curated datasets to support Power BI dashboards. Collaborate with data analysts and business stakeholders to deliver fit-for-purpose data assets. Apply data governance policies in line with Microsoft Purview or Unity Catalog. Support monitoring, logging, and CI/CD automation using Azure DevOps. Technical Stack:
Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake) Azure Databricks SQL Server / SQL Managed Instances Power BI SSIS (migration and maintenance) LangGraph and RAG DB (for advanced data workflows) Must-Have Qualifications:
Bachelor's degree in computer science, Information Systems, or related field. 3-5 years of experience in data engineering or related roles. Proficiency in SQL, Python, Spark. Familiarity with LangGraph and RAG DB concepts. Understanding of ETL/ELT pipelines and data warehousing concepts. Knowledge of CI/CD automation with Azure DevOps. Familiarity with data governance tools (Microsoft Purview, Unity Catalog). Experience with SSIS package migration and maintenance.