Lead Data Engineer
RIT Solutions, Inc. - Tampa, Florida, us, 33646
Work at RIT Solutions, Inc.
Overview
- View job
Overview
Remote (EST) Contract:
6+ months Ongoing (possible contract to hire/must be eligible for conversion) Summary: s a Lead Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure. You will be responsible for data integration, migration, and analysis using a variety of Microsoft technologies. This role requires a deep understanding
of Azure Data Factory, Logic Apps, Azure Service Bus, Databricks, and advanced SQL and Python
. You will work closely with the Data Lead and Technical Analyst to translate business requirements into technical solutions and ensure the seamless flow of data across our systems.
Key Responsibilities: * Lead Data Engineer will design, develop, and maintain data pipelines using Azure Data Factory, Logic Apps, and Azure Service Bus * Implement and manage Databricks for advanced data processing and analytics * Develop complex SQL queries and stored procedures for data extraction, transformation, and loading (ETL) * Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications * Ensure data quality and integrity across various data sources and systems * Manage data integrations and migrations between diverse systems, ensuring minimal disruption to business operations * As a Lead Data Engineer, you will utilize Azure CI/CD pipelines for continuous integration and delivery of data solutions * Create and maintain data workflows using Power Automate * Conduct data analysis to support business decision-making processes * Work independently and as part of a team to deliver high-quality data solutions * Communicate effectively with stakeholders to understand their data needs and provide technical guidance