Diverse Lynx
Role: Data Engineer
Location: Atlanta, GA (must be onsite for this opportunity - NO starting off remote)
Job type: Long-term contract to hire
Job Type: W2 contract- Visa sponsorship not available
Top 3 MUST HAVES:
1-3 years of data engineering exp Hands on experience with Microsoft Azure products Full life cycle implementation and support of data warehouse and business intelligence solutions
We are seeking a Data Engineer with experience manipulating and transforming data in a software engineering environment. This role requires deep technical knowledge and hands-on experience working with both traditional relational systems and modern cloud and big data technologies. The ideal candidate will have experience normalizing databases, structuring data for analytics, and building pipelines that support enterprise data initiatives.
Key Responsibilities: • Develop, test, and support scalable data pipelines using both cloud and on-premises technologies. • Normalize relational and NoSQL databases to meet the requirements of consuming applications. • Design and construct datasets that are machine-readable, consistent, and optimized for analysis. • Integrate and transform raw data from multiple sources into unified, business-ready formats. • Collaborate with cross-functional teams to deliver end-to-end data engineering and analytics solutions. • Create functional and technical design documentation for data workflows and system components. • Perform code reviews and contribute to reusable solution components and best practices. • Support automation and deployment efforts using CI/CD and DevOps methodologies. • Participate in Agile development processes and ensure high-quality delivery through collaborative team efforts.
Required Skills and Experience: • 1-3 years of experience in data engineering, data integration, or software engineering focused on data. • Strong proficiency in SQL, data modeling, and data normalization techniques. Hands-on experience with: • Microsoft Azure tools: Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Databricks, Azure Key Vault, Power BI. • Big data tools: Hadoop, Spark, Hive. • ETL/BI tools: SSIS, SSAS, Informatica, Oracle Golden Gate. • Programming languages: Python (including for AI/ML development). • utomation tools: Autosys or similar. • Experience implementing various data models and working with structured, semi-structured, and unstructured data. • Familiarity with containerization tools like Docker and OpenShift. • Experience working in medium to large enterprise environments and collaborating across multiple projects and teams. • Microsoft Azure Data Engineer Certification. • Knowledge of data governance practices and tools (e.g., Unity Catalog in Databricks). • Experience designing API- and web service-based data integration solutions.
Preferred Qualifications: • Industry experience in the Gas/Utilities sector and understanding of related data strategies. • Experience using JIRA and/or Azure DevOps for work management and delivery tracking. • Strong understanding of Agile development and DevOps/CI-CD pipelines.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Top 3 MUST HAVES:
1-3 years of data engineering exp Hands on experience with Microsoft Azure products Full life cycle implementation and support of data warehouse and business intelligence solutions
We are seeking a Data Engineer with experience manipulating and transforming data in a software engineering environment. This role requires deep technical knowledge and hands-on experience working with both traditional relational systems and modern cloud and big data technologies. The ideal candidate will have experience normalizing databases, structuring data for analytics, and building pipelines that support enterprise data initiatives.
Key Responsibilities: • Develop, test, and support scalable data pipelines using both cloud and on-premises technologies. • Normalize relational and NoSQL databases to meet the requirements of consuming applications. • Design and construct datasets that are machine-readable, consistent, and optimized for analysis. • Integrate and transform raw data from multiple sources into unified, business-ready formats. • Collaborate with cross-functional teams to deliver end-to-end data engineering and analytics solutions. • Create functional and technical design documentation for data workflows and system components. • Perform code reviews and contribute to reusable solution components and best practices. • Support automation and deployment efforts using CI/CD and DevOps methodologies. • Participate in Agile development processes and ensure high-quality delivery through collaborative team efforts.
Required Skills and Experience: • 1-3 years of experience in data engineering, data integration, or software engineering focused on data. • Strong proficiency in SQL, data modeling, and data normalization techniques. Hands-on experience with: • Microsoft Azure tools: Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Databricks, Azure Key Vault, Power BI. • Big data tools: Hadoop, Spark, Hive. • ETL/BI tools: SSIS, SSAS, Informatica, Oracle Golden Gate. • Programming languages: Python (including for AI/ML development). • utomation tools: Autosys or similar. • Experience implementing various data models and working with structured, semi-structured, and unstructured data. • Familiarity with containerization tools like Docker and OpenShift. • Experience working in medium to large enterprise environments and collaborating across multiple projects and teams. • Microsoft Azure Data Engineer Certification. • Knowledge of data governance practices and tools (e.g., Unity Catalog in Databricks). • Experience designing API- and web service-based data integration solutions.
Preferred Qualifications: • Industry experience in the Gas/Utilities sector and understanding of related data strategies. • Experience using JIRA and/or Azure DevOps for work management and delivery tracking. • Strong understanding of Agile development and DevOps/CI-CD pipelines.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.