Diverse Lynx
Job type: ETL Data Engineer
Location: Dallas, TX, Kansas City, MO or Edison, NJ - Remote job but local to these area
Experience: 10-15 years
Duration: 12-24 Months
Must have: Strong SQL Development, PySpark, AWS Glue and Healthcare domain exp in recent
Job Overview : We are looking for a highly skilled and experienced Senior Data Engineer to join our team . The ideal candidate will have extensive experience in AWS Redshift, PostgreSQL, SQL Server, Git, AWS Glue, Spark, Slack and Python. You will be responsible for designing, developing, and maintaining complex ETL processes that enable smooth and efficient data integration, transformation, and loading across multiple systems. You should have excellent problem-solving skills and be able to work both independently and collaboratively within a dynamic environment.
Key Responsibilities:
Design, develop, and optimize ETL pipelines to support data integration between diverse data sources, including AWS Glue/PySpark, Redshift, PostgreSQL, and SQL Server. Collaborate with business stakeholders and data engineers to gather requirements, define data workflows, and ensure alignment with business goals. Develop Python scripts to automate ETL processes, enhance data workflows, and solve complex data challenges. Ensure data quality, integrity, and reliability throughout all stages of the ETL process. Optimize database queries and data transformations for high performance in AWS Redshift, PostgreSQL, and SQL Server. Perform data analysis and troubleshooting to identify and resolve ETL issues. Work closely with cross-functional teams to support data-driven projects and improve existing ETL workflows. Implement best practices for data governance, security, and compliance in all ETL processes. Mentor junior team members and provide guidance on best ETL practices.
Key Requirements:
Experience: Minimum 7+ years of hands-on experience in ETL development, with a focus on AWS Glue/PySpark, AWS Step Function, Redshift, PostgreSQL, and SQL Server. Expertise in AWS: Strong experience with AWS services, especially Redshift, Lambda, S3, and RDS. Strong SLACK skills Python Programming: Proficiency in Python for scripting, data transformation, and automation of ETL tasks. SQL Skills: Deep understanding of SQL query optimization, stored procedures, and database design. Data
Analytical Skills: Experience in analyzing the data, finding the root cause for any data anomalies, fixing and demonstrating to the business. Problem Solving: Excellent problem-solving skills with a track record of resolving complex technical issues in data engineering and ETL workflows. Tools & Technologies: Familiarity with ETL tools (e.g.,
AWS Glue, Step Function, Lambda ) and version control systems (e.g., Git). Analytical Mindset : Strong attention to detail with the ability to analyze data and improve data quality. Communication: Excellent verbal and written communication skills, with the ability to convey technical concepts to non-technical stakeholders. Health Care Experience: Resources with health care experience especially with any of the EHR systems
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Must have: Strong SQL Development, PySpark, AWS Glue and Healthcare domain exp in recent
Job Overview : We are looking for a highly skilled and experienced Senior Data Engineer to join our team . The ideal candidate will have extensive experience in AWS Redshift, PostgreSQL, SQL Server, Git, AWS Glue, Spark, Slack and Python. You will be responsible for designing, developing, and maintaining complex ETL processes that enable smooth and efficient data integration, transformation, and loading across multiple systems. You should have excellent problem-solving skills and be able to work both independently and collaboratively within a dynamic environment.
Key Responsibilities:
Design, develop, and optimize ETL pipelines to support data integration between diverse data sources, including AWS Glue/PySpark, Redshift, PostgreSQL, and SQL Server. Collaborate with business stakeholders and data engineers to gather requirements, define data workflows, and ensure alignment with business goals. Develop Python scripts to automate ETL processes, enhance data workflows, and solve complex data challenges. Ensure data quality, integrity, and reliability throughout all stages of the ETL process. Optimize database queries and data transformations for high performance in AWS Redshift, PostgreSQL, and SQL Server. Perform data analysis and troubleshooting to identify and resolve ETL issues. Work closely with cross-functional teams to support data-driven projects and improve existing ETL workflows. Implement best practices for data governance, security, and compliance in all ETL processes. Mentor junior team members and provide guidance on best ETL practices.
Key Requirements:
Experience: Minimum 7+ years of hands-on experience in ETL development, with a focus on AWS Glue/PySpark, AWS Step Function, Redshift, PostgreSQL, and SQL Server. Expertise in AWS: Strong experience with AWS services, especially Redshift, Lambda, S3, and RDS. Strong SLACK skills Python Programming: Proficiency in Python for scripting, data transformation, and automation of ETL tasks. SQL Skills: Deep understanding of SQL query optimization, stored procedures, and database design. Data
Analytical Skills: Experience in analyzing the data, finding the root cause for any data anomalies, fixing and demonstrating to the business. Problem Solving: Excellent problem-solving skills with a track record of resolving complex technical issues in data engineering and ETL workflows. Tools & Technologies: Familiarity with ETL tools (e.g.,
AWS Glue, Step Function, Lambda ) and version control systems (e.g., Git). Analytical Mindset : Strong attention to detail with the ability to analyze data and improve data quality. Communication: Excellent verbal and written communication skills, with the ability to convey technical concepts to non-technical stakeholders. Health Care Experience: Resources with health care experience especially with any of the EHR systems
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.