Resource Informatics Group
Hi,
The following requirement is open with our client.
\Job Title : Data Engineer
Location : Malvern, PA (3 days onsite)
Duration : 12+ Months
In-person interview
Job Description: We are seeking a skilled Data Engineer to join our team on a contract basis through the end of the year. In this role, you will design and implement scalable data pipelines and cloud-based solutions using AWS technologies to support analytics, reporting, and operational decision-making.
Key Responsibilities
Design and implement scalable data pipelines using AWS Glue, Apache Spark, AWS Athena, AWS S3, AWS Lambda, and related services. (10%) Integrate large-scale datasets from diverse internal and external sources to support business intelligence and analytics. (10%) Ensure pipeline security and performance within a cloud-based data architecture. (10%) Translate business requirements into technical specifications and data engineering solutions. (10%) Develop and maintain SQL queries, stored procedures, and scripts for reporting and data validation. (10%) Write clean, reusable, and well-documented code following best practices in software engineering. (10%) Collaborate with cross-functional teams including data scientists, analysts, and product owners. (10%) Conduct data validation and cleansing to improve data quality and resolve inconsistencies. (10%) Provide technical consultation and data analysis to stakeholders. (5%) Contribute to enterprise data standards and policies including performance benchmarks and security. (5%) Test and deploy software enhancements using formal regression testing methodologies. (5%) Participate in special projects and perform additional responsibilities as needed. (5%)
Required Qualifications
Bachelor's degree in Computer Science, Information Systems, or a related field. Proven experience with AWS data services (Glue, Lambda, Athena, S3). Strong proficiency in SQL, Apache Spark, and data pipeline development. Experience with data integration, validation, and cleansing techniques. Ability to work collaboratively in cross-functional teams. Excellent problem-solving and communication skills.
Preferred Skills
Experience with data governance, security policies, and performance optimization. Familiarity with automated workflows and CI/CD pipelines. Knowledge of business intelligence tools and data visualization platforms.
In-person interview
Job Description: We are seeking a skilled Data Engineer to join our team on a contract basis through the end of the year. In this role, you will design and implement scalable data pipelines and cloud-based solutions using AWS technologies to support analytics, reporting, and operational decision-making.
Key Responsibilities
Design and implement scalable data pipelines using AWS Glue, Apache Spark, AWS Athena, AWS S3, AWS Lambda, and related services. (10%) Integrate large-scale datasets from diverse internal and external sources to support business intelligence and analytics. (10%) Ensure pipeline security and performance within a cloud-based data architecture. (10%) Translate business requirements into technical specifications and data engineering solutions. (10%) Develop and maintain SQL queries, stored procedures, and scripts for reporting and data validation. (10%) Write clean, reusable, and well-documented code following best practices in software engineering. (10%) Collaborate with cross-functional teams including data scientists, analysts, and product owners. (10%) Conduct data validation and cleansing to improve data quality and resolve inconsistencies. (10%) Provide technical consultation and data analysis to stakeholders. (5%) Contribute to enterprise data standards and policies including performance benchmarks and security. (5%) Test and deploy software enhancements using formal regression testing methodologies. (5%) Participate in special projects and perform additional responsibilities as needed. (5%)
Required Qualifications
Bachelor's degree in Computer Science, Information Systems, or a related field. Proven experience with AWS data services (Glue, Lambda, Athena, S3). Strong proficiency in SQL, Apache Spark, and data pipeline development. Experience with data integration, validation, and cleansing techniques. Ability to work collaboratively in cross-functional teams. Excellent problem-solving and communication skills.
Preferred Skills
Experience with data governance, security policies, and performance optimization. Familiarity with automated workflows and CI/CD pipelines. Knowledge of business intelligence tools and data visualization platforms.