Accord Technologies Inc
Senior AWS Data Engineer
Accord Technologies Inc, Rock Hill, South Carolina, United States, 29732
Overview
Fort Mills, SC (Hybrid 3 days a week). Position type: W2 contract. Job Summary Contribute to building state-of-the-art data platforms in AWS, leveraging Python and Spark. This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with cutting-edge technologies. You will design, implement, and optimize ETL workflows using Python and Spark, contributing to our robust data Lakehouse architecture on AWS. Success in this role requires technical expertise, strong problem-solving skills, and the ability to collaborate effectively within an agile team. Responsibilities
Provide guidance on best practices in design, development, and implementation, ensuring solutions meet business requirements and technical standards. Work closely with architects, Product Owners, and development team members to decompose solutions into Epics, leading design and planning of these components. Drive the migration of existing data processing workflows to the Lakehouse architecture, leveraging Iceberg capabilities. Communicate complex technical information clearly, tailoring messages to the appropriate audience to ensure alignment. Must Have Tech Skills
Demonstrable experience as a senior data engineer. Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices. Experience implementing data pipelines using AWS EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena. Experience with data services in a Lakehouse architecture. Key Skills
Deep technical knowledge of data engineering solutions and practices. Implementation of data pipelines using AWS data services and Lakehouse capabilities. Highly proficient in Python and Spark; familiarity with a variety of development technologies to adapt solutions to project-specific needs. Skilled in decomposing solutions into components (Epics, stories) to streamline development. Proficient in creating clear, comprehensive documentation to support knowledge sharing and compliance. Proficient in quality assurance practices, including code reviews, automated testing, and data validation. Experience leveraging automation tools and CI/CD pipelines to streamline development, testing, and deployment. Educational Background
Bachelors degree in computer science, Software Engineering, or related field required. Must Have
Financial Services expertise, working with Equity and Fixed Income asset classes and a working knowledge of Indices. Nice To Have Tech Skills
Experience in solution architecture and technical design for scalable, reliable data architectures. Masters degree or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous. Seniority
Mid-Senior level Employment Type
Contract Job Function
Information Technology Notes: This posting has been streamlined to remove boilerplate content not relevant to the role. EEO and compliance information should be provided as required by law. #J-18808-Ljbffr
Fort Mills, SC (Hybrid 3 days a week). Position type: W2 contract. Job Summary Contribute to building state-of-the-art data platforms in AWS, leveraging Python and Spark. This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with cutting-edge technologies. You will design, implement, and optimize ETL workflows using Python and Spark, contributing to our robust data Lakehouse architecture on AWS. Success in this role requires technical expertise, strong problem-solving skills, and the ability to collaborate effectively within an agile team. Responsibilities
Provide guidance on best practices in design, development, and implementation, ensuring solutions meet business requirements and technical standards. Work closely with architects, Product Owners, and development team members to decompose solutions into Epics, leading design and planning of these components. Drive the migration of existing data processing workflows to the Lakehouse architecture, leveraging Iceberg capabilities. Communicate complex technical information clearly, tailoring messages to the appropriate audience to ensure alignment. Must Have Tech Skills
Demonstrable experience as a senior data engineer. Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices. Experience implementing data pipelines using AWS EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena. Experience with data services in a Lakehouse architecture. Key Skills
Deep technical knowledge of data engineering solutions and practices. Implementation of data pipelines using AWS data services and Lakehouse capabilities. Highly proficient in Python and Spark; familiarity with a variety of development technologies to adapt solutions to project-specific needs. Skilled in decomposing solutions into components (Epics, stories) to streamline development. Proficient in creating clear, comprehensive documentation to support knowledge sharing and compliance. Proficient in quality assurance practices, including code reviews, automated testing, and data validation. Experience leveraging automation tools and CI/CD pipelines to streamline development, testing, and deployment. Educational Background
Bachelors degree in computer science, Software Engineering, or related field required. Must Have
Financial Services expertise, working with Equity and Fixed Income asset classes and a working knowledge of Indices. Nice To Have Tech Skills
Experience in solution architecture and technical design for scalable, reliable data architectures. Masters degree or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous. Seniority
Mid-Senior level Employment Type
Contract Job Function
Information Technology Notes: This posting has been streamlined to remove boilerplate content not relevant to the role. EEO and compliance information should be provided as required by law. #J-18808-Ljbffr