Progression Inc
*Work with Progression, Inc. get your application bumped to the front of the line* AWS Data Engineer Sterling, VA 100% Remote *Must go on site to pick up equipment* MUST: Active IRS – MBI is Required (badging could take 1-6 months without) 5+ years of Data Engineer / Software Development experience 5+ years Python and Java 5+ years with Apache Spark (Spark SQL, Spark Streaming, data transformations, performance optimization, and tuning) 5+ years experience with cloud-based data platforms (Databricks or AWS EMR) Proficiency with Git and version control best practices Experience building and maintaining high-volume data pipelines Knowledge of data modeling and ETL best practices Familiarity with SQL and NoSQL databases Understanding of data warehouse concepts and dimensional modeling Bachelor's degree in Computer Science, Engineering, or related technical field DUTIES: As a Data Engineer, you will: Design and implement scalable, production-grade data pipelines. Optimize existing data workflows for performance, reliability, and scalability. Collaborate with data scientists and analysts to meet evolving data needs. Implement data quality checks and monitoring for accuracy and consistency. Document data processes, workflows, and architectural designs. Support data modeling and ETL best practices across projects. Troubleshoot and resolve issues in high-volume data processing environments. Experience with real-time data processing and streaming architectures Knowledge of Delta Lake or similar data lakehouse technologies Experience with CI/CD pipelines for data deployments Cloud platform expertise (AWS, Azure, or GCP) Contributions to open-source projects *Progression Inc. is an affirmative action/equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, status as a protected veteran, or status as an individual with a disability.* #INDPRO