Progression, Inc.
AWS Data Engineer IRS MBI Clearance
Progression, Inc., Sterling, Virginia, United States, 22170
Job Description
Job Description
**
Work with Progression, Inc. get your application bumped to the front of the line
**
AWS Data Engineer (IRS - MBI Clearance)
Sterling, VA
100% Remote
Must go on site to pick up equipment
MUST:
Active IRS – MBI is Required (badging could take 1-6 months without)
5+ years of Data Engineer / Software Development experience
5+ years Python and Java
5+ years with Apache Spark (Spark SQL, Spark Streaming, data transformations, performance optimization, and tuning)
5+ years experience with cloud-based data platforms (Databricks or AWS EMR)
Proficiency with Git and version control best practices
Experience building and maintaining high-volume data pipelines
Knowledge of data modeling and ETL best practices
Familiarity with SQL and NoSQL databases
Understanding of data warehouse concepts and dimensional modeling
Bachelor's degree in Computer Science, Engineering, or related technical field
DUTIES:
As a Data Engineer, you will:
Design and implement scalable, production-grade data pipelines.
Optimize existing data workflows for performance, reliability, and scalability.
Collaborate with data scientists and analysts to meet evolving data needs.
Implement data quality checks and monitoring for accuracy and consistency.
Document data processes, workflows, and architectural designs.
Support data modeling and ETL best practices across projects.
Troubleshoot and resolve issues in high-volume data processing environments.
Experience with real-time data processing and streaming architectures
Knowledge of Delta Lake or similar data lakehouse technologies
Experience with CI/CD pipelines for data deployments
Cloud platform expertise (AWS, Azure, or GCP)
Contributions to open-source projects
Progression Inc. is an affirmative action/equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, status as a protected veteran, or status as an individual with a disability.
#INDPRO
Company Description
We staff quicker than any agency in town for a reason. Rapid responses, delivering rapid results. IT, Cyber Security, Legal, Admin & Accounting.
Company Description We staff quicker than any agency in town for a reason. Rapid responses, delivering rapid results. IT, Cyber Security, Legal, Admin & Accounting.
**
Work with Progression, Inc. get your application bumped to the front of the line
**
AWS Data Engineer (IRS - MBI Clearance)
Sterling, VA
100% Remote
Must go on site to pick up equipment
MUST:
Active IRS – MBI is Required (badging could take 1-6 months without)
5+ years of Data Engineer / Software Development experience
5+ years Python and Java
5+ years with Apache Spark (Spark SQL, Spark Streaming, data transformations, performance optimization, and tuning)
5+ years experience with cloud-based data platforms (Databricks or AWS EMR)
Proficiency with Git and version control best practices
Experience building and maintaining high-volume data pipelines
Knowledge of data modeling and ETL best practices
Familiarity with SQL and NoSQL databases
Understanding of data warehouse concepts and dimensional modeling
Bachelor's degree in Computer Science, Engineering, or related technical field
DUTIES:
As a Data Engineer, you will:
Design and implement scalable, production-grade data pipelines.
Optimize existing data workflows for performance, reliability, and scalability.
Collaborate with data scientists and analysts to meet evolving data needs.
Implement data quality checks and monitoring for accuracy and consistency.
Document data processes, workflows, and architectural designs.
Support data modeling and ETL best practices across projects.
Troubleshoot and resolve issues in high-volume data processing environments.
Experience with real-time data processing and streaming architectures
Knowledge of Delta Lake or similar data lakehouse technologies
Experience with CI/CD pipelines for data deployments
Cloud platform expertise (AWS, Azure, or GCP)
Contributions to open-source projects
Progression Inc. is an affirmative action/equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, status as a protected veteran, or status as an individual with a disability.
#INDPRO
Company Description
We staff quicker than any agency in town for a reason. Rapid responses, delivering rapid results. IT, Cyber Security, Legal, Admin & Accounting.
Company Description We staff quicker than any agency in town for a reason. Rapid responses, delivering rapid results. IT, Cyber Security, Legal, Admin & Accounting.