ClearanceJobs
Senior/Principal Data Engineer
At Agile Defense we know that action defines the outcome and new challenges require new solutions. That's why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next. Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility-leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation's vital interests. $22,000 - $225,000 a year Requisition #: 1046 Location: Original Headquarters Building, 1000 Colonial Farm Rd McLean, Virginia 22101 Clearance Level: Active DoD - Top Secret SCI FSP Required Certification(s): Active U.S. security clearance at Top Secret/SCI with Full Scope Poly Summary
This initiative builds and maintains a robust data-management backbone to support advanced cyber-analysis workflows. Working on-site with developers, data scientists, subject-matter experts, and analysts, the program architects scalable repositories and ETL pipelines that ingest, process, and serve large volumes of classified cyber data for real-time and batch analytics. As a Senior Data Engineer, you will design, develop, and optimize data-pipeline architectures that underpin the program's analytics platform. Partnering with cross-functional teams, you will analyze data challenges, propose cutting-edge tools, and implement solutions that ensure high performance, reliability, and maintainability of all data services. Job Duties and Responsibilities
Architect and build ETL workflows to ingest, transform, and load large datasets from disparate cyber sources. Implement and maintain scalable data-pipeline frameworks (e.g., Airflow, NiFi). Develop data-visualization dashboards to surface key metrics and insights. Design and optimize data-repository schemas for structured and unstructured data. Troubleshoot ETL failures and performance bottlenecks; implement corrective actions. Collaborate with peer engineers to establish best practices for data ingestion, storage, and retrieval. Support data-querying processes and maintain documentation for all data assets. Evaluate and integrate new data technologies (NoSQL, columnar stores, graph databases) as needed. Qualifications
Required Certifications
Active U.S. security clearance at Top Secret/SCI with Full Scope Poly Education, Background, and Years of Experience
Bachelor's degree in Computer Science, Information Systems, Engineering, or related field. 5-10 years of professional experience in data engineering or similar technical roles. Additional Skills & Qualifications
Required Skills
Proven expertise in designing and executing ETL processes on large datasets. Strong coding skills in Python, Java, or Scala for data-pipeline development. Experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra). Familiarity with data-orchestration tools (Airflow, Prefect, or equivalent). Proficiency in creating data visualizations (e.g., Tableau, Power BI, or custom dashboards). Solid understanding of data-modeling principles and repository design. Excellent problem-solving skills and attention to detail in troubleshooting data issues. Preferred Skills
Experience with cloud-based data platforms in government environments (AWS GovCloud). Knowledge of containerized deployments (Docker) and orchestration platforms (Kubernetes). Hands-on work with streaming data systems (Kafka, Kinesis). Familiarity with infrastructure as code (Terraform, CloudFormation). Working Conditions
Environmental Conditions
Full-time, on-site at a secure government facility. Regular business hours, with periodic after-hours support for pipeline deployments or incident response. Must comply with all facility security requirements and data-handling protocols. Strength Demands
Sedentary - 10 lbs. Maximum lifting, occasional lift/carry of small articles. Some occasional walking or standing may be required. Physical Requirements
Stand or Sit; Walk; Repetitive Motion; Use Hands / Fingers to Handle or Feel; Stoop, Kneel, Crouch, or Crawl; See; Push or Pull; Climb (stairs, ladders) or Balance (ascend / descend, work atop, traverse). Agile Defense's Culture
Happy
Be Infectious. Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do. Helpful
Be Supportive. Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated. Honest
Be Trustworthy. Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support. Humble
Be Grounded. Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task. Hungry
Be Eager. Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges. Hustle
Be Driven. Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success. Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
At Agile Defense we know that action defines the outcome and new challenges require new solutions. That's why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next. Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility-leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation's vital interests. $22,000 - $225,000 a year Requisition #: 1046 Location: Original Headquarters Building, 1000 Colonial Farm Rd McLean, Virginia 22101 Clearance Level: Active DoD - Top Secret SCI FSP Required Certification(s): Active U.S. security clearance at Top Secret/SCI with Full Scope Poly Summary
This initiative builds and maintains a robust data-management backbone to support advanced cyber-analysis workflows. Working on-site with developers, data scientists, subject-matter experts, and analysts, the program architects scalable repositories and ETL pipelines that ingest, process, and serve large volumes of classified cyber data for real-time and batch analytics. As a Senior Data Engineer, you will design, develop, and optimize data-pipeline architectures that underpin the program's analytics platform. Partnering with cross-functional teams, you will analyze data challenges, propose cutting-edge tools, and implement solutions that ensure high performance, reliability, and maintainability of all data services. Job Duties and Responsibilities
Architect and build ETL workflows to ingest, transform, and load large datasets from disparate cyber sources. Implement and maintain scalable data-pipeline frameworks (e.g., Airflow, NiFi). Develop data-visualization dashboards to surface key metrics and insights. Design and optimize data-repository schemas for structured and unstructured data. Troubleshoot ETL failures and performance bottlenecks; implement corrective actions. Collaborate with peer engineers to establish best practices for data ingestion, storage, and retrieval. Support data-querying processes and maintain documentation for all data assets. Evaluate and integrate new data technologies (NoSQL, columnar stores, graph databases) as needed. Qualifications
Required Certifications
Active U.S. security clearance at Top Secret/SCI with Full Scope Poly Education, Background, and Years of Experience
Bachelor's degree in Computer Science, Information Systems, Engineering, or related field. 5-10 years of professional experience in data engineering or similar technical roles. Additional Skills & Qualifications
Required Skills
Proven expertise in designing and executing ETL processes on large datasets. Strong coding skills in Python, Java, or Scala for data-pipeline development. Experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra). Familiarity with data-orchestration tools (Airflow, Prefect, or equivalent). Proficiency in creating data visualizations (e.g., Tableau, Power BI, or custom dashboards). Solid understanding of data-modeling principles and repository design. Excellent problem-solving skills and attention to detail in troubleshooting data issues. Preferred Skills
Experience with cloud-based data platforms in government environments (AWS GovCloud). Knowledge of containerized deployments (Docker) and orchestration platforms (Kubernetes). Hands-on work with streaming data systems (Kafka, Kinesis). Familiarity with infrastructure as code (Terraform, CloudFormation). Working Conditions
Environmental Conditions
Full-time, on-site at a secure government facility. Regular business hours, with periodic after-hours support for pipeline deployments or incident response. Must comply with all facility security requirements and data-handling protocols. Strength Demands
Sedentary - 10 lbs. Maximum lifting, occasional lift/carry of small articles. Some occasional walking or standing may be required. Physical Requirements
Stand or Sit; Walk; Repetitive Motion; Use Hands / Fingers to Handle or Feel; Stoop, Kneel, Crouch, or Crawl; See; Push or Pull; Climb (stairs, ladders) or Balance (ascend / descend, work atop, traverse). Agile Defense's Culture
Happy
Be Infectious. Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do. Helpful
Be Supportive. Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated. Honest
Be Trustworthy. Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support. Humble
Be Grounded. Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task. Hungry
Be Eager. Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges. Hustle
Be Driven. Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success. Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities