BLACK CAPE LLC
Spectacular Data Engineering Lead (**Mid Level and Above)
BLACK CAPE LLC, Falls Church, Virginia, United States, 22042
Overview
Black Cape Job Title
Data Engineering Lead Location
Arlington, Falls Church, Crystal City, Alexandria or Pentagon, VA Employment Type
Full-time ONSITE: Ability to go ONSITE Up to 2-5 days per week (depending on customer needs) Clearance
Active TS/SCI required - no CI Poly but need to be willing to get one MUST HAVE an Active TS/SCI Clearance Need to be OPEN to sitting for a CI Poly Be able to flex in and out of SCIFs at Pentagon, Crystal City, Alexandria and Falls Church About the Project
We are delivering a large-scale data platform initiative for a DoD client, involving a 50-person cross-functional team of data engineers, BI developers, product owners, and domain experts. Our infrastructure is built on Databricks for data processing and transformation, and Qlik for analytics and reporting. We are seeking a Data Engineering Lead to lead the data engineering workstreamensuring high-quality, scalable, and efficient data solutions that enable timely insights and business decision-making. Role Overview
The Data Engineering Lead will oversee the design, development, and maintenance of the projects data pipelines, data models, and integrations. This role involves both technical leadership and people managementguiding a team of engineers, setting priorities, and ensuring successful delivery in alignment with the projects goals and timelines. We are expanding and need to hire motivated data engineers to help build innovative solutions for our customers. The ideal candidate needs limited direction and to be passionate about technology. A willingness and desire to pick up new technologies or languages quickly is a must. Our team builds and deploys cutting-edge AI and Machine Learning applications that directly support national security missions. We leverage the Databricks platform for advanced data science and engineering, and transform complex model outputs into compelling, interactive dashboards using Qlik. These solutions are built to empower 19 key Principal Staff members (Senior Executive Service members and General Officers) within the Office of the Undersecretary of Defense (OUSD) and the Intelligence community. Our products provide them with the critical, data-driven insights needed for strategic decision-making. Our work is grounded in successful deployments on JWICS, NIPR, SIPR utilizing AWS, combining commercial best practices in an Agile environment to ensure we deliver impactful capabilities to senior defense leadership. Key Responsibilities
Leadership & Management
Lead and manage a team of Data Engineers working on Databricks-based data processing workflows Coordinate closely with developers, Qlik specialists, and other project leads to align technical outputs with reporting requirements Oversee sprint planning, backlog management, and milestone tracking Mentor engineers and promote best practices for coding, testing, and deployment Technical Oversight
Design and maintain scalable data pipelines using Databricks Ensure data quality, lineage, and governance across ingestion, transformation, and consumption layers Optimize Databricks clusters and jobs for performance and cost efficiency Integrate with Qlik data models to ensure seamless dashboard performance Collaboration & Stakeholder Engagement
Work with project managers to define scope, deliverables, and timelines Partner with product owners and Qlik developers to ensure transformed data meets analytical needs Act as a technical point of contact for client stakeholders, communicating risks, trade-offs, and progress Quality & Compliance
Implement robust testing and validation for all data pipelines Ensure compliance with data security and privacy requirements Maintain documentation for data flows, transformations, and system dependencies Qualifications
Required (MUST HAVES) 5+ years in data engineering, with at least 2 years in a team lead or manager role Hands-on experience with Databricks Strong knowledge of data modeling and transformation for BI tools, preferably Qlik. Tableau would be acceptable Proficiency in cloud platforms (AWS preferred); if no AWS experience, Azure or GCP experience considered Track record of delivering complex data projects on time and within budget Experience managing data engineering workstreams in a multi-team project (35+ people) Familiarity with CI/CD for data workflows and version control (e.g., Git) Working knowledge with JIRA and Confluence; some previous experience preferred Experience working in an Agile delivery in a data project context Customer-interfacing experience in the Federal sector preferred; working professionally across many cross-functional teams Team Player ALL THE WAY! Preferred (NICE to HAVES) Experience managing data engineering workstreams in a multi-team project (60+ people) Experience with Jupyter Notebooks or familiarity with it What We Offer
Opportunity to lead a high-impact project with modern data infrastructure Work alongside a skilled, multidisciplinary team Autonomy for leaders; Black Cape offers significant freedom and support About the Company
Want to be part of a loyal, intelligent, talented, dynamic and fun team from the ground up and help build something GREAT? We work with the Intelligence Community and Department of Defense to accomplish their goals. Come join us in creating cloud-native web applications, advanced data analysis tools, and new machine learning capabilities. Be part of a team making an impact on the world and its safety while having fun. Black Cape provides full-stack software development and software integration capabilities for traditional, cloud, and hybrid-cloud environments. We are doing AI technology, machine learning and cloud technology that will impact the greater good and the worlds safety. CONTACT: recruiting@blackcape.io Great Benefits | 401K | Competitive Salary | Generous Time Off | Mentorship & Professional Development Programs | Tuition Reimbursement #J-18808-Ljbffr
Black Cape Job Title
Data Engineering Lead Location
Arlington, Falls Church, Crystal City, Alexandria or Pentagon, VA Employment Type
Full-time ONSITE: Ability to go ONSITE Up to 2-5 days per week (depending on customer needs) Clearance
Active TS/SCI required - no CI Poly but need to be willing to get one MUST HAVE an Active TS/SCI Clearance Need to be OPEN to sitting for a CI Poly Be able to flex in and out of SCIFs at Pentagon, Crystal City, Alexandria and Falls Church About the Project
We are delivering a large-scale data platform initiative for a DoD client, involving a 50-person cross-functional team of data engineers, BI developers, product owners, and domain experts. Our infrastructure is built on Databricks for data processing and transformation, and Qlik for analytics and reporting. We are seeking a Data Engineering Lead to lead the data engineering workstreamensuring high-quality, scalable, and efficient data solutions that enable timely insights and business decision-making. Role Overview
The Data Engineering Lead will oversee the design, development, and maintenance of the projects data pipelines, data models, and integrations. This role involves both technical leadership and people managementguiding a team of engineers, setting priorities, and ensuring successful delivery in alignment with the projects goals and timelines. We are expanding and need to hire motivated data engineers to help build innovative solutions for our customers. The ideal candidate needs limited direction and to be passionate about technology. A willingness and desire to pick up new technologies or languages quickly is a must. Our team builds and deploys cutting-edge AI and Machine Learning applications that directly support national security missions. We leverage the Databricks platform for advanced data science and engineering, and transform complex model outputs into compelling, interactive dashboards using Qlik. These solutions are built to empower 19 key Principal Staff members (Senior Executive Service members and General Officers) within the Office of the Undersecretary of Defense (OUSD) and the Intelligence community. Our products provide them with the critical, data-driven insights needed for strategic decision-making. Our work is grounded in successful deployments on JWICS, NIPR, SIPR utilizing AWS, combining commercial best practices in an Agile environment to ensure we deliver impactful capabilities to senior defense leadership. Key Responsibilities
Leadership & Management
Lead and manage a team of Data Engineers working on Databricks-based data processing workflows Coordinate closely with developers, Qlik specialists, and other project leads to align technical outputs with reporting requirements Oversee sprint planning, backlog management, and milestone tracking Mentor engineers and promote best practices for coding, testing, and deployment Technical Oversight
Design and maintain scalable data pipelines using Databricks Ensure data quality, lineage, and governance across ingestion, transformation, and consumption layers Optimize Databricks clusters and jobs for performance and cost efficiency Integrate with Qlik data models to ensure seamless dashboard performance Collaboration & Stakeholder Engagement
Work with project managers to define scope, deliverables, and timelines Partner with product owners and Qlik developers to ensure transformed data meets analytical needs Act as a technical point of contact for client stakeholders, communicating risks, trade-offs, and progress Quality & Compliance
Implement robust testing and validation for all data pipelines Ensure compliance with data security and privacy requirements Maintain documentation for data flows, transformations, and system dependencies Qualifications
Required (MUST HAVES) 5+ years in data engineering, with at least 2 years in a team lead or manager role Hands-on experience with Databricks Strong knowledge of data modeling and transformation for BI tools, preferably Qlik. Tableau would be acceptable Proficiency in cloud platforms (AWS preferred); if no AWS experience, Azure or GCP experience considered Track record of delivering complex data projects on time and within budget Experience managing data engineering workstreams in a multi-team project (35+ people) Familiarity with CI/CD for data workflows and version control (e.g., Git) Working knowledge with JIRA and Confluence; some previous experience preferred Experience working in an Agile delivery in a data project context Customer-interfacing experience in the Federal sector preferred; working professionally across many cross-functional teams Team Player ALL THE WAY! Preferred (NICE to HAVES) Experience managing data engineering workstreams in a multi-team project (60+ people) Experience with Jupyter Notebooks or familiarity with it What We Offer
Opportunity to lead a high-impact project with modern data infrastructure Work alongside a skilled, multidisciplinary team Autonomy for leaders; Black Cape offers significant freedom and support About the Company
Want to be part of a loyal, intelligent, talented, dynamic and fun team from the ground up and help build something GREAT? We work with the Intelligence Community and Department of Defense to accomplish their goals. Come join us in creating cloud-native web applications, advanced data analysis tools, and new machine learning capabilities. Be part of a team making an impact on the world and its safety while having fun. Black Cape provides full-stack software development and software integration capabilities for traditional, cloud, and hybrid-cloud environments. We are doing AI technology, machine learning and cloud technology that will impact the greater good and the worlds safety. CONTACT: recruiting@blackcape.io Great Benefits | 401K | Competitive Salary | Generous Time Off | Mentorship & Professional Development Programs | Tuition Reimbursement #J-18808-Ljbffr