QSS Inc
Software Engineer Senior I (Databricks Engineer) Secret Clearance Required
QSS Inc, Virginia, Minnesota, United States, 55792
Overview
Software Engineer Senior I (Databricks Engineer) with Secret clearance is sought to support the migration of mission-critical legacy applications, services, and platforms into a next-generation Medallion Model on Databricks. This role focuses on modernizing enterprise data systems that impact national mission success in a fast-paced, collaborative environment. Job Details Location:
Dulles, VA Clearance:
Secret (Must be able to obtain TS/SCI and DHS Suitability) Company:
Quantum Science Solutions (QSS) Position:
Software Engineer Senior I (Databricks Engineer) Responsibilities
Support migration of services, applications, and platforms from legacy back-end systems to Databricks. Identify optimal migration paths, build detailed plans, and execute migration strategies. Migrate legacy pipelines from NiFi to Databricks and perform validation. Implement the Medallion Model for all migrated data assets. Develop Standard Operating Procedures (SOPs) for integrating data assets into Databricks with a focus on efficiency, instrumentation, and performance. Optimize development, testing, monitoring, and security processes for data assets. Automate and optimize data ingestion, pipeline orchestration, and management using programming and scripting languages. Leverage AWS CloudWatch and related tools to enhance transparency and monitor pipeline performance. Ensure team SOPs are documented and communicated effectively. Provide technical oversight to ensure correctness, timeliness, and quality of deliverables. Communicate effectively with all levels of management and customer stakeholders. Required Qualifications
Must be a U.S. Citizen. Active Secret clearance, with ability to obtain TS/SCI and DHS Suitability. 8+ years of directly relevant software development experience. Minimum of 5 years performing data engineering in a cloud environment. Hands-on experience with relational, NoSQL, and file-based storage (Databricks, Elastic, Postgres, S3, Athena). Strong background in CI/CD pipeline development. Working knowledge of Databricks, NiFi, AWS Redshift, and Elasticsearch. Preferred Skills
Databricks Workflows, Unity Catalog, Autoloader, Delta Live Tables/Delta Lake, Workspaces/Notebooks, and MLflow. Apache Spark expertise. Familiarity with AWS Professional certifications (Solutions Architect, Developer, Data Engineer). Knowledge of CISA best practices, software supply chain security, and NIST SP 800-218. Experience with collaboration tools including MS Teams, Outlook, SharePoint, and Confluence. Excellent problem-solving and communication skills. Education
Bachelors degree in software engineering, Computer Science, or related discipline. In lieu of degree, 10 additional years of experience (total of 18+ years) may be substituted. Benefits
Competitive compensation with annual performance bonuses 401(k) with company match Opportunities for continuous learning and skill development Why QSS?
At QSS, youre not just filling a role, youre shaping mission-critical solutions that keep our nation secure. We invest in your growth, foster innovation, and reward technical excellence. #J-18808-Ljbffr
Software Engineer Senior I (Databricks Engineer) with Secret clearance is sought to support the migration of mission-critical legacy applications, services, and platforms into a next-generation Medallion Model on Databricks. This role focuses on modernizing enterprise data systems that impact national mission success in a fast-paced, collaborative environment. Job Details Location:
Dulles, VA Clearance:
Secret (Must be able to obtain TS/SCI and DHS Suitability) Company:
Quantum Science Solutions (QSS) Position:
Software Engineer Senior I (Databricks Engineer) Responsibilities
Support migration of services, applications, and platforms from legacy back-end systems to Databricks. Identify optimal migration paths, build detailed plans, and execute migration strategies. Migrate legacy pipelines from NiFi to Databricks and perform validation. Implement the Medallion Model for all migrated data assets. Develop Standard Operating Procedures (SOPs) for integrating data assets into Databricks with a focus on efficiency, instrumentation, and performance. Optimize development, testing, monitoring, and security processes for data assets. Automate and optimize data ingestion, pipeline orchestration, and management using programming and scripting languages. Leverage AWS CloudWatch and related tools to enhance transparency and monitor pipeline performance. Ensure team SOPs are documented and communicated effectively. Provide technical oversight to ensure correctness, timeliness, and quality of deliverables. Communicate effectively with all levels of management and customer stakeholders. Required Qualifications
Must be a U.S. Citizen. Active Secret clearance, with ability to obtain TS/SCI and DHS Suitability. 8+ years of directly relevant software development experience. Minimum of 5 years performing data engineering in a cloud environment. Hands-on experience with relational, NoSQL, and file-based storage (Databricks, Elastic, Postgres, S3, Athena). Strong background in CI/CD pipeline development. Working knowledge of Databricks, NiFi, AWS Redshift, and Elasticsearch. Preferred Skills
Databricks Workflows, Unity Catalog, Autoloader, Delta Live Tables/Delta Lake, Workspaces/Notebooks, and MLflow. Apache Spark expertise. Familiarity with AWS Professional certifications (Solutions Architect, Developer, Data Engineer). Knowledge of CISA best practices, software supply chain security, and NIST SP 800-218. Experience with collaboration tools including MS Teams, Outlook, SharePoint, and Confluence. Excellent problem-solving and communication skills. Education
Bachelors degree in software engineering, Computer Science, or related discipline. In lieu of degree, 10 additional years of experience (total of 18+ years) may be substituted. Benefits
Competitive compensation with annual performance bonuses 401(k) with company match Opportunities for continuous learning and skill development Why QSS?
At QSS, youre not just filling a role, youre shaping mission-critical solutions that keep our nation secure. We invest in your growth, foster innovation, and reward technical excellence. #J-18808-Ljbffr