Pacific Northwest National Laboratory
Data Engineer 2 - MLOps
Pacific Northwest National Laboratory, Seattle, Washington, us, 98127
Overview
At PNNL, our core capabilities are divided among major departments that we refer to as Directorates within the Lab, focused on a specific area of scientific research or other function, with its own leadership team and dedicated budget. Our Science & Technology directorates include National Security, Earth and Biological Sciences, Physical and Computational Sciences, and Energy and Environment. In addition, we have an Environmental Molecular Sciences Laboratory, a Department of Energy, Office of Science user facility housed on the PNNL campus.
The National Security Directorate (NSD) drives science‑based, mission‑focused solutions to take on complex, real‑world threats to our nation and the world. The AI and Data Analytics Division (AIDA), part of the National Security Directorate, combines profound domain expertise and creative integration of advanced hardware and software to deliver computational solutions that address complex data and analytic challenges. Working in multidisciplinary teams, we connect foundational research to engineering to operations, providing the tools to innovate quickly and field results faster. Our strengths are integrated across the data analytics lifecycle, from data acquisition and management to analysis and decision support.
Responsibilities AIDA’s Operational Readiness and Enablement (ORE) Team is looking for a Data Engineer (MLOps) to help play a crucial role in developing cutting‑edge software, scalable data architecture & pipelines, and AI/ML solutions in support of some of the nation’s biggest and most complex challenges.
Key Responsibilities
Identify mission challenges and methodically formulate engineering solutions
Demonstrate software engineering excellence and deliver high‑quality results at scale
Develop software using a high‑level programming language such as Python
Apply strong design principles and innovative problem‑solving skills to complex technical challenges
Stay current on advancements in data management and database technologies
Take initiative in setting and pursuing personal goals and professional growth
Mentor and support the development of junior scientists and engineers
Communicate effectively, both verbally and in writing, and collaborate successfully in a team environment
How We Work
Mission‑Critical Development
Design, develop, test, and deploy software applications that directly contribute to the nation’s mission objectives.
Collaborate with Government and Industry partners to understand mission needs, requirements, and translate them into robust and scalable software solutions.
Innovative Problem Solving
Tackle complex technical challenges with creativity and innovation.
Propose and implement solutions that go beyond conventional approaches, ensuring the software we deliver is both efficient and impactful.
End‑to‑End Ownership
Take ownership of the entire software development lifecycle, from initial concept to deployment.
Ensure the reliability, security, and performance of mission‑critical software systems.
Collaborative Teamwork
Work in an agile environment with multidisciplinary teams, including software engineers, cloud engineers, machine learning engineers, data scientists/domain experts, UX/UI, front‑end developers, scrum masters, product owners, and most importantly, USERS.
Participate in code reviews and knowledge‑sharing sessions to enhance the overall team skill set.
Continuous Learning
Stay up‑to‑date with industry trends and emerging technologies to bring innovative ideas to the table.
Actively participate in training and development opportunities to enhance your skills and contribute to the team’s growth.
Have opportunities to attend conferences and engage in industry events.
Technologies We Use
Programming & Scripting - Python, C#/.Net, Bash, PowerShell, JavaScript, TypeScript, Java, C/C++
Platforms - AWS, Azure, On‑Prem, IoT/ICS, GCP
Development/Lifecycle - Agile/Scrum/Kanban, GitLab/Atlassian, CI/CD & DevSecOps
Paradigms - Rapid prototypes with ad‑hoc CSP managed services, well‑architected solutions using Infrastructure as Code, compliant deployments in highly‑regulated environments
Data & Storage - S3, Athena, PostgreSQL, Elasticsearch/OpenSearch, Dynamo, Redshift, MongoDB, DataBricks, Apache Spark
Data Complexities
Volume - large, terabytes and petabytes of data
Variety - Images, audio, text, IoT, RF, GPS, edge sensors
Velocity - sub‑second and lower frequency
National Interest Project Examples
Detect and prevent smuggling of drugs and contraband at ports of entry
Develop large data pipelines to thwart funding for terrorists, nuclear proliferators, drug cartels, and rogue leaders
Applying big data solutions to national security problems
Develop capabilities for scalable geospatial analytics
Use remotely sensed imagery to identify and monitor the progression of wildfires
Analyze the resiliency of the electric power grid to prevent large‑scale outages
Optimize building efficiency using IoT and ICs data with automated demand‑response markets
Model climate change and impacts to civilization
Hunt for the existence of dark matter to understand the nature of the universe
This position is based in either Richland, WA or Seattle, WA and requires an onsite presence.
Minimum Qualifications
PhD OR
MS/MA OR
BS/BA and 2 years of relevant experience
Preferred Qualifications
Degree in computer science, software engineering, or related field
2+ years of experience in designing or deploying large‑scale and high‑performance ETL and ELT pipelines and analytics
2+ years Python or other software development experience
Strong understanding of software engineering and data management best practices
Strong cloud architecture and implementation experience
Cloud and database certifications
Familiar with machine learning algorithms with hands‑on experience in machine learning pipeline development
Active Q Clearance and ability to maintain such clearance
Hazardous Working Conditions/Environment: Not applicable.
Additional Information: This position requires the ability to obtain and maintain a federal security clearance. A security clearance background investigation includes review of your employment, education, financial, and criminal history, as well as interviews with you and your personal references, neighbors, and co‑workers to determine trustworthiness, reliability, and loyalty to the United States. The investigation also examines your foreign connections, drug and alcohol use, foreign influence, and overall conduct.
Requirements
U.S. Citizenship
Background Investigation: Applicants selected will be subject to a Federal background investigation and must meet eligibility requirements for access to classified matter in accordance with 10 CFR 710, Appendix B.
Drug Testing: All Security Clearance positions are Testing Designated Positions, which means that the applicant selected for hire is subject to pre‑employment drug testing, and post‑employment random drug testing. Applicants must be able to demonstrate non‑use of illegal drugs, including marijuana, for the 12 consecutive months preceding completion of the requisite Questionnaire for National Security Positions (QNSP).
Note: Applicants will be considered ineligible for security clearance processing by the U.S. Department of Energy if non‑use of illegal drugs, including marijuana, for 12 months cannot be demonstrated.
This position is a Testing Designated Position (TDP). The candidate selected for this position will be subject to pre‑employment and random drug testing for illegal drugs, including marijuana, consistent with the Controlled Substances Act and the PNNL Workplace Substance Abuse Program.
About PNNL Pacific Northwest National Laboratory (PNNL) is a world‑class research institution powered by a highly educated, diverse workforce committed to the values of Integrity, Creativity, Collaboration, Impact, and Courage. Every year, scores of dynamic, driven people come to PNNL to work with renowned researchers on meaningful science, innovations and outcomes for the U.S. Department of Energy and other sponsors. PNNL offers an exciting research environment and excellent benefits, including health insurance and flexible work schedules. PNNL is located in eastern Washington State, known for its stellar outdoor recreation and affordable cost of living.
Commitment to Excellence and Equal Employment Opportunity Our laboratory is committed to fostering a work environment where all individuals are treated with fairness and respect while solving critical challenges in fundamental sciences, national security, and energy resiliency. We are an Equal Employment Opportunity employer. We also provide reasonable accommodations for individuals with disabilities and disabled veterans. For foreign national candidates, certain eligibility requirements apply as described.
#J-18808-Ljbffr
The National Security Directorate (NSD) drives science‑based, mission‑focused solutions to take on complex, real‑world threats to our nation and the world. The AI and Data Analytics Division (AIDA), part of the National Security Directorate, combines profound domain expertise and creative integration of advanced hardware and software to deliver computational solutions that address complex data and analytic challenges. Working in multidisciplinary teams, we connect foundational research to engineering to operations, providing the tools to innovate quickly and field results faster. Our strengths are integrated across the data analytics lifecycle, from data acquisition and management to analysis and decision support.
Responsibilities AIDA’s Operational Readiness and Enablement (ORE) Team is looking for a Data Engineer (MLOps) to help play a crucial role in developing cutting‑edge software, scalable data architecture & pipelines, and AI/ML solutions in support of some of the nation’s biggest and most complex challenges.
Key Responsibilities
Identify mission challenges and methodically formulate engineering solutions
Demonstrate software engineering excellence and deliver high‑quality results at scale
Develop software using a high‑level programming language such as Python
Apply strong design principles and innovative problem‑solving skills to complex technical challenges
Stay current on advancements in data management and database technologies
Take initiative in setting and pursuing personal goals and professional growth
Mentor and support the development of junior scientists and engineers
Communicate effectively, both verbally and in writing, and collaborate successfully in a team environment
How We Work
Mission‑Critical Development
Design, develop, test, and deploy software applications that directly contribute to the nation’s mission objectives.
Collaborate with Government and Industry partners to understand mission needs, requirements, and translate them into robust and scalable software solutions.
Innovative Problem Solving
Tackle complex technical challenges with creativity and innovation.
Propose and implement solutions that go beyond conventional approaches, ensuring the software we deliver is both efficient and impactful.
End‑to‑End Ownership
Take ownership of the entire software development lifecycle, from initial concept to deployment.
Ensure the reliability, security, and performance of mission‑critical software systems.
Collaborative Teamwork
Work in an agile environment with multidisciplinary teams, including software engineers, cloud engineers, machine learning engineers, data scientists/domain experts, UX/UI, front‑end developers, scrum masters, product owners, and most importantly, USERS.
Participate in code reviews and knowledge‑sharing sessions to enhance the overall team skill set.
Continuous Learning
Stay up‑to‑date with industry trends and emerging technologies to bring innovative ideas to the table.
Actively participate in training and development opportunities to enhance your skills and contribute to the team’s growth.
Have opportunities to attend conferences and engage in industry events.
Technologies We Use
Programming & Scripting - Python, C#/.Net, Bash, PowerShell, JavaScript, TypeScript, Java, C/C++
Platforms - AWS, Azure, On‑Prem, IoT/ICS, GCP
Development/Lifecycle - Agile/Scrum/Kanban, GitLab/Atlassian, CI/CD & DevSecOps
Paradigms - Rapid prototypes with ad‑hoc CSP managed services, well‑architected solutions using Infrastructure as Code, compliant deployments in highly‑regulated environments
Data & Storage - S3, Athena, PostgreSQL, Elasticsearch/OpenSearch, Dynamo, Redshift, MongoDB, DataBricks, Apache Spark
Data Complexities
Volume - large, terabytes and petabytes of data
Variety - Images, audio, text, IoT, RF, GPS, edge sensors
Velocity - sub‑second and lower frequency
National Interest Project Examples
Detect and prevent smuggling of drugs and contraband at ports of entry
Develop large data pipelines to thwart funding for terrorists, nuclear proliferators, drug cartels, and rogue leaders
Applying big data solutions to national security problems
Develop capabilities for scalable geospatial analytics
Use remotely sensed imagery to identify and monitor the progression of wildfires
Analyze the resiliency of the electric power grid to prevent large‑scale outages
Optimize building efficiency using IoT and ICs data with automated demand‑response markets
Model climate change and impacts to civilization
Hunt for the existence of dark matter to understand the nature of the universe
This position is based in either Richland, WA or Seattle, WA and requires an onsite presence.
Minimum Qualifications
PhD OR
MS/MA OR
BS/BA and 2 years of relevant experience
Preferred Qualifications
Degree in computer science, software engineering, or related field
2+ years of experience in designing or deploying large‑scale and high‑performance ETL and ELT pipelines and analytics
2+ years Python or other software development experience
Strong understanding of software engineering and data management best practices
Strong cloud architecture and implementation experience
Cloud and database certifications
Familiar with machine learning algorithms with hands‑on experience in machine learning pipeline development
Active Q Clearance and ability to maintain such clearance
Hazardous Working Conditions/Environment: Not applicable.
Additional Information: This position requires the ability to obtain and maintain a federal security clearance. A security clearance background investigation includes review of your employment, education, financial, and criminal history, as well as interviews with you and your personal references, neighbors, and co‑workers to determine trustworthiness, reliability, and loyalty to the United States. The investigation also examines your foreign connections, drug and alcohol use, foreign influence, and overall conduct.
Requirements
U.S. Citizenship
Background Investigation: Applicants selected will be subject to a Federal background investigation and must meet eligibility requirements for access to classified matter in accordance with 10 CFR 710, Appendix B.
Drug Testing: All Security Clearance positions are Testing Designated Positions, which means that the applicant selected for hire is subject to pre‑employment drug testing, and post‑employment random drug testing. Applicants must be able to demonstrate non‑use of illegal drugs, including marijuana, for the 12 consecutive months preceding completion of the requisite Questionnaire for National Security Positions (QNSP).
Note: Applicants will be considered ineligible for security clearance processing by the U.S. Department of Energy if non‑use of illegal drugs, including marijuana, for 12 months cannot be demonstrated.
This position is a Testing Designated Position (TDP). The candidate selected for this position will be subject to pre‑employment and random drug testing for illegal drugs, including marijuana, consistent with the Controlled Substances Act and the PNNL Workplace Substance Abuse Program.
About PNNL Pacific Northwest National Laboratory (PNNL) is a world‑class research institution powered by a highly educated, diverse workforce committed to the values of Integrity, Creativity, Collaboration, Impact, and Courage. Every year, scores of dynamic, driven people come to PNNL to work with renowned researchers on meaningful science, innovations and outcomes for the U.S. Department of Energy and other sponsors. PNNL offers an exciting research environment and excellent benefits, including health insurance and flexible work schedules. PNNL is located in eastern Washington State, known for its stellar outdoor recreation and affordable cost of living.
Commitment to Excellence and Equal Employment Opportunity Our laboratory is committed to fostering a work environment where all individuals are treated with fairness and respect while solving critical challenges in fundamental sciences, national security, and energy resiliency. We are an Equal Employment Opportunity employer. We also provide reasonable accommodations for individuals with disabilities and disabled veterans. For foreign national candidates, certain eligibility requirements apply as described.
#J-18808-Ljbffr