Danaher Corporation
AI Evaluation Engineer, Device Intelligence
Danaher Corporation, Washington, District of Columbia, us, 20022
Overview
At Danaher, our work saves lives. Every associate contributes to this mission through continuous improvement and rapid innovation. With over 63,000 associates worldwide, we operate across more than 15 unique businesses in life sciences, diagnostics, and biotechnology.
The
AI Evaluation Engineer, Device Intelligence
will be a key member of the AI Product and Imaging Innovation team, reporting to the Sr. Director. This new role is instrumental in implementing cutting‑edge AI systems that leverage data from Danaher devices to extract meaningful insights and dramatically improve user experience.
This position is remote in Europe or the Eastern United States.
Responsibilities
Define, own, and run the AI evaluation strategy for AI products in life sciences, diagnostics, and biotechnology.
Design and implement robust evaluation frameworks for agentic workflows, LLMs/NLP, computer vision, and multimodal models.
Develop and execute evaluation plans to measure performance, reliability, and safety across multimodal datasets.
Collaborate with the Sr. Director, Sr. AI Engineers, and product teams to align evaluation criteria with product KPIs and regulatory needs.
Analyze evaluation results, identify weaknesses, and recommend improvements to AI models and workflows.
Build automated pipelines for continuous evaluation and monitoring of AI systems in production.
Essential Requirements
Bachelor’s degree in Computer Science, Engineering, Data Science, or related field; MS/PhD preferred.
Proven experience designing and implementing evaluation methodologies for AI systems, including LLMs and computer vision.
Strong knowledge of metrics for AI performance, robustness, and fairness, especially in regulated domains.
Expertise in at least three of the following: benchmarking frameworks, statistical validation, synthetic data generation, adversarial testing, explainability techniques.
Proficiency in Python and ML libraries (e.g., PyTorch, TensorFlow) and familiarity with evaluation tools (e.g., OpenAI Evals, Dynabench, Promptfoo).
Ability to communicate complex evaluation results to technical and non‑technical stakeholders and influence model improvements.
Preferred Experience
Experience with regulatory processes, especially for medical devices and AI/ML‑based software as a medical device (SaMD).
Familiarity with quality management systems and standards relevant to the life sciences and diagnostics industries.
Knowledge of instrument control mechanisms and how they integrate with AI systems for enhanced automation.
Remote Work Information We recognize the benefits of flexible, remote working arrangements. This role is eligible for remote work from home in the designated regions. Further details will be provided during the interview process.
Salary and Benefits The annual salary range for this role is $150,000–$170,000, with eligibility for bonus/incentive pay. Danaher offers a comprehensive benefits package, including paid time off, medical/dental/vision insurance, and a 401(k) for eligible employees.
Equal Opportunity Employment Danaher Corporation and all Danaher Companies are committed to equal opportunity regardless of race, color, national origin, religion, sex, age, marital status, disability, veteran status, sexual orientation, gender identity, or other characteristics protected by law. We comply with federal and state disability laws and provide reasonable accommodations for applicants and employees with disabilities. For accommodations, please contact 1‑202‑419‑7762 or applyassistance@danaher.com.
The U.S. EEO posters are available here.
#J-18808-Ljbffr
The
AI Evaluation Engineer, Device Intelligence
will be a key member of the AI Product and Imaging Innovation team, reporting to the Sr. Director. This new role is instrumental in implementing cutting‑edge AI systems that leverage data from Danaher devices to extract meaningful insights and dramatically improve user experience.
This position is remote in Europe or the Eastern United States.
Responsibilities
Define, own, and run the AI evaluation strategy for AI products in life sciences, diagnostics, and biotechnology.
Design and implement robust evaluation frameworks for agentic workflows, LLMs/NLP, computer vision, and multimodal models.
Develop and execute evaluation plans to measure performance, reliability, and safety across multimodal datasets.
Collaborate with the Sr. Director, Sr. AI Engineers, and product teams to align evaluation criteria with product KPIs and regulatory needs.
Analyze evaluation results, identify weaknesses, and recommend improvements to AI models and workflows.
Build automated pipelines for continuous evaluation and monitoring of AI systems in production.
Essential Requirements
Bachelor’s degree in Computer Science, Engineering, Data Science, or related field; MS/PhD preferred.
Proven experience designing and implementing evaluation methodologies for AI systems, including LLMs and computer vision.
Strong knowledge of metrics for AI performance, robustness, and fairness, especially in regulated domains.
Expertise in at least three of the following: benchmarking frameworks, statistical validation, synthetic data generation, adversarial testing, explainability techniques.
Proficiency in Python and ML libraries (e.g., PyTorch, TensorFlow) and familiarity with evaluation tools (e.g., OpenAI Evals, Dynabench, Promptfoo).
Ability to communicate complex evaluation results to technical and non‑technical stakeholders and influence model improvements.
Preferred Experience
Experience with regulatory processes, especially for medical devices and AI/ML‑based software as a medical device (SaMD).
Familiarity with quality management systems and standards relevant to the life sciences and diagnostics industries.
Knowledge of instrument control mechanisms and how they integrate with AI systems for enhanced automation.
Remote Work Information We recognize the benefits of flexible, remote working arrangements. This role is eligible for remote work from home in the designated regions. Further details will be provided during the interview process.
Salary and Benefits The annual salary range for this role is $150,000–$170,000, with eligibility for bonus/incentive pay. Danaher offers a comprehensive benefits package, including paid time off, medical/dental/vision insurance, and a 401(k) for eligible employees.
Equal Opportunity Employment Danaher Corporation and all Danaher Companies are committed to equal opportunity regardless of race, color, national origin, religion, sex, age, marital status, disability, veteran status, sexual orientation, gender identity, or other characteristics protected by law. We comply with federal and state disability laws and provide reasonable accommodations for applicants and employees with disabilities. For accommodations, please contact 1‑202‑419‑7762 or applyassistance@danaher.com.
The U.S. EEO posters are available here.
#J-18808-Ljbffr