Midwestern Interactive LLC
Senior Data Scientist - AI Research & Evaluation
Job Summary/Overview
The company is seeking a mission-driven
Senior Data Scientist
to join its AI Research & Data Science team. In this pivotal role, you'll transform cutting-edge language model research into meaningful, faith-aligned product insights that drive real-world impact. You will lead the end-to-end experimentation lifecycle-from causal test design and metric development to automation and deployment-ensuring model outputs are trustworthy, fair, and aligned with the company's mission to promote human flourishing through technology.
This position combines hands-on data analysis with strategic decision-making, working closely with engineers, product managers, and researchers to develop scalable systems, insightful dashboards, and robust evaluation frameworks. Ideal candidates are passionate about shaping AI for good, deeply experienced in statistical modeling, and excited to work in a collaborative, values-driven environment.
Key Responsibilities
Research & Technical Excellence
Design and implement evaluation pipelines for model accuracy, bias, hallucination, latency, and cost. Develop and validate custom metrics that represent human flourishing Build instrumentation and automation for regression, drift detection, and lineage tracking in data pipelines. Contribute to internal knowledge-sharing through whitepapers, journal clubs, and mentorship. Delivery
Own the full analytics pipeline-from querying large datasets to surfacing insights via dashboards or internal tools. Standardize and accelerate experimentation using templates for A/B testing, Bayesian bandits, and other frameworks. Optimize performance across data workflows, inference pipelines, and labeling systems. Strategic Clarity
Collaborate cross-functionally to align metrics and datasets with mission-driven product outcomes. Communicate data trade-offs (e.g., GPU cost vs. accuracy vs. privacy) with clear recommendations to stakeholders. Maintain living documentation of metrics, governance rules, and experimentation checklists. Collaboration
Partner with infrastructure, security, and UX teams to ensure scalable, secure, and well-instrumented systems. Foster open dialogue, surfacing risks and driving evidence-based decision-making across functions. Leadership & Influence
Mentor junior analysts and engineers; elevate team competency in statistics and experimentation. Advocate for data-driven solutions even in the face of intuition-based resistance. Lead retrospectives, capture learnings, and continuously improve experimentation processes. Required Qualifications
Advanced degree or equivalent experience (e.g., peer-reviewed publications or high-impact data products). 5+ years in product or research-focused data science roles. Strong proficiency in SQL and Python (NumPy, Pandas); comfortable across ETL, analysis, and dashboarding. Deep experience with causal inference, A/B and switchback testing, and metric development. Proven ability to evaluate and partner on large language model (LLM) analytics. Excellent communication skills, with a knack for translating complex statistics into actionable insights. Preferred Qualifications
Hands-on experience with LLM evaluation, bias audits, or prompt analysis tooling. Familiarity with modern MLOps tools (e.g., Ray, Airflow, Kubernetes) and GPU cost tracking. Open-source contributions (e.g., repos with >500 GitHub stars) or relevant academic publications (NeurIPS, ICML, KDD). Experience in faith-aligned, mission-driven, or nonprofit-focused environments. Additional Information
Location
Hybrid role based in Sewickley, PA (Pittsburgh area) preferred Remote work available for highly qualified candidates Work Environment & Benefits
Flexible PTO and compliant sick leave policy Medical, dental, and vision insurance with up to 90% coverage for employees Generous employer HSA contributions for HDHP plans Employer-sponsored 401(k) with 2% match Learning & development stipend (available after 6 months) Paid parental leave Hybrid work environment with in-person and virtual team events Collaborative and mission-aligned team culture
Eligibility
Applicants must be currently authorized to work in the United States. Only U.S. Citizens or U.S. Permanent Residents are eligible for consideration at this time.
Job Summary/Overview
The company is seeking a mission-driven
Senior Data Scientist
to join its AI Research & Data Science team. In this pivotal role, you'll transform cutting-edge language model research into meaningful, faith-aligned product insights that drive real-world impact. You will lead the end-to-end experimentation lifecycle-from causal test design and metric development to automation and deployment-ensuring model outputs are trustworthy, fair, and aligned with the company's mission to promote human flourishing through technology.
This position combines hands-on data analysis with strategic decision-making, working closely with engineers, product managers, and researchers to develop scalable systems, insightful dashboards, and robust evaluation frameworks. Ideal candidates are passionate about shaping AI for good, deeply experienced in statistical modeling, and excited to work in a collaborative, values-driven environment.
Key Responsibilities
Research & Technical Excellence
Design and implement evaluation pipelines for model accuracy, bias, hallucination, latency, and cost. Develop and validate custom metrics that represent human flourishing Build instrumentation and automation for regression, drift detection, and lineage tracking in data pipelines. Contribute to internal knowledge-sharing through whitepapers, journal clubs, and mentorship. Delivery
Own the full analytics pipeline-from querying large datasets to surfacing insights via dashboards or internal tools. Standardize and accelerate experimentation using templates for A/B testing, Bayesian bandits, and other frameworks. Optimize performance across data workflows, inference pipelines, and labeling systems. Strategic Clarity
Collaborate cross-functionally to align metrics and datasets with mission-driven product outcomes. Communicate data trade-offs (e.g., GPU cost vs. accuracy vs. privacy) with clear recommendations to stakeholders. Maintain living documentation of metrics, governance rules, and experimentation checklists. Collaboration
Partner with infrastructure, security, and UX teams to ensure scalable, secure, and well-instrumented systems. Foster open dialogue, surfacing risks and driving evidence-based decision-making across functions. Leadership & Influence
Mentor junior analysts and engineers; elevate team competency in statistics and experimentation. Advocate for data-driven solutions even in the face of intuition-based resistance. Lead retrospectives, capture learnings, and continuously improve experimentation processes. Required Qualifications
Advanced degree or equivalent experience (e.g., peer-reviewed publications or high-impact data products). 5+ years in product or research-focused data science roles. Strong proficiency in SQL and Python (NumPy, Pandas); comfortable across ETL, analysis, and dashboarding. Deep experience with causal inference, A/B and switchback testing, and metric development. Proven ability to evaluate and partner on large language model (LLM) analytics. Excellent communication skills, with a knack for translating complex statistics into actionable insights. Preferred Qualifications
Hands-on experience with LLM evaluation, bias audits, or prompt analysis tooling. Familiarity with modern MLOps tools (e.g., Ray, Airflow, Kubernetes) and GPU cost tracking. Open-source contributions (e.g., repos with >500 GitHub stars) or relevant academic publications (NeurIPS, ICML, KDD). Experience in faith-aligned, mission-driven, or nonprofit-focused environments. Additional Information
Location
Hybrid role based in Sewickley, PA (Pittsburgh area) preferred Remote work available for highly qualified candidates Work Environment & Benefits
Flexible PTO and compliant sick leave policy Medical, dental, and vision insurance with up to 90% coverage for employees Generous employer HSA contributions for HDHP plans Employer-sponsored 401(k) with 2% match Learning & development stipend (available after 6 months) Paid parental leave Hybrid work environment with in-person and virtual team events Collaborative and mission-aligned team culture
Eligibility
Applicants must be currently authorized to work in the United States. Only U.S. Citizens or U.S. Permanent Residents are eligible for consideration at this time.