Sully.ai
About Us
Team from OpenAI, DeepMind, NASA, GoogleX, Tesla, and 2 physicians: 6 exits, 2 IPOs.
Our model outperforms Claude, Gemini, and GPT-4.5 on clinical benchmarks.
400+ healthcare orgs signed in 16 months.
$25M raised from YC, Amity Ventures, Sequoia scouts, and more.
$1T+ market opportunity. We’re going after all of it.
About The Role We are seeking a Head of Engineering, QA to build Sully.ai’s QA function from the ground up—owning strategy, automation, and execution. This is a 0→1 role: you’ll set the framework for functional, performance, and compliance testing, scale automation across our stack, and ensure our AI medical employees are safe, reliable, and high-performing. You will also recruit and mentor a team, embedding QA into CI/CD pipelines to enable fast, clinical-grade releases.
Key Responsibilities
Own QA strategy, defining frameworks for automation, functional, performance, and compliance testing
Build and scale Playwright-based test automation for UI and API coverage
Ensure reliability by expanding automation coverage, monitoring dashboards, and resolving test failures quickly
Guarantee accuracy, security, and compliance (HIPAA/SOC-2), partnering with Engineering and Clinical teams
Recruit, mentor, and lead a high-performing QA team
Embed QA into CI/CD pipelines using GitHub Actions and related tooling
Hard Requirements
Founder / 0→1 experience — first in function, building QA processes and teams from scratch
6–8+ years in QA with strong expertise in Playwright
3–4+ years of people leadership experience
Proven ability to automate functional UI and API test cases
Hands‑on with QA tools (Playwright, Cypress, PyTest, Postman)
Experience scaling test automation and maintaining reliability
Highly motivated, driven, and ownership‑oriented
Nice‑to‑Have
Experience testing AI/LLM workflows
Familiarity with dashboarding and observability tooling
GitHub Actions CI/CD integration experience
Prior startup or healthcare QA background
First‑Month Focus
Define Sully.ai’s QA strategy and initial automation framework
Implement core Playwright test cases across key workflows
Partner with Engineering and Clinical teams to validate compliance needs
Success OKRs (90 Days)
Establish automated test coverage across UI and API workflows
Integrate QA pipelines into GitHub Actions for reliable CI/CD
Deliver measurable improvements in test reliability and release confidence
Culture Fit
Persistent, driven problem solver
Willing to push back on leadership to defend quality/timelines
Thrives in high‑ambiguity, fast‑paced startup environments
Why Join Shape the Future of Healthcare: Build category‑defining partnerships that enable doctors to focus on saving lives.
Early‑Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
Remote‑First Culture: Work with a talented, mission‑driven team in a flexible, remote environment.
Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.
Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.
#J-18808-Ljbffr
Our model outperforms Claude, Gemini, and GPT-4.5 on clinical benchmarks.
400+ healthcare orgs signed in 16 months.
$25M raised from YC, Amity Ventures, Sequoia scouts, and more.
$1T+ market opportunity. We’re going after all of it.
About The Role We are seeking a Head of Engineering, QA to build Sully.ai’s QA function from the ground up—owning strategy, automation, and execution. This is a 0→1 role: you’ll set the framework for functional, performance, and compliance testing, scale automation across our stack, and ensure our AI medical employees are safe, reliable, and high-performing. You will also recruit and mentor a team, embedding QA into CI/CD pipelines to enable fast, clinical-grade releases.
Key Responsibilities
Own QA strategy, defining frameworks for automation, functional, performance, and compliance testing
Build and scale Playwright-based test automation for UI and API coverage
Ensure reliability by expanding automation coverage, monitoring dashboards, and resolving test failures quickly
Guarantee accuracy, security, and compliance (HIPAA/SOC-2), partnering with Engineering and Clinical teams
Recruit, mentor, and lead a high-performing QA team
Embed QA into CI/CD pipelines using GitHub Actions and related tooling
Hard Requirements
Founder / 0→1 experience — first in function, building QA processes and teams from scratch
6–8+ years in QA with strong expertise in Playwright
3–4+ years of people leadership experience
Proven ability to automate functional UI and API test cases
Hands‑on with QA tools (Playwright, Cypress, PyTest, Postman)
Experience scaling test automation and maintaining reliability
Highly motivated, driven, and ownership‑oriented
Nice‑to‑Have
Experience testing AI/LLM workflows
Familiarity with dashboarding and observability tooling
GitHub Actions CI/CD integration experience
Prior startup or healthcare QA background
First‑Month Focus
Define Sully.ai’s QA strategy and initial automation framework
Implement core Playwright test cases across key workflows
Partner with Engineering and Clinical teams to validate compliance needs
Success OKRs (90 Days)
Establish automated test coverage across UI and API workflows
Integrate QA pipelines into GitHub Actions for reliable CI/CD
Deliver measurable improvements in test reliability and release confidence
Culture Fit
Persistent, driven problem solver
Willing to push back on leadership to defend quality/timelines
Thrives in high‑ambiguity, fast‑paced startup environments
Why Join Shape the Future of Healthcare: Build category‑defining partnerships that enable doctors to focus on saving lives.
Early‑Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
Remote‑First Culture: Work with a talented, mission‑driven team in a flexible, remote environment.
Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.
Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.
#J-18808-Ljbffr