Sully.ai Inc.
The Role
As
Head of Engineering, QA
at
Sully.ai , you’ll build QA from the ground up—owning strategy, automation, and execution. You’ll ensure our AI medical employees are safe, reliable, and high-performing. This is a 0→1 ***** you’ll be the first in function, setting standards, scaling automation, and growing a team. What Youll Do
Own QA **
Define the framework for automation, functional, performance, and compliance testing.
Build & Scale *
Lead design and implementation of Playwright-based test frameworks; automate test cases for UI and API.
Ensure *
Scale automation coverage, add new tests, monitor dashboards, and fix failing tests fast.
Guarantee *
Validate accuracy, security, and compliance (HIPAA/SOC-2); partner with Engineering and Clinical teams.
Lead & *
Recruit, mentor, and drive a high-performing QA team; embed QA into CI/CD pipelines (GitHub Actions).
What Youll Bring (Must-Have)
Founder / 0→1 experience — first in function, building QA processes and teams from scratch.
6–8+ years QA experience
with strong Playwright expertise.
3-4+ years with strong people leadership.
Proven ability to automate functional UI and API test cases.
Hands-on with QA tools (Playwright, Cypress, PyTest, Postman).
Experience with scaling test automation and maintaining reliability.
Highly motivated, driven, and ownership-oriented.
Nice to Have
Experience testing AI/LLM workflows.
Dashboarding/observability tooling.
GitHub Actions CI/CD integration.
Prior startup or healthcare QA experience.
Tech Snapshot
Playwright, Cypress, PyTest
CI/
GitHub Actions, Kubernetes, Docker
Locust, JMeter, k6
AWS/GCP/Azure
AI *
Prompt/LLM evaluation, guardrails
Why Join
Sully.ai ?
Build QA from 0→1:
Define how quality is done at a fast-growing AI healthcare startup. Real *
Ensure clinical-grade safety and reliability in products used by doctors and patients. Work with a mission-driven team from anywhere. Competitive salary + equity. Tackle Hard *
*
AI QA at scale in healthcare—complex, high-impact, and career-defining. Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.
J-18808-Ljbffr
As
Head of Engineering, QA
at
Sully.ai , you’ll build QA from the ground up—owning strategy, automation, and execution. You’ll ensure our AI medical employees are safe, reliable, and high-performing. This is a 0→1 ***** you’ll be the first in function, setting standards, scaling automation, and growing a team. What Youll Do
Own QA **
Define the framework for automation, functional, performance, and compliance testing.
Build & Scale *
Lead design and implementation of Playwright-based test frameworks; automate test cases for UI and API.
Ensure *
Scale automation coverage, add new tests, monitor dashboards, and fix failing tests fast.
Guarantee *
Validate accuracy, security, and compliance (HIPAA/SOC-2); partner with Engineering and Clinical teams.
Lead & *
Recruit, mentor, and drive a high-performing QA team; embed QA into CI/CD pipelines (GitHub Actions).
What Youll Bring (Must-Have)
Founder / 0→1 experience — first in function, building QA processes and teams from scratch.
6–8+ years QA experience
with strong Playwright expertise.
3-4+ years with strong people leadership.
Proven ability to automate functional UI and API test cases.
Hands-on with QA tools (Playwright, Cypress, PyTest, Postman).
Experience with scaling test automation and maintaining reliability.
Highly motivated, driven, and ownership-oriented.
Nice to Have
Experience testing AI/LLM workflows.
Dashboarding/observability tooling.
GitHub Actions CI/CD integration.
Prior startup or healthcare QA experience.
Tech Snapshot
Playwright, Cypress, PyTest
CI/
GitHub Actions, Kubernetes, Docker
Locust, JMeter, k6
AWS/GCP/Azure
AI *
Prompt/LLM evaluation, guardrails
Why Join
Sully.ai ?
Build QA from 0→1:
Define how quality is done at a fast-growing AI healthcare startup. Real *
Ensure clinical-grade safety and reliability in products used by doctors and patients. Work with a mission-driven team from anywhere. Competitive salary + equity. Tackle Hard *
*
AI QA at scale in healthcare—complex, high-impact, and career-defining. Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.
J-18808-Ljbffr