Sully.ai Inc.
The Role
As
Head of Engineering, QA
at Sully.ai, youll build QA from the ground upowning strategy, automation, and execution. Youll ensure our AI medical employees are safe, reliable, and high-performing. This is a 0?1 role: youll be the first in function, setting standards, scaling automation, and growing a team. What You'll Do
Own QA Strategy:
Define the framework for automation, functional, performance, and compliance testing.
Build & Scale Automation:
Lead design and implementation of Playwright-based test frameworks; automate test cases for UI and API.
Ensure Reliability:
Scale automation coverage, add new tests, monitor dashboards, and fix failing tests fast.
Guarantee Quality:
Validate accuracy, security, and compliance (HIPAA/SOC-2); partner with Engineering and Clinical teams.
Lead & Grow:
Recruit, mentor, and drive a high-performing QA team; embed QA into CI/CD pipelines (GitHub Actions).
What You'll Bring (Must-Have)
Founder / 0?1 experience
first in function, building QA processes and teams from scratch.
68+ years QA experience
with strong Playwright expertise.
3-4+ years with strong people leadership.
Proven ability to automate functional UI and API test cases.
Hands-on with QA tools (Playwright, Cypress, PyTest, Postman).
Experience with scaling test automation and maintaining reliability.
Highly motivated, driven, and ownership-oriented.
Nice to Have
Experience testing AI/LLM workflows.
Dashboarding/observability tooling.
GitHub Actions CI/CD integration.
Prior startup or healthcare QA experience.
Tech Snapshot
Automation:
Playwright, Cypress, PyTest
CI/CD:
GitHub Actions, Kubernetes, Docker
Performance:
Locust, JMeter, k6
Cloud:
AWS/GCP/Azure
AI QA:
Prompt/LLM evaluation, guardrails
Why Join Sully.ai?
Build QA from 0?1:
Define how quality is done at a fast-growing AI healthcare startup. Real Impact:
Ensure clinical-grade safety and reliability in products used by doctors and patients. Remote-First:
Work with a mission-driven team from anywhere. Compensation:
Competitive salary + equity. Tackle Hard Problems:
AI QA at scale in healthcarecomplex, high-impact, and career-defining. Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment. #J-18808-Ljbffr
As
Head of Engineering, QA
at Sully.ai, youll build QA from the ground upowning strategy, automation, and execution. Youll ensure our AI medical employees are safe, reliable, and high-performing. This is a 0?1 role: youll be the first in function, setting standards, scaling automation, and growing a team. What You'll Do
Own QA Strategy:
Define the framework for automation, functional, performance, and compliance testing.
Build & Scale Automation:
Lead design and implementation of Playwright-based test frameworks; automate test cases for UI and API.
Ensure Reliability:
Scale automation coverage, add new tests, monitor dashboards, and fix failing tests fast.
Guarantee Quality:
Validate accuracy, security, and compliance (HIPAA/SOC-2); partner with Engineering and Clinical teams.
Lead & Grow:
Recruit, mentor, and drive a high-performing QA team; embed QA into CI/CD pipelines (GitHub Actions).
What You'll Bring (Must-Have)
Founder / 0?1 experience
first in function, building QA processes and teams from scratch.
68+ years QA experience
with strong Playwright expertise.
3-4+ years with strong people leadership.
Proven ability to automate functional UI and API test cases.
Hands-on with QA tools (Playwright, Cypress, PyTest, Postman).
Experience with scaling test automation and maintaining reliability.
Highly motivated, driven, and ownership-oriented.
Nice to Have
Experience testing AI/LLM workflows.
Dashboarding/observability tooling.
GitHub Actions CI/CD integration.
Prior startup or healthcare QA experience.
Tech Snapshot
Automation:
Playwright, Cypress, PyTest
CI/CD:
GitHub Actions, Kubernetes, Docker
Performance:
Locust, JMeter, k6
Cloud:
AWS/GCP/Azure
AI QA:
Prompt/LLM evaluation, guardrails
Why Join Sully.ai?
Build QA from 0?1:
Define how quality is done at a fast-growing AI healthcare startup. Real Impact:
Ensure clinical-grade safety and reliability in products used by doctors and patients. Remote-First:
Work with a mission-driven team from anywhere. Compensation:
Competitive salary + equity. Tackle Hard Problems:
AI QA at scale in healthcarecomplex, high-impact, and career-defining. Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment. #J-18808-Ljbffr