Head of Engineering, QA
New Yesterday
Overview The Role — As Head of Engineering, QA at Sully.ai, you’ll build QA from the ground up—owning strategy, automation, and execution. You’ll ensure our AI medical employees are safe, reliable, and high-performing. This is a 0→1 role: you’ll be the first in function, setting standards, scaling automation, and growing a team.
What You'll Do Own QA Strategy: Define the framework for automation, functional, performance, and compliance testing.
Build & Scale Automation: Lead design and implementation of Playwright-based test frameworks; automate test cases for UI and API.
Ensure Reliability: Scale automation coverage, add new tests, monitor dashboards, and fix failing tests fast.
Guarantee Quality: Validate accuracy, security, and compliance (HIPAA / SOC-2); partner with Engineering and Clinical teams.
Lead & Grow: Recruit, mentor, and drive a high-performing QA team; embed QA into CI / CD pipelines (GitHub Actions).
What You\'ll Bring (Must-Have) Founder / 0→1 experience — first in function, building QA processes and teams from scratch.
6–8+ years QA experience with strong Playwright expertise.
3-4+ years with strong people leadership.
Proven ability to automate functional UI and API test cases.
Hands-on with QA tools (Playwright, Cypress, PyTest, Postman).
Experience with scaling test automation and maintaining reliability.
Highly motivated, driven, and ownership-oriented.
Nice to Have Experience testing AI / LLM workflows.
Dashboarding / observability tooling.
GitHub Actions CI / CD integration.
Prior startup or healthcare QA experience.
Tech Snapshot Automation : Playwright, Cypress, PyTest
CI / CD : GitHub Actions, Kubernetes, Docker
Performance : Locust, JMeter, k6
Cloud : AWS / GCP / Azure
AI QA : Prompt / LLM evaluation, guardrails
Why Join Sully.ai? Build QA from 0→1 : Define how quality is done at a fast-growing AI healthcare startup.
Real Impact : Ensure clinical-grade safety and reliability in products used by doctors and patients.
Remote-First : Work with a mission-driven team from anywhere.
Compensation : Competitive salary + equity.
Tackle Hard Problems : AI QA at scale in healthcare—complex, high-impact, and career-defining.
Sully.ai is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to status as a protected veteran, a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy, or age. Sully.ai prohibits any form of workplace harassment.
#J-18808-Ljbffr
- Location:
- San Francisco, CA, United States
- Salary:
- $250,000 +
- Category:
- Engineering