Head of Engineering, QA

New Yesterday

Overview The Role — As Head of Engineering, QA at Sully.ai, you’ll build QA from the ground up—owning strategy, automation, and execution. You’ll ensure our AI medical employees are safe, reliable, and high-performing. This is a 0→1 role: you’ll be the first in function, setting standards, scaling automation, and growing a team. What You'll Do Own QA Strategy: Define the framework for automation, functional, performance, and compliance testing. Build & Scale Automation: Lead design and implementation of Playwright-based test frameworks; automate test cases for UI and API. Ensure Reliability: Scale automation coverage, add new tests, monitor dashboards, and fix failing tests fast. Guarantee Quality: Validate accuracy, security, and compliance (HIPAA / SOC-2); partner with Engineering and Clinical teams. Lead & Grow: Recruit, mentor, and drive a high-performing QA team; embed QA into CI / CD pipelines (GitHub Actions). What You\'ll Bring (Must-Have) Founder / 0→1 experience — first in function, building QA processes and teams from scratch. 6–8+ years QA experience with strong Playwright expertise. 3-4+ years with strong people leadership. Proven ability to automate functional UI and API test cases. Hands-on with QA tools (Playwright, Cypress, PyTest, Postman). Experience with scaling test automation and maintaining reliability. Highly motivated, driven, and ownership-oriented. Nice to Have Experience testing AI / LLM workflows. Dashboarding / observability tooling. GitHub Actions CI / CD integration. Prior startup or healthcare QA experience. Tech Snapshot Automation : Playwright, Cypress, PyTest CI / CD : GitHub Actions, Kubernetes, Docker Performance : Locust, JMeter, k6 Cloud : AWS / GCP / Azure AI QA : Prompt / LLM evaluation, guardrails Why Join Sully.ai? Build QA from 0→1 : Define how quality is done at a fast-growing AI healthcare startup. Real Impact : Ensure clinical-grade safety and reliability in products used by doctors and patients. Remote-First : Work with a mission-driven team from anywhere. Compensation : Competitive salary + equity. Tackle Hard Problems : AI QA at scale in healthcare—complex, high-impact, and career-defining. Sully.ai is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to status as a protected veteran, a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy, or age. Sully.ai prohibits any form of workplace harassment.
#J-18808-Ljbffr
Location:
San Francisco, CA, United States
Salary:
$250,000 +
Category:
Engineering