What Youll Do

Build scalable processes for evaluating AI models 0 0etween quantitatively and qualitatively 0so we can stay ahead of the game.

Work hand-in-hand with our brilliant AI Research team to create test plans, run experiments, and identify areas for improvement or inconsistencies in model behavior.

Set the gold standard for model quality by creating baselines, benchmarks, and rating systems.

Keep everything organized with clear test plans, documentation, and bug reports that your future self (and team) will thank you for.

Tap into internal and external resources to gather the data we need to refine and perfect our models.

Be the go-to expert for working with third-party service providers to ensure they meet our sky-high quality standards.

Continuously improve testing tools and methodologies.

Share the QA love by mentoring others and collaborating across teams to make sure everything works beautifully together.

What You Bring

2+ years experience leading evaluation of AI models.

2+ years experience as a test lead on a team, product area, or feature.

5+ years QA experience.

Experience working with AI Research teams.

Ability to collaborate effectively with cross-functional teams and stakeholders.

Bachelors degree in Computer Science, Engineering, or equivalent relevant experience.

Nice to Haves

Experience evaluating AI speech or video models.

Experience using Python for scripting.

The base salary range for this role is $140,000-$181,000. Final offer amounts will carefully consider multiple factors, including prior experience, expertise, and location, and they may vary from the amount above.

Descript is the special company that shas product-market fit and the raw materials (passionate user community, great product, large market) for growth, but is still early enough that each new employee has a measurable influence on the direction of the company.

Benefits include a generous healthcare package, catered lunches, and flexible vacation time. Our headquarters are located in the Mission District of San Francisco, CA. Were looking to hire people who are local and able to join us at the office when needed. Were flexible, and youre an adult we dont expect or mandate that youre in the office every day. But we do believe there are valuable and serendipitous moments of discovery and collaboration that come from working together in person.

Descript is an equal opportunity workplace we are dedicated to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status. We believe in actively building a team rich in diverse backgrounds, experiences, and opinions to better allow our employees, products, and community to thrive.

Apply for this job

J-18808-Ljbffr

#J-18808-Ljbffr