Quality Assurance Analyst, AI Delivery Jobs

Quality Assurance Analyst, AI Delivery

Cresta

Location:
United States

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

50000.00 - 70000.00 USD / Year

Save Job

Apply Position

Job Description:

We’re looking for a Quality Assurance Analyst to ensure Cresta’s AI systems perform with accuracy, fairness, and compliance. You’ll audit AI-generated conversations, evaluate model behavior, and deliver feedback that improves model performance and customer trust.

Job Responsibility:

Review AI-generated summaries for accuracy and completeness
provide feedback to improve models
Conduct behavioral audits to verify agent triggers and responses match expected outcomes
Perform redaction audits to protect sensitive customer data
Run bias audits to detect and document fairness issues
Compare audio and text for transcription accuracy
Support Opera platform maintenance and rule configuration to keep AI outputs accurate

Requirements:

1–3 years in QA or data labeling
Exceptional attention to detail and analytical rigor
Strong documentation and communication skills
Comfort with accuracy-driven tasks

Nice to have:

Familiarity with conversational AI or annotation tools
Experience with bias / redaction audits or speech-to-text QA

What we offer:

Competitive pay and equity
Medical, dental, vision coverage
Flexible PTO, remote-first culture
Monthly wellness stipend & home-office support

Additional Information:

Job Posted:
December 07, 2025

Employment Type:

Fulltime

Work Type:

Remote work

View All Jobs In This Company

Job Link Share:

Welcome to CrawlJobs.com –
Your Global Job Discovery Platform

At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.