CrawlJobs Logo

Data Analyst - Quality Assurance

glean.com Logo

Glean

Location Icon

Location:
India , Bangalore

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

We're seeking a technically-focused Data Analyst - QA role to drive the Quality of our AI features and various LLM models. This role involves evaluating AI outputs, identifying and tagging patterns in errors, and ensuring that responses align with accuracy, coherence, and ethical guidelines.

Job Responsibility:

  • Triage Bad Query responses and categorisation of the issues found
  • Analyse win/loss patterns across different LLM Models and AI features
  • Conduct qualitative analysis to detect inconsistencies, biases, retrieval errors, or hallucinations in AI outputs
  • Develop quality metrics and benchmarks to measure AI response performance over time
  • Collaborate with data scientists and engineers to provide feedback and improve AI models
  • Identify trends and recurring issues in AI responses and suggest refinements
  • Design and maintain quality assurance guidelines for AI-generated content evaluation
  • Perform manual audits on AI outputs to ensure compliance with linguistic and ethical standards

Requirements:

  • Bachelor's or Master's degree in Data Science, Computer Science Engineering, AI/ML Engineering, Information Technology, Compute Applications
  • 3 -5 years of experience in quality assurance, data analysis, content moderation, or NLP-related roles
  • Excellent vocabulary and communication skills
  • Experience in Search Engine Optimization (SEO) or analysing AI response quality
  • Strong ability to analyze qualitative data, identify patterns, and synthesize insights
  • Ability to communicate findings effectively to both technical and non-technical stakeholders
  • Excellent attention to detail and critical thinking skills
  • Experience working with AI-generated content, NLP models, or chatbots

Nice to have:

  • Familiarity with data annotation tools and evaluation frameworks for AI models
  • Familiarity with qualitative research methodologies and user behavior analysis
  • Basic knowledge on SQL retrieval
  • Experience working on JIRA is a plus
  • Ability to work in a fast-paced environment and adapt to evolving AI technologies

Additional Information:

Job Posted:
January 06, 2026

Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Analyst - Quality Assurance

Quality Assurance Analyst, Consumer Products

The Quality Assurance (QA) Analyst is responsible for ensuring production of mer...
Location
Location
Vietnam , Ho Chi Minh City
Salary
Salary:
Not provided
disney.com Logo
Disney
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 5 years of related experience
  • Bachelor’s Degree or equivalent experience/education combination
  • Consumer product or industry-specific experience
  • Proficient in English and Vietnamese
  • Strong computer skills including Microsoft Office and databases
  • Knowledge of tools, concepts and methodologies of QA
  • Knowledge of relevant regulatory requirements globally
Job Responsibility
Job Responsibility
  • Conducts technical audit and identify QC process issue at factory as needed, help supplier to work on the improvement to mitigate quality risk in production aiming to secure on-time delivery and high-quality standard to protect Disney brand
  • Drives supplier to work on root cause analysis and corrective action
  • develop, recommend and monitor correction and preventive action in regards to production quality improvement. Review and validate the implementation throughout issue closure
  • Conducts and carries out onsite inspection for finished products to ensure production quality meets Disney standards
  • Manage a 3rd party consultant to perform quality assurance inspection for Disney product, monitor and leverage 3rd party consultant’s service to best manage the gating of product’s quality from Disney suppliers
  • Provides update and reporting out of supplier quality issue and communicate outcome of quality activities to QA manager and project stakeholders
  • Analyze quality data to identify areas for improvement in factory quality management system
  • Supports leadership to manage the deliverables of the development of short and long-term quality strategies for managed suppliers, setting priorities, objectives, and action plans to mitigate risk with measurable accountability
  • Provides quality training to factory for continuous manufacturing process optimization and quality management system improvement
  • Co-works closely with internal and external partners for quality communication and problem solving, host meeting with cross function teams and build up strong relationships and mutual trust at work
Read More
Arrow Right

Quality Assurance Analyst IV

Beacon Technologies is seeking a Quality Assurance Analyst IV for our client par...
Location
Location
United States
Salary
Salary:
Not provided
beacontechinc.com Logo
Beacon Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in quality inspection, auditing, and testing – 5 years
  • Strong analytical and problem-solving skills – 5 years
  • Excellent verbal and written communication skills – 5 years
  • Candidates must be CURRENT Wisconsin residents
  • No relocation is allowed
What we offer
What we offer
  • Career advancement opportunities
  • Extensive training
  • Excellent benefits including paying for health and dental premiums for salaried employees
  • Fulltime
Read More
Arrow Right

Lead Construction Quality Assurance Analyst

This position supports compliance with Capital Delivery project management polic...
Location
Location
United States , Philadelphia; Washington
Salary
Salary:
94300.00 - 122256.00 USD / Year
amtrak.com Logo
AMTRAK
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum six (6) years of relevant experience in a quality control and\or assurance function and a Bachelor’s degree in Science or Engineering, or 10 years’ experience without a degree.
  • Valid Driver’s License or ability to utilize an alternative method of transportation when needed to carry out job-related functions.
  • Must have work authorization in the United States.
  • Lean Six Sigma or process improvement training, certification, and/ or experience
  • Experienced in use of statistical analysis tools (Excel, SPSS, EngineRoom)
  • Familiarity with project management methods, techniques, standards, and best practices
  • Experience drafting technical documents such as standard practices, technical specifications, procedures, or policies
  • Ability to clearly organize and present reports, and other related technical information to upper management
  • Experienced in developing and delivering training
Job Responsibility
Job Responsibility
  • Prepare audit/compliance plans with sampling and test design for process measurement.
  • Conduct audits, surveys, and performance reviews to ensure compliance with policies and best practices.
  • Identify and recommend improvement opportunities across various management levels.
  • Support development of corrective action scopes and monitor implementation.
  • Conduct process mapping, quality checks, and audits to ensure data integrity and support data initiatives.
  • Apply disciplined quality management common in manufacturing to construction projects.
  • Identify gaps and inefficiencies and presents recommended improvement opportunities at various levels of management
  • Supports development of scope for corrective action or improvement projects
  • Track and monitor (or implement) corrective / preventive actions
  • Conduct process and value mapping activities
What we offer
What we offer
  • health, dental, and vision plans
  • health savings accounts
  • wellness programs
  • flexible spending accounts
  • 401K retirement plan with employer match
  • life insurance
  • short and long term disability insurance
  • paid time off
  • back-up care
  • adoption assistance
  • Fulltime
Read More
Arrow Right

Quality Assurance Analyst

Mayvue is seeking a highly motivated Quality Assurance Analyst that will be work...
Location
Location
United States , Pittsburgh
Salary
Salary:
Not provided
mayvue.com Logo
Mayvue Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on testing experience with SaaS or enterprise web applications
  • Proven ability to create and maintain automated UI, API, and integration tests (e.g., Cypress, Playwright, Selenium)
  • Solid understanding of RESTful API testing with tools like Postman or RestAssured
  • Familiarity with Git-based workflows and CI/CD pipelines (GitHub Actions, Jenkins, or similar)
  • Working knowledge of SQL for data validation and basic querying
  • Strong written and verbal communication skills in an Agile/Scrum environment
Job Responsibility
Job Responsibility
  • Own quality from day one – design, document, and execute test strategies that cover functional, regression, performance, and security scenarios for our web and mobile applications
  • Automate first – develop and maintain automated UI, API, and integration tests (Selenium, Cypress, or Playwright) integrated into our CI/CD pipelines (GitHub Actions, Jenkins, Octopus)
  • Shift left – collaborate closely with Product, UX, and Engineering during backlog refinement and design reviews to surface edge cases early and prevent defects
  • Track and triage – file clear, reproducible defects in Jira, validate fixes, and analyze root causes to drive continuous improvement
  • Measure & monitor – set quality KPIs, leverage dashboards, and raise risks with data-backed insights
  • Mentor & evangelize – share QA best practices, pair on code reviews, and help foster a “quality-is-everyone’s-job” culture
What we offer
What we offer
  • Unlimited PTO
  • Life Insurance at no cost to employees
  • Short-term and long-term disability at no cost to employees
  • Paid maternity and paternity leave
  • Healthcare insurance (Premiums are partially paid for by Mayvue)
  • Dental and vision at no cost to employees and dependents
  • Optional supplemental life insurance
  • Receive $1,000.00 per year for Continuous Learning Allowance
  • Receive 1 day paid per year as a Community Service Allowance
  • Onsite gym in Pittsburgh office
  • Fulltime
Read More
Arrow Right

Quality Assurance Analyst, AI Delivery

We’re looking for a Quality Assurance Analyst to ensure Cresta’s AI systems perf...
Location
Location
United States
Salary
Salary:
50000.00 - 70000.00 USD / Year
cresta.com Logo
Cresta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 1–3 years in QA or data labeling
  • Exceptional attention to detail and analytical rigor
  • Strong documentation and communication skills
  • Comfort with accuracy-driven tasks
Job Responsibility
Job Responsibility
  • Review AI-generated summaries for accuracy and completeness
  • provide feedback to improve models
  • Conduct behavioral audits to verify agent triggers and responses match expected outcomes
  • Perform redaction audits to protect sensitive customer data
  • Run bias audits to detect and document fairness issues
  • Compare audio and text for transcription accuracy
  • Support Opera platform maintenance and rule configuration to keep AI outputs accurate
What we offer
What we offer
  • Competitive pay and equity
  • Medical, dental, vision coverage
  • Flexible PTO, remote-first culture
  • Monthly wellness stipend & home-office support
  • Fulltime
Read More
Arrow Right

Software Quality Assurance Analyst

This person will ensure high-quality software delivery through thorough testing,...
Location
Location
United States , Glen Allen
Salary
Salary:
90000.00 - 105000.00 USD / Year
capstonec.com Logo
Capstone IT Staffing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ability to quickly learn and understand complex software systems
  • 7-10 years of experience across software testing types: functional, non-functional, integration, regression, and UAT
  • 5+ years of experience testing Java applications
  • Strong knowledge of test planning, test case development, and execution
  • Proficiency with HTML, XML, Java, TypeScript, and React or Next.js
  • Solid experience with MS SQL and Git
  • Hands-on experience with Azure DevOps (Boards, Repos, Pipelines, Test Plans)
  • Experience hosting requirement and test case reviews with developers, QAs, and project stakeholders
  • Familiarity with Agile Scrum and QA’s responsibilities within the process
  • Strong attention to detail and ability to perform root-cause analysis
Job Responsibility
Job Responsibility
  • Understand business and technical requirements by working with Product/Business SMEs and development teams
  • Review requirements for clarity, accuracy, and testability
  • Create, maintain, and execute test plans, scenarios, and cases using requirement documents and logic extracts
  • Document test scenarios, expected results, and execute test sets within the test management tool
  • Perform functional, non-functional, integration, regression, and UAT testing
  • Write and run complex SQL queries to validate database persistence and data integrity
  • Identify, log, and track defects, performing root-cause analysis when needed
  • Participate in daily Scrum ceremonies and align testing activities with project timelines
  • Determine required test data and identify gaps in the test environment
  • Identify test cases suitable for automation
  • Fulltime
Read More
Arrow Right

Data Quality Lead Analyst

The Data Quality Lead Analyst is a strategic professional who stays abreast of d...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years software experience preferred
  • High proficiency in MS Excel, Python, SQL for Data analysis
  • Ability to create BI tools such as Qlikview and/or Tableau views for analysis
  • Problem Solving - Evaluates moderately complex and variable issues with substantial potential impact
  • Good analytical skills to filter, prioritize and validate potentially complex and dynamic material from multiple sources
  • Outstanding written and oral communication, influencing and presentation skills
  • A self-starter with ability to independently manage work and drive multiple deliverables concurrently
  • Strong subject matter expertise regarding technology application control disciplines and technology infrastructure knowledge
  • Demonstrated capability and maturity to work in an individual capacity
  • Demonstrates experience in managing teams and managing integrated internal audit and assurance delivery
Job Responsibility
Job Responsibility
  • Devises methods for identifying data patterns and trends in available data sources
  • Defines strategies to drive data quality measurement, produce data quality dashboards and reports, and implement data quality strategies to effectively govern data and improve data quality
  • Works with data quality partners and Technology teams to identify and implement data quality tools
  • Identify critical data elements, data quality rules, thresholds, and other business requirements
  • Mentors junior analysts
  • Applies in-depth understanding and knowledge of how business integrates within the sub function
  • Contributes to the development of new techniques and processes and for the aligned business
  • Integrates subject matter and industry expertise within a defined area
  • Responsible for own work to support business teams in assigned area
  • Build data quality assessments and measurement of critical data utilized by Citi strategic systems and processes
  • Fulltime
Read More
Arrow Right

Quality Assurance Analyst

As a Quality Assurance Analyst, you will play a crucial role in ensuring the int...
Location
Location
United States , Princeton, NJ
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficient in Bug Tracking
  • Experience in Integration Testing
  • Knowledge of Jenkins
  • Skilled in AB Testing
  • Experience in Agile Scrum
  • Strong auditing skills
  • Experience in a Call Center Customer Service environment
  • Excellent Customer Service skills
Job Responsibility
Job Responsibility
  • Lead quality assurance initiatives for Property & Casualty insurance projects
  • Team up with cross-functional groups
  • Design, document, and execute extensive test cases
  • Keep detailed records of test cases, test outcomes, and defect tracking
  • Conduct hands-on tests
  • Develop and maintain automated test scripts
  • Leverage coding skills to customize and enhance testing frameworks
  • Write and execute SQL queries
  • Analyze and troubleshoot data discrepancies between systems
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right