CrawlJobs Logo

Quality Analyst, AI Business

prolific.com Logo

Prolific

Location Icon

Location:
Mexico , Mexico City

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

As a Quality Analyst within Prolific AI Data Services, you will play a critical role in ensuring the consistency, reliability, and integrity of the human data we deliver to customers. As task types and volumes grow, quality can’t rely on spot checks or tribal knowledge—this role helps operationalise quality through measurement, early detection, and clear feedback loops. You’ll work closely with Operations, reviewers, and Quality and Delivery leads to run day-to-day quality measurement, surface issues early, and help turn fixes into repeatable workflows that scale across studies and customers.

Job Responsibility:

  • Run day-to-day quality measurement for managed service studies, including sampling, rubric-based review, and structured reporting
  • Apply rubrics and guidelines consistently, flag ambiguities, and propose clear, actionable clarifications as task types evolve
  • Maintain and update golden sets, and support calibration efforts by preparing materials, tracking outcomes, and documenting decisions
  • Track defects and failure modes by categorising issues, assessing severity, and keeping defect taxonomies current
  • Run automated quality checks using SQL and Python or R, including completeness checks, schema and format validation, anomaly detection, and label distribution monitoring
  • Support launch gates by preparing readiness artefacts such as rubric versioning, gold status, sampling plans, and early pilot findings
  • Investigate quality drops by pulling examples, quantifying scope, and supporting root-cause analysis and corrective and preventive actions (CAPAs)
  • Build dashboards and weekly updates covering defect rates, rework, agreement, throughput versus quality trade-offs, and SLA risk
  • Partner with Operations, reviewers, and—when needed—Product and Engineering to improve task design, reviewer workflows, and escalation paths

Requirements:

  • 1–3 years of experience in analysis, quality, operations, or data-focused roles, or equivalent academic projects or internships
  • A background in computer science, data science, statistics, engineering, or a related quantitative discipline
  • Strong SQL skills (required), with the ability to independently query, join, and summarise datasets to answer quality and operational questions
  • Working proficiency in Python and/or R, with experience writing scripts or notebooks to clean data, compute metrics, and automate checks
  • Strong analytical rigour, with a high bar for precision, consistency, and clear documentation of decisions
  • Solid statistical fundamentals, including intuition for sampling, distributions, confidence, and agreement concepts
  • Clear and structured communication skills, with the ability to explain issues using concrete examples and propose practical fixes
  • A collaborative mindset and willingness to partner cross-functionally to improve quality outcomes and delivery reliability

Nice to have:

  • Experience with human data workflows such as annotation or data labelling, or ML/LLM evaluation (rubric-based evals, preference data, red teaming)
  • Familiarity with QA concepts such as defect severity, leakage, root-cause analysis, and CAPA processes
  • Experience building or maintaining dashboards in BI tools such as Looker, Tableau, or Mode
What we offer:
  • competitive salary, benefits, and hybrid working within our impactful, mission-driven culture
  • equity
  • opportunity to earn a cash variable element, such as a bonus or commission

Additional Information:

Job Posted:
January 07, 2026

Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Quality Analyst, AI Business

Business Analyst

Andersen is hiring a Business Analyst in Germany to support a large AI-driven di...
Location
Location
Germany
Salary
Salary:
Not provided
andersenlab.com Logo
Andersen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working as a Business Analyst in software or data-driven environments for 5+ years
  • Experience working on AI/ML or GenAI initiatives, including model-driven features, automation, RAG, and LLM-based products
  • Ability to collect, analyse, and document business requirements for AI systems with unclear or evolving problem spaces
  • Understanding of AI fundamentals, including data quality, model lifecycle, inference vs. training, evaluation metrics, risks, and limitations
  • Experience transforming business needs into clear functional and non-functional requirements for AI teams
  • Strong skills in process analysis, workflow definition, and optimisation for AI-enabled use cases
  • Ability to analyse data sources, constraints, privacy implications, and readiness for AI use
  • Experience preparing user stories, acceptance criteria, and success metrics for AI features
  • Ability to work closely with Data Science, ML Engineering, Product, and Software Engineering teams
  • Strong stakeholder communication skills, with the ability to explain AI capabilities and limitations in simple terms
Job Responsibility
Job Responsibility
  • Gathering and documenting business requirements for AI/ML and GenAI initiatives, ensuring clarity for both technical and non-technical teams
  • Analyzing business processes and identifying opportunities where AI can improve efficiency, accuracy, or decision-making
  • Translating requirements into functional specifications, user stories, acceptance criteria, and measurable outcomes
  • Collaborating with Data Scientists and ML Engineers to align requirements with model capabilities and data constraints
  • Analyzing available data sources and assessing data readiness for AI use, including quality, structure, gaps, and risks
  • Facilitating communication between business stakeholders and technical teams to ensure expectations and limitations are well understood
  • Supporting product discovery and experimentation cycles (PoCs, prototypes, pilots), capturing learnings and shaping next steps
  • Reviewing and validating AI feature outputs, model behaviour, and user experience against defined acceptance criteria
  • Preparing process diagrams, workflows, documentation, and decision materials related to AI-enabled solutions
  • Monitoring the performance of delivered AI features and supporting iterative improvements based on user feedback and insights
What we offer
What we offer
  • Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others
  • The opportunity to change the project and/or develop expertise in an interesting business domain
  • Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant
  • Guarantee of professional, financial, and career growth
  • The company has introduced systems of mentoring and adaptation for each new employee
  • The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities
  • Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated
  • Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies)
  • Certification compensation (AWS, PMP, etc)
  • Referral program
Read More
Arrow Right

Business Analyst

The BA will bridge domain experts and engineering teams to deliver a spectrum of...
Location
Location
Saudi Arabia , Khobar
Salary
Salary:
Not provided
beyond.ai Logo
Beyond Limits
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS in Information Systems, Computer Science, Software Engineering, or a related field
  • 3+ years of experience as a BA on technical projects, including software application development, AI solution delivery, dashboard and reporting, and data integration efforts, preferably in Oil & Gas or similar industries
  • Proven ability to manage and align cross-functional stakeholders toward shared project goals
  • Strong visualization skills using Visio/Lucidchart for process mapping, Figma/Sketch for wireframes, and Power BI/Tableau for dashboard mock-ups
  • Excellent communication and active listening skills
  • adept at eliciting, clarifying, and translating stakeholder needs into clear, actionable software requirements
  • In-depth knowledge of Agile and Waterfall methodologies, backlog grooming, and sprint planning
  • Working knowledge of RESTful APIs, database structures, frontend frameworks (React, Angular), and basic DevOps practices
  • Proficient with tools such as Jira, Confluence, SQL clients, and scripting for data validation (Python/JavaScript)
  • Fluent in both Arabic and English a must
Job Responsibility
Job Responsibility
  • Conduct interviews and workshops with business owners, engineers, and data scientists to capture functional and non-functional requirements
  • Use active listening to distill complex needs into precise documentation
  • Produce user stories, acceptance criteria, process flows, ER diagrams, UI wireframes, and functional specs
  • Create mock-ups and interactive prototypes (using Figma or similar) for both AI-enabled features and traditional software modules (dashboards, forms, reporting screens)
  • Maintain and prioritize a combined AI/software backlog: data prep tasks, UI enhancements, API endpoints, and integration tasks
  • Lead backlog grooming sessions to ensure clarity and feasibility for development sprints
  • Partner with AI engineers, Data Scientists, frontend/backend developers, QA engineers, DevOps, and data teams to validate solutions and ensure requirements are implemented correctly
  • Act as liaison between waterfall-oriented stakeholders and agile development teams to maintain alignment on scope, timelines, and quality
  • Present requirement artifacts and progress updates using clear, visually engaging dashboards
Read More
Arrow Right

Business Analyst

The BA will bridge domain experts and engineering teams to deliver a spectrum of...
Location
Location
Qatar , Doha
Salary
Salary:
Not provided
beyond.ai Logo
Beyond Limits
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS in Information Systems, Computer Science, Software Engineering, or a related field
  • 8+ years of experience as a BA on technical projects, including software application development, AI solution delivery, dashboard and reporting, and data integration efforts, preferably in Oil & Gas or similar industries
  • Proven ability to manage and align cross-functional stakeholders toward shared project goals
  • Strong visualization skills using Visio/Lucidchart for process mapping, Figma/Sketch for wireframes, and Power BI/Tableau for dashboard mock-ups
  • Excellent communication and active listening skills
  • adept at eliciting, clarifying, and translating stakeholder needs into clear, actionable software requirements
  • In-depth knowledge of Agile and Waterfall methodologies, backlog grooming, and sprint planning
  • Working knowledge of RESTful APIs, database structures, frontend frameworks (React, Angular), and basic DevOps practices
  • Proficient with tools such as Jira, Confluence, SQL clients, and scripting for data validation (Python/JavaScript)
  • Fluent in both Arabic and English
Job Responsibility
Job Responsibility
  • Conduct interviews and workshops with business owners, engineers, and data scientists to capture functional and non-functional requirements
  • Use active listening to distill complex needs into precise documentation
  • Produce user stories, acceptance criteria, process flows, ER diagrams, UI wireframes, and functional specs
  • Create mock-ups and interactive prototypes (using Figma or similar) for both AI-enabled features and traditional software modules
  • Maintain and prioritize a combined AI/software backlog: data prep tasks, UI enhancements, API endpoints, and integration tasks
  • Lead backlog grooming sessions to ensure clarity and feasibility for development sprints
  • Partner with AI engineers, Data Scientists, frontend/backend developers, QA engineers, DevOps, and data teams to validate solutions and ensure requirements are implemented correctly
  • Act as liaison between waterfall-oriented stakeholders and agile development teams to maintain alignment on scope, timelines, and quality
  • Present requirement artifacts and progress updates using clear, visually engaging dashboards
Read More
Arrow Right

Senior Business Analyst

We are hiring a Senior Analyst to partner closely with our Healthcare Product te...
Location
Location
United States , Boston
Salary
Salary:
120000.00 - 155000.00 USD / Year
whoop.com Logo
Whoop
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in a deeply strategic/analytical role, including partnership with clinical, product, data science, or engineering teams
  • Able to take broad questions, wrangle appropriate data, quickly isolate and model key insights, visualize results and communicate actionable recommendations
  • Strong storytelling skills – able to create compelling and concise presentations that convey actionable solutions to complex, ambiguous problems
  • Demonstrated success in influencing senior stakeholders and leadership on strategic direction based on analytical recommendations
  • Experience working with data engineering and development teams on complex datasets
  • Advanced skills in SQL and general understanding of ELT (dbt) and data warehousing (Snowflake) structures, as well as data visualization (eg. Amplitude, Sigma, Hex). Python is a plus
  • Strong commitment to embracing and leveraging AI tools in day-to-day tasks, ensuring AI-assisted work aligns with the same high-quality standards as personal contributions
Job Responsibility
Job Responsibility
  • Collaborate closely with Product, Digital & Connected Health, Software, UX, Data Science, Marketing, and Strategic Finance teams to break down and prioritize the product strategy and roadmap
  • Develop a deep understanding of WHOOP's database and tools to effectively drive data-driven proposals to internal stakeholders on necessary changes
  • Help build and refine health-specific KPIs, including engagement with relevant features, adoption of recommended behaviors, and member-reported value
  • Uncover insights about key member segments — including those managing hormonal health, cardiometabolic health, or looking for more personalized wellness support
  • Create repeatable tools and processes for analytics across new health features and algorithms— from data pipelines to dashboards and weekly health performance reviews
  • Collaborate with a high-performance team in a fast-paced environment, providing thought leadership to identify the most impactful ways to drive decisions and improve retention
What we offer
What we offer
  • equity package
  • Fulltime
Read More
Arrow Right

Senior Business Analyst

We’re hiring a Senior Business Analyst to join our central Business Analytics te...
Location
Location
United Kingdom
Salary
Salary:
Not provided
prolific.com Logo
Prolific
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience working with senior leadership to shape decisions
  • Ability to understand business drivers across GTM, Finance, Support, CX, and Product, and connect them to insights
  • Ability to influence without authority, build cross-org alignment, and challenge assumptions constructively
  • Strong judgment and comfort navigating ambiguity, trade-offs, and competing priorities
  • Exceptional communicator able to synthesise data into compelling stories and clear recommendations
  • Experience developing KPI frameworks, performance diagnostics, and insight narratives that drive action
  • Bias for clarity, precision, and “so-what” impact
  • Actively identifies opportunities and issues before they surface
  • Comfort structuring ambiguous areas from first principles
  • Ability to ask (and reframe) the right questions to unlock insight
Job Responsibility
Job Responsibility
  • Lead high-impact analyses that clarify performance, diagnose issues, and inform strategic decisions
  • Build KPI frameworks and business-health reporting tailored to senior leadership
  • Own analytical workstreams feeding business reviews, forecasting inputs, and executive updates
  • Act as a trusted partner to senior leaders, providing clarity, structure, and insight
  • Drive alignment on metrics, definitions, and success criteria across teams
  • Translate analysis into clear next steps that enable accountability and action
  • Identify leading indicators, emerging risks, and opportunities ahead of time
  • Understand the mechanics of our marketplace deeply and connect patterns across supply, demand, pricing, operations, and customer behaviours
  • Highlight where interventions are needed and recommend strategic and operational responses
  • Build scalable dashboards and reporting that underpin decision-making across the business
What we offer
What we offer
  • competitive salary
  • benefits
  • remote working
  • impactful, mission-driven culture
Read More
Arrow Right

Senior Technical Writer + Business Analyst

We are seeking an experienced Technical Writer with 5-7 years of expertise in cr...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
fissionlabs.com Logo
Fission Labs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experienced technical writer for writing reports, recommendations and detailed analysis of deeply technical subjects
  • Standard Technical Writer profile with 5-7 years experience as the base requirement
  • To be sourced from the experienced Tech Writer community in Services or Product firms
  • Experience in writing product manuals, creating write ups for client proposal etc
  • Experience in helping the corporate communication team in writing blogs and other communication write ups
  • Prior experience in working on Tech Report authoring in AI space will be an added advantage
  • Bachelor’s degree (or equivalent) in journalism, communications, or relevant technical field
  • Firm understanding of SDLC (systems development lifecycle)
  • Previous experience in software development
  • Professional certification (ex: Society for Technical Communication)
Job Responsibility
Job Responsibility
  • Writing reports, recommendations and detailed analysis of deeply technical subjects
  • Writing product manuals, creating write ups for client proposals
  • Helping the corporate communication team in writing blogs and other communication write ups
  • Collaborating across product, engineering, and corporate communication teams to produce high-quality reports, recommendations, blogs, and internal/external communication materials
What we offer
What we offer
  • Opportunity to work on technical challenges with global impact
  • Vast opportunities for self-development, including online university access and sponsored certifications
  • Sponsored Tech Talks & Hackathons
  • Generous benefits package including health insurance, retirement benefits, flexible work hours, and more
  • Supportive work environment with forums to explore passions beyond work
  • Fulltime
Read More
Arrow Right

Senior Quality Analyst

The role focuses on quality engineering and automation strategy for the Global F...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in functional and non-functional software testing
  • 3+ years of experience as Test Automation Lead
  • Expertise in test automation frameworks / tools like Jenkins, Selenium, Cucumber, TestNG, Junit, Cypress
  • Strong programming skills in Java, Python or any other programming or scripting language
  • Expertise in SQL
  • Experience with API testing tools (Postman, RestAssured) and performance testing tools (JMeter, LoadRunner)
  • Expertise in build tools like Maven / Gradle, continuous integration tools like Jenkins, source management tools like Git/GitHub
  • Strong knowledge of Agile, Scrum, and DevOps practices
  • Strong knowledge of functional Test tool (JIRA)
  • Familiarity with cloud-based test execution – AWS, Azure, or GCP
Job Responsibility
Job Responsibility
  • Plan, lead, and execute testing automation strategy for CitiFTP
  • Continuously monitor automation coverage and enhance the existing automation framework to increase the automation coverage
  • Design, Develop, and Implement scalable and maintainable automation frameworks for UI, API, and data validation testing on Big Data/Hadoop platform
  • Collaborate with other testing areas, development teams, product owners, and business partners to integrate automation into the agile SDLC
  • Enhance the efficiency of regression, and end-to-end testing using automation
  • Develop robust test scripts and maintain automation suites to support rapid software releases
  • Improve overall test coverage, defect detection, and release quality through automation
  • Establish and track key QA metrics e.g. defect leakage, test execution efficiency, automation coverage
  • Advocate for best practices in test automation, including code reviews, re-usability and maintainability
  • Drive the adoption of AI/ML-based testing tools and emerging trends in test automation
What we offer
What we offer
  • Global workforce benefits designed to support well-being, growth, and work-life balance
  • Fulltime
Read More
Arrow Right

Senior NetSuite Business Systems Analyst

At WHOOP, we're on a mission to unlock human performance and healthspan. WHOOP e...
Location
Location
United States , Boston
Salary
Salary:
145000.00 - 175000.00 USD / Year
whoop.com Logo
Whoop
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS in Information Systems, Computer Science, Business, or equivalent experience
  • 5+ years of experience in NetSuite administration, business systems analysis, or consulting with both functional and technical responsibilities
  • Strong understanding of NetSuite financials (GL, AP, AR, Revenue) and operational modules
  • Hands-on experience with SuiteScript (1.0/2.0), workflows, custom objects, and NetSuite APIs
  • Experience designing and supporting integrations with NetSuite (e.g., middleware, APIs, ETL tools)
  • Ability to translate business processes into scalable system designs and technical requirements
  • Excellent problem-solving skills with strong attention to detail and analytical rigor
  • Effective communication skills, with proven success collaborating across technical and non-technical teams
  • Strong commitment to embracing and leveraging AI tools in day-to-day tasks, ensuring AI-assisted work aligns with the same high-quality standards as personal contributions
Job Responsibility
Job Responsibility
  • Serve as the NetSuite subject matter expert, partnering with Finance, Operations, and cross-functional teams to understand business needs and deliver solutions
  • Partner with stakeholders to gather business requirements and translate them into scalable NetSuite solutions
  • Configure and customize NetSuite, including workflows, custom records, scripts (SuiteScript), and saved searches
  • Design and implement integrations between NetSuite and other business-critical systems in collaboration with Engineering
  • Lead requirements gathering, solution design, testing, and deployment for NetSuite enhancements and projects
  • Support and optimize end-to-end financial and operational processes, including order-to-cash, procure-to-pay, and revenue recognition
  • Develop technical documentation, process guides, and training for end users
  • Proactively identify opportunities for automation and efficiency improvements across systems and workflows
What we offer
What we offer
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right