CrawlJobs Logo
Kiddom Logo Kiddom · IT - Software Development

Senior QA Engineer, AI Experience

United States, San Francisco Or New York 110000.00 - 165000.00 USD / Year · Job Posted January 25, 2026
Apply Position
Job Link Share

Job Description

As a Senior QA Engineer, you will play an important role in ensuring the quality and reliability of our educational platforms. You will work at the intersection of traditional quality assurance and cutting-edge AI technology, contributing to our testing infrastructure and improving learning outcomes for our users. You are expected to exemplify company values and possess the capabilities to keep the team on track through independent project management and process adherence.

Job Responsibility

  • Project Leadership: Keep team projects on track, demonstrating strong ownership and initiative, while effectively managing interactions with cross-functional partner groups
  • Technical Estimation & Strategy: Independently and accurately estimate the QA level of effort (costing) for projects, considering maintenance, timelines, and business pressures
  • Requirement Analysis & Design Feedback: Deeply understand and analyze user stories, product specifications, and requirements to ensure testability. Provide critical feedback on functional issues, acceptance criteria, and design flaws early in the development lifecycle
  • Testing & Debugging: Design and execute comprehensive tests, and debug complex issues, in possibly unfamiliar areas of the application
  • AI Tooling: Proactively integrate AI tools into your QA workflows to improve efficiency and accuracy, while evaluating and recommending specific testing tools (e.g., self-healing scripts, AI-driven test generation) to increase team velocity
  • Testing AI Features: Validate AI-driven educational features, such as personalized learning paths or automated grading systems, ensuring accuracy and bias mitigation
  • Automation & Code Quality: Create complex test scripts, and conduct high-quality code reviews for automated scripts with actionable feedback
  • Documentation: Develop thorough test plans that prioritize maintainability and address immediate business needs. Utilize LLMs to generate test data, summarize bug reports, and create initial drafts of test documentation
  • Defect Management: Conduct in-depth defect analysis to identify root causes and trends, improving overall product quality
  • Support: support customers by triaging user-reported issues

Requirements

  • 5+ years of professional experience in functional manual testing
  • Expert understanding of core QA concepts, testing strategies, and the software test cycle process
  • Deep experience with functional automation tools (Playwright, Selenium, and JUnit, etc.)
  • Proven ability to use AI tools for test automation, bug triage, and test data generation
  • Excellent verbal and written communication skills
  • Strong ability to solve technical issues in both familiar and unfamiliar functionality
  • Excellent attention to detail, high accountability, and the ability to handle problems from start to finish

What we offer

  • Competitive salary
  • Meaningful equity
  • Health insurance benefits: medical (various PPO/HMO/HSA plans), dental, vision, disability and life insurance
  • One Medical membership (in participating locations)
  • Flexible vacation time policy (subject to internal approval). Average use 4 weeks off per year
  • 10 paid sick days per year (pro rated depending on start date)
  • Paid holidays
  • Paid bereavement leave
  • Paid family leave after birth/adoption. Minimum of 16 paid weeks for birthing parents, 10 weeks for caretaker parents. Meant to supplement benefits offered by State
  • Commuter and FSA plans
Kiddom - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior QA Engineer, AI Experience

8 matching positions

Senior QA Engineer, AI Experience

Location
Location
United States , San Francisco; New York
Salary
Salary:
Not provided
kiddom.co Logo
Kiddom
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Can you describe a time when you identified a critical defect late in the development cycle? How did you handle it, and what steps did you take to prevent similar issues in the future?
  • How have you leveraged AI or machine learning tools in your QA process (e.g., test generation, bug triage, self-healing scripts), and what was the impact on efficiency or quality?
  • Describe a time when you encountered a complex testing challenge with minimal guidance. How did you approach the problem, what resources did you leverage, and what was the outcome?
  • Will you need sponsorship to work in the United States? If yes, please explain.
  • Fulltime
Read More
Arrow Right

Senior QA Engineer with AI experience

N-iX is looking for a Senior QA Engineer with AI experience to join our team. We...
Location
Location
Ukraine
Salary
Salary:
Not provided
n-ix.com Logo
N-iX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in manual QA, with exposure to frontend, backend and AI testing
  • Solid experience with API testing using tools such as Postman, REST Client, or similar
  • Experience testing web UIs and understanding of cross-browser/cross-environment considerations
  • Ability to read and interpret API documentation, data schemas, and system architecture descriptions
  • Hands-on experience working on projects that included AI, ML, or NLP components — particularly validating outputs that are probabilistic or context-dependent
  • Familiarity with the concept of RAG (Retrieval-Augmented Generation) or LLM-based systems
  • Strong analytical thinking — especially the ability to assess whether an AI response is contextually correct, not just technically non-null
  • Good understanding of test documentation practices: test plans, test cases, bug reports, traceability
  • English level at least Upper-Intermediate
Job Responsibility
Job Responsibility
  • Follow a phased QA approach — begin with CMS and backend testing to establish a reliable baseline of expected system behavior, then apply those insights to validate AI agent outputs effectively
  • Design and execute test cases for REST APIs, covering functional correctness, edge cases, error handling, authentication, and data integrity
  • Perform UI testing across core user journeys, validating layout, behavior, and integration with backend services
  • Transition into AI output validation once the deterministic layers are stable — using your knowledge of business rules to identify inconsistencies, hallucinations, or degraded outputs in agent responses
  • Document and maintain test cases, test plans, and bug reports in a structured and traceable way
  • Participate in requirement reviews and technical discussions to identify testability gaps early
  • Collaborate with the Lead Big Data/AI Engineer and AI team to understand RAG pipeline behavior, document ingestion flows, and output quality expectations
  • Contribute to building reusable test assets and QA processes as the project scales
What we offer
What we offer
  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits
Read More
Arrow Right

Senior QA Engineer – AI & Conversational Products

We're looking for a Senior QA Engineer who's passionate about quality, thrives i...
Location
Location
Israel
Salary
Salary:
Not provided
radancy.com Logo
Radancy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of QA engineering experience, with at least 2 years in a senior or lead capacity
  • Hands-on experience testing AI/ML features, LLM-based products, or conversational systems (a plus)
  • Strong proficiency with test automation frameworks (e.g., Playwright, Selenium, Cypress, Pytest)
  • Solid understanding of API testing (REST/GraphQL) and tools like Postman or similar
  • Experience with CI/CD pipelines (GitHub Actions, Jenkins, or equivalent)
  • Ability to think like a user and an engineer — identifying failure modes others miss
  • Excellent communication skills and a collaborative approach to cross-functional teamwork
Job Responsibility
Job Responsibility
  • Own the end-to-end quality assurance process for features across web, API, and backend services within Radancy's talent platform
  • Design and implement test strategies for LLM-based features and AI agents — ensuring accuracy, consistency, and robustness at scale
  • Build and maintain automated test frameworks covering UI, API, performance, and regression testing
  • Develop comprehensive test plans and test cases that address both functional requirements and edge scenarios unique to AI-driven hiring experiences
  • Partner closely with Product, Engineering, and Data teams to surface quality gaps early in the development cycle
  • Analyze and report bugs with precision, advocating for high-impact fixes that protect candidate and employer experience
  • Participate in release processes, CI/CD pipeline validation, and production monitoring
Read More
Arrow Right

Senior AI QA Engineer

We are looking for a Senior AI QA Engineer with 8+ years of experience in softwa...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience in Software Quality Assurance
  • Test Planning and Test Strategy
  • Test Automation
  • Selenium
  • Pytest
  • Python
  • API Testing (REST)
  • CI/CD Integration
  • Data Pipeline Testing
  • AI/ML Pipeline Testing
Job Responsibility
Job Responsibility
  • Define and execute test plans, test strategies, and test cases for AI/ML and data-driven applications
  • Design, develop, and maintain automated test frameworks using Selenium and Pytest
  • Perform API testing for RESTful services
  • Validate data pipelines, ETL workflows, and ML model outputs
  • Conduct end-to-end testing across the AI/ML lifecycle, including data ingestion, model training, inference, and deployment
  • Integrate automated test suites into CI/CD pipelines
  • Perform regression, integration, system, and performance testing
  • Identify, document, prioritize, and track defects through resolution
  • Collaborate closely with Data Engineers, ML Engineers, and DevOps teams
  • Ensure adherence to QA standards, best practices, and compliance requirements
  • Fulltime
Read More
Arrow Right

Senior QA Engineer (AI-based)

We are seeking a detail-oriented Senior QA Engineer to keep the quality assuranc...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
parserdigital.com Logo
Parser Limited
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in QA engineering, with proven experience in testing data systems or AI applications
  • Strong analytical skills and attention to detail, capable of spotting subtle inconsistencies in data and agent behavior
  • Proficiency in Python and SQL for data validation, automation scripting, and test preparation
  • Experience with API testing (REST/GraphQL automation and validation)
  • Familiarity with chatbot frameworks, LLMs, or conversational testing
  • (Desirable) Experience or strong interest in using LLM-based assistants (e.g., GitHub Copilot, ChatGPT) in test and execution
  • (Desirable) Exposure to QA automation tools (e.g., PyTest, Postman, dbt tests)
Job Responsibility
Job Responsibility
  • Expertise in quality assurance efforts for data pipelines, APIs, and conversational agents
  • Design and execute generative AI testing scenarios, including exploratory testing for chatbot interactions, intent recognition, tone, and edge-case behavior
  • Experience in LLM test designs, including prompt and grounding validation, golden sets, and non-deterministic assertions
  • Perform crucial safety and quality checks, such as testing for hallucination, bias, toxicity, and PII leakage
  • Validate structured and unstructured data outputs, ensuring consistency, accuracy, and compliance
  • Establish and drive real-time testing approaches, including streaming data validation and API monitoring
  • Collaborate with ML and NLP teams to define comprehensive evaluation metrics and criteria for agent performance
  • Integrate AI-driven tools (like Copilot) into the QA lifecycle to accelerate test design, documentation, and defect analysis
  • Fulltime
Read More
Arrow Right

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Software Quality Assurance and Test Automation
  • Strong expertise in Test Planning, Test Strategy, and Test Execution
  • Hands-on experience with Selenium, Pytest, and Python-based automation
  • Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
  • Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
  • Experience testing Data platforms, ETL pipelines, and large-scale datasets
  • Exposure to AI/ML pipeline testing, including model validation and data quality checks
  • Strong understanding of SDLC, Agile/Scrum, and DevOps practices
  • Excellent analytical, debugging, and communication skills
Job Responsibility
Job Responsibility
  • Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
  • Design, develop, and maintain automation frameworks using Selenium and Pytest
  • Perform API testing (RESTful services) including functional, regression, and integration testing
  • Validate data pipelines, ETL workflows, and data quality checks across large datasets
  • Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
  • Integrate automated test suites into CI/CD pipelines to enable continuous testing
  • Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
  • Perform root cause analysis and drive defect resolution with engineering teams
  • Ensure adherence to QA best practices, SDLC, and Agile methodologies
  • Mentor junior QA engineers and contribute to improving overall QA maturity
What we offer
What we offer
  • Work on cutting-edge Data and AI/ML platforms
  • Hybrid work model across Lahore, Karachi, and Islamabad
  • Opportunity to influence quality strategy at scale
  • Collaborative engineering culture with strong focus on automation and innovation
  • Fulltime
Read More
Arrow Right

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Software Quality Assurance and Test Automation
  • Strong expertise in Test Planning, Test Strategy, and Test Execution
  • Hands-on experience with Selenium, Pytest, and Python-based automation
  • Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
  • Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
  • Experience testing Data platforms, ETL pipelines, and large-scale datasets
  • Exposure to AI/ML pipeline testing, including model validation and data quality checks
  • Strong understanding of SDLC, Agile/Scrum, and DevOps practices
  • Excellent analytical, debugging, and communication skills
Job Responsibility
Job Responsibility
  • Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
  • Design, develop, and maintain automation frameworks using Selenium and Pytest
  • Perform API testing (RESTful services) including functional, regression, and integration testing
  • Validate data pipelines, ETL workflows, and data quality checks across large datasets
  • Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
  • Integrate automated test suites into CI/CD pipelines to enable continuous testing
  • Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
  • Perform root cause analysis and drive defect resolution with engineering teams
  • Ensure adherence to QA best practices, SDLC, and Agile methodologies
  • Mentor junior QA engineers and contribute to improving overall QA maturity
What we offer
What we offer
  • Work on cutting-edge Data and AI/ML platforms
  • Hybrid work model across Lahore, Karachi, and Islamabad
  • Opportunity to influence quality strategy at scale
  • Collaborative engineering culture with strong focus on automation and innovation
  • Fulltime
Read More
Arrow Right

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Software Quality Assurance and Test Automation
  • Strong expertise in Test Planning, Test Strategy, and Test Execution
  • Hands-on experience with Selenium, Pytest, and Python-based automation
  • Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
  • Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
  • Experience testing Data platforms, ETL pipelines, and large-scale datasets
  • Exposure to AI/ML pipeline testing, including model validation and data quality checks
  • Strong understanding of SDLC, Agile/Scrum, and DevOps practices
  • Excellent analytical, debugging, and communication skills
Job Responsibility
Job Responsibility
  • Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
  • Design, develop, and maintain automation frameworks using Selenium and Pytest
  • Perform API testing (RESTful services) including functional, regression, and integration testing
  • Validate data pipelines, ETL workflows, and data quality checks across large datasets
  • Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
  • Integrate automated test suites into CI/CD pipelines to enable continuous testing
  • Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
  • Perform root cause analysis and drive defect resolution with engineering teams
  • Ensure adherence to QA best practices, SDLC, and Agile methodologies
  • Mentor junior QA engineers and contribute to improving overall QA maturity
What we offer
What we offer
  • Work on cutting-edge Data and AI/ML platforms
  • Hybrid work model across Lahore, Karachi, and Islamabad
  • Opportunity to influence quality strategy at scale
  • Collaborative engineering culture with strong focus on automation and innovation
  • Fulltime
Read More
Arrow Right