CrawlJobs Logo

Qa - Ai

barclays.co.uk Logo

Barclays

Location Icon

Location:
India , Pune

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

Join Barclays as a QA - AI , you will be involved in designing, developing, and executing testing strategies to validate functionality, performance, and user experience, while collaborating with cross-functional teams to identify and resolve defects, and continuously improve testing processes and methodologies, to ensure software quality and reliability.

Job Responsibility:

  • Development and implementation of comprehensive test plans and strategies to validate software functionality and ensure compliance with established quality standards
  • Creation and execution automated test scripts, leveraging testing frameworks and tools to facilitate early detection of defects and quality issues
  • Collaboration with cross-functional teams to analyse requirements, participate in design discussions, and contribute to the development of acceptance criteria, ensuring a thorough understanding of the software being tested
  • Root cause analysis for identified defects, working closely with developers to provide detailed information and support defect resolution
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations, and actively contribute to the organization's technology communities to foster a culture of technical excellence and growth

Requirements:

  • Understanding of Large Language Models (LLM), LangChain, and LangGraph frameworks
  • Python programming skills with demonstrated ability to architect scalable test automation solutions
  • Deep hands-on experience with Generative AI and Agentic AI implementations in production environments
  • Machine Learning model testing and validation methodologies
  • Natural Language Understanding (NLU) testing strategies
  • Natural Language Processing (NLP) quality assurance
  • Knowledge of prompt engineering and LLM evaluation frameworks (RAGAS, DeepEval, etc.)
  • Familiarity with vector databases for RAG testing
  • Experience with performance and load testing of Gen AI applications
  • Understanding of AI ethics, bias detection and responsible AI testing practices
  • Comprehensive knowledge of AWS services, particularly Bedrock, Lambda and CloudWatch
  • Experience architecting and implementing enterprise-scale cloud-based testing solutions
  • Expert proficiency with version control systems (Git, Stash) and branching strategies
  • Proven experience designing and optimizing CI/CD pipelines using Jenkins, GitLab CI, or similar tools
  • Deep understanding of Agile/Scrum methodology, SDLC best practices, and DevOps culture
  • Demonstrated ability to drive quality initiatives and establish testing excellence across organizations
  • Proven expertise in leading cross-functional collaboration with development, product, and operations teams
  • Experience establishing quality gates and governance frameworks for Gen AI applications
  • Knowledge in UI, mobile and API testing methodologies
  • Advanced proficiency with Behavior-Driven Development (BDD) frameworks and test design patterns
  • Experience with test management and reporting tools including Jira, Xray, ALM, and TestRail

Nice to have:

  • Experience with containerization (Docker, Kubernetes) for test environments
  • Background in data engineering or data quality testing
  • Publications, conference presentations, or contributions to open-source testing frameworks
What we offer:
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness access to wellness rooms, gyms and mental health support
  • Modern workspaces, collaborative areas, and state-of-the-art meeting rooms
  • Facilities include wellness rooms, on-site cafeterias, fitness centers, and tech-equipped workstations

Additional Information:

Job Posted:
February 21, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Qa - Ai

HPC and AI Software QA Engineer

The role involves creating and documenting detailed test plans, collaborating wi...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S or M.S. degree in a related software engineering field is required
  • 8+ years prior experience in software QA testing is required
  • Certifications in software testing such as ISTQB or CMMI are highly desirable
  • Experience in HPC or AI software development testing environments is a plus
  • Excellent communication and team collaboration skills
  • Strong interpersonal skills
  • Ability to collaborate effectively across a geographically distributed cross-functional team
  • Attention to detail and accuracy
  • Ability to use Jira, Confluence, and related software
Job Responsibility
Job Responsibility
  • Create and document detailed test plans, collaborating with software engineers and management as needed
  • Test software components according to written test plans
  • Track software defects and effectively communicate failures to software engineers
  • Review engineering requirements, test plans, and test cases for completeness, accuracy, and consistency
  • Conduct QA audits to identify improvements and apply corrective measures
  • Ensure that all software delivered meets quality expectations
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Inclusion and diversity in the workplace
  • Fulltime
Read More
Arrow Right

HPC and AI Software QA Engineer

The role involves creating and documenting test plans, testing software componen...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S or M.S. degree in a related software engineering field is required
  • 8+ years prior experience in software QA testing is required
  • Certifications in software testing such as ISTQB or CMMI are highly desirable
  • Experience in HPC or AI software development testing environments is a plus
  • Excellent communication and team collaboration skills
  • Strong interpersonal skills
  • Ability to collaborate effectively across a geographically distributed cross-functional team
  • Attention to detail and accuracy
  • Ability to use Jira, Confluence, and related software
Job Responsibility
Job Responsibility
  • Create and document detailed test plans, collaborating with software engineers and management as needed
  • Test software components according to written test plans
  • Track software defects and effectively communicate failures to software engineers
  • Review engineering requirements, test plans, and test cases for completeness, accuracy, and consistency
  • Conduct QA audits to identify improvements and apply corrective measures
  • Ensure that all software delivered meets quality expectations
What we offer
What we offer
  • Comprehensive suite of benefits that supports physical, financial and emotional well-being
  • Career investment programs
  • Inclusive work environment
  • Fulltime
Read More
Arrow Right

HPC And AI Software QA Engineer

The successful candidate will be responsible for validating software that spans ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S or M.S. degree in a related software engineering field is required
  • 7+ years prior experience in software QA testing is required
  • Certifications in software testing such as ISTQB or CMMI are highly desirable
  • Experience in HPC or AI software development testing environments is a plus
  • Excellent communication and team collaboration skills
  • Strong interpersonal skills
  • Ability to collaborate effectively across a geographically distributed cross-functional team
  • Attention to detail and accuracy
  • Ability to use Jira, Confluence, and related software
  • Skills needed are Python, AI Testing, CI/CD Pipeline, Kubernetes.
Job Responsibility
Job Responsibility
  • Create and document detailed test plans, collaborating with software engineers and management as needed
  • Test software components according to written test plans
  • Track software defects and effectively communicate failures to software engineers
  • Review engineering requirements, test plans, and test cases for completeness, accuracy, and consistency
  • Conduct QA audits to identify improvements and apply corrective measures
  • Ensure that all software delivered meets quality expectations.
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion workplace culture.
  • Fulltime
Read More
Arrow Right

Principal QA Automation Engineer w/ AI experience

We seek a Principal QA Automation Engineer with a strong background in Cypress, ...
Location
Location
Argentina , Gran Buenos Aires; Capital Federal; Mar del Plata
Salary
Salary:
Not provided
basicagency.com Logo
BASIC/DEPT®
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands-on experience with Cypress for UI and end-to-end automation testing
  • Expert-level proficiency in TypeScript, JavaScript and Python
  • Proven experience testing AI-powered or machine learning applications, including AI model validation techniques
  • Strong understanding of AWS services (e.g., Lambda, S3, SQS, CloudWatch, ECS/EKS) and how to validate applications deployed in cloud environments
  • Experience with threaded/multi-agent AI tools and how they impact test design and validation
  • Familiarity with version control (Git), containerization (Docker), and CI/CD pipelines (e.g., GitHub Actions, Jenkins, or CircleCI)
  • Strong communication, leadership, and mentoring skills
Job Responsibility
Job Responsibility
  • Lead the design and implementation of end-to-end test automation frameworks using Cypress with TypeScript
  • Define quality strategies for applications with AI/ML components, including deterministic and non-deterministic testing approaches
  • Collaborate with engineering, DevOps, and AI/ML teams to ensure quality across AI-infused features in production environments
  • Build and scale testing strategies for threaded AI applications running in AWS cloud infrastructure
  • Integrate automated tests into CI/CD pipelines to support frequent, reliable deployments
  • Mentor and guide mid- and senior-level QA engineers, setting best practices and driving a culture of quality-first development
  • Evaluate and introduce new tools, libraries, and frameworks to improve test coverage, performance, and developer experience
  • Participate in architectural discussions to ensure testability and reliability are baked into software designs from the start
  • Analyze test results, track quality metrics, and communicate risk and coverage to stakeholders
What we offer
What we offer
  • Premium healthcare through OSDE for the employee and their immediate family members
  • Mendel prepaid card with a monthly allowance for grocery purchases
  • Monthly reimbursements for Wi-Fi/electricity expenses
  • Monthly reimbursements for training/English classes
  • 100% covered “Plan Total” membership at Sportclub
  • Access to a our benefits platform through Bonda
  • A flexible vacation policy
  • Fulltime
Read More
Arrow Right

AI-First Automation Engineer

Instawork is on a mission to create meaningful economic opportunities for skille...
Location
Location
United States , San Francisco
Salary
Salary:
120000.00 - 150000.00 USD / Year
instawork.com Logo
Instawork
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 1+ years of experience in AI model development and proficient in testing, evaluating and setting model quality standards
  • 2+ years of experience in QA automation
  • BS or MS in Computer Science or related field
  • Programming experience in Python + Javascript or similar language
  • Thorough knowledge of automation testing frameworks, tools and release processes
  • Self-motivated, especially in learning new software tools and best practices in software quality assurance
  • Startup mentality: self-starter, multi-tasker, proactive and flexible
  • Good communication and interpersonal skills
  • You straddle a fine line between QA, software and DevOps engineering
Job Responsibility
Job Responsibility
  • Develop customized AI models for QA data and conduct prompt engineering analysis
  • Implement and evolve QA processes to get effective test signals and scale testing efforts across multiple products
  • Build advanced automation architecture and integrate AI tools, thereby reducing manual intensive repetitive tasks
  • Transform our automation by integrating cutting-edge AI tools and methodologies, creating smarter, faster, and more resilient frameworks that elevate our efficiency and coverage standards
  • Help solve cross-platform testing challenges and contribute impactful ideas to improve quality
  • Build a self-optimizing QA system that scales with the growth of our products
  • Partner with engineering and infrastructure teams to leverage automation for scalable solutions to prevent regressions and ensure reliability of products
What we offer
What we offer
  • Variety of medical, dental, and vision plans with coverage beginning on the date of hire
  • Flexible paid time off
  • At least 8 paid company holidays annually
  • Phone stipend
  • Commuter stipend
  • Supplemental pay on qualified leaves
  • Employee health savings accounts (HSA) contribution
  • Flexible spending plans
  • 401K plan
  • Perkspot - discount program through Lumity
  • Fulltime
Read More
Arrow Right

Qa Analyst

The Quality Assurance (QA) Specialist plays a critical role in ensuring consiste...
Location
Location
Philippines , Imus or Bacoor, Cavite
Salary
Salary:
Not provided
appen.com Logo
Appen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Previous experience in quality assurance, content moderation is highly preferred
  • Proficient in English – reading, writing, speaking, and listening (B2 level or higher)
  • College graduate is a must but those with relevant experience will be considered
  • Candidates must demonstrate a willingness to work on-site with a flexible schedule at our office locations in Imus or Bacoor, Cavite
Job Responsibility
Job Responsibility
  • Conduct Daily QA Audits Performs a set number of quality audits each day to ensure adherence to processes, guidelines, and client requirements
  • Monitor Quality Updates Tracks and reviews all quality-related updates received from the client to ensure timely dissemination and correct implementation
  • Data Quality Assurance: Make sure all annotations are accurate and consistent by following set guidelines and standards
  • Documentation: Keep clear records of your work, including any issues or findings from the comparison process
  • Continuous Improvement: Suggest ways to improve tools and processes based on your experience and insights from the tasks
  • Provide on-the-floor support, answer associate queries, and clarify quality-related concerns in real time
  • Publish and distribute daily QA performance reports to relevant stakeholders
Read More
Arrow Right
New

Conversational AI QA Engineering Lead Director

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Hartford
Salary
Salary:
144200.00 - 288400.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • 10+ years of experience in QA leadership roles, with at least 5 years focused on cloud-native environments (IBM & Azure highly preferred) testing conversational AI solutions, including voice and chatbots
  • 10+ years of experience translating complex QA strategies into strategic business outcomes
  • 10+ years of experience with QA automation and scripting using languages such as Java, Python, or Node.js
  • 7+ years of experience as a QA lead for large-scale AI or digital transformation programs working in a high-performance Agile environment
  • Strong understanding of conversational AI technologies (e.g., chatbots, voice assistants, LLMs, STT/TTS, NLU/NLP engines) and QA techniques for validating these technologies, including model testing, regression, and performance validation
  • Bachelor’s degree or equivalent experience (HS diploma + 4 years relevant QA experience)
Job Responsibility
Job Responsibility
  • Lead enterprise QA strategy for Conversational AI platforms, ensuring high‑quality, scalable delivery of voice and chatbot solutions aligned with business objectives and customer experience goals
  • Own end‑to‑end quality assurance execution across AI model validation, automation, and manual testing, driving consistent quality outcomes and timely release cycles
  • Build, develop, and inspire high‑performing QA teams, including QA engineers and test managers, fostering a culture of excellence, collaboration, and continuous improvement
  • Establish and evolve QA frameworks, governance, and KPIs to ensure performance, compliance, risk management, and measurable ROI for conversational AI initiatives
  • Champion modern QA practices and emerging technologies, including agile testing methodologies, automation frameworks, and AI‑specific QA tools
  • Partner closely with product, engineering, and leadership teams to identify quality risks, communicate insights and metrics, and proactively improve customer experience
What we offer
What we offer
  • Affordable medical plan options, a 401(k) plan (including matching company contributions), and an employee stock purchase plan
  • No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
  • Benefit solutions that address the different needs and preferences of our colleagues including paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, retiree medical access and many other benefits depending on eligibility
  • Fulltime
!
Read More
Arrow Right

Senior Quality Assurance Engineer

You’ll join as a Senior Quality Assurance Engineer, building the QA function fro...
Location
Location
Poland , Warsaw
Salary
Salary:
40000.00 - 85000.00 USD / Year
dualentry.com Logo
DualEntry
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in Software QA for SaaS/web applications
  • Proven track record in high-growth environments
  • Deep expertise in UI & API testing, bug reporting tools (Jira), and test management (TestRail)
  • Familiarity with CI/CD, AWS, Docker/Kubernetes
  • Experience with Selenium/Cypress
  • knowledge of performance and database testing
  • Strong product intuition and testability thinking
  • Excellent English communication (C1)
  • Ability to work hard (we work most weekends), move fast, and thrive in high-velocity environments
Job Responsibility
Job Responsibility
  • Establish and lead QA practices for a new AI-first SaaS platform
  • Design and execute test strategies across UI, API, and integrations
  • Build and maintain test case management and reporting systems
  • Collaborate closely with founders, engineering, and product to embed QA across development
  • Own bug reporting, triage, and release validation
  • Lay the foundation for future automated testing and CI/CD integration
  • Champion user empathy and customer feedback to drive product reliability
What we offer
What we offer
  • Significant equity ownership
  • Equity: ~$25K+
  • Remote-first team
  • Time Off: 15 PTO days + 12 public holidays
  • Visa sponsorship option for relocation to NYC within 2+ years
  • Early-stage role with high autonomy and real long-term upside
  • Fulltime
Read More
Arrow Right