CrawlJobs Logo
Barclays Logo Barclays · IT - Software Development

Artificial Intelligence QA

India, Bengaluru · Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

You will be involved in designing, developing, and executing testing strategies to validate functionality, performance, and user experience, while collaborating with cross-functional teams to identify and resolve defects, and continuously improve testing processes and methodologies, to ensure software quality and reliability.

Job Responsibility

  • Development and implementation of comprehensive test plans and strategies to validate software functionality and ensure compliance with established quality standards
  • Creation and execution automated test scripts, leveraging testing frameworks and tools to facilitate early detection of defects and quality issues
  • Collaboration with cross-functional teams to analyse requirements, participate in design discussions, and contribute to the development of acceptance criteria, ensuring a thorough understanding of the software being tested
  • Root cause analysis for identified defects, working closely with developers to provide detailed information and support defect resolution
  • Collaboration with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations, and actively contribute to the organization's technology communities to foster a culture of technical excellence and growth

Requirements

  • Understanding of Large Language Models (LLM), LangChain, and LangGraph frameworks
  • Python programming skills with demonstrated ability to architect scalable test automation solutions
  • Deep hands-on experience with Generative AI and Agentic AI implementations in production environments
  • Machine Learning model testing and validation methodologies
  • Natural Language Understanding (NLU) testing strategies
  • Natural Language Processing (NLP) quality assurance
  • Knowledge of prompt engineering and LLM evaluation frameworks (RAGAS, DeepEval, etc.)
  • Familiarity with vector databases for RAG testing
  • Experience with performance and load testing of Gen AI applications
  • Understanding of AI ethics, bias detection and responsible AI testing practices
  • Comprehensive knowledge of AWS services, particularly Bedrock, Lambda and CloudWatch
  • Experience architecting and implementing enterprise-scale cloud-based testing solutions
  • Expert proficiency with version control systems (Git, Stash) and branching strategies
  • Proven experience designing and optimizing CI/CD pipelines using Jenkins, GitLab CI, or similar tools
  • Deep understanding of Agile/Scrum methodology, SDLC best practices, and DevOps culture
  • Demonstrated ability to drive quality initiatives and establish testing excellence across organizations
  • Proven expertise in leading cross-functional collaboration with development, product, and operations teams
  • Experience establishing quality gates and governance frameworks for Gen AI applications
  • Knowledge in UI, mobile and API testing methodologies
  • Advanced proficiency with Behavior-Driven Development (BDD) frameworks and test design patterns
  • Experience with test management and reporting tools including Jira, Xray, ALM, and TestRail

Nice to have

  • Experience with containerization (Docker, Kubernetes) for test environments
  • Background in data engineering or data quality testing
  • Publications, conference presentations, or contributions to open-source testing frameworks

What we offer

  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
Barclays - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Artificial Intelligence QA

8 matching positions

Java Lead – Artificial Intelligence & Machine Learning -Vice President

We’re currently looking for a high caliber professional to join our team as Vice...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12 to 15 years of relevant experience in Apps Development role with hand on coding
  • Demonstrated thought leadership in designing complex and distrusted systems
  • In depth knowledge of Java, Spring, Kafka, Distributed Cache/Systems (e.g. Apache Ignite)
  • Experience with Generative AI (Gen AI) concepts and their application in product development or quality assurance
  • Familiarity with AI-powered development tools such as Copilot
  • Any experience with NoSQL databases like MongoDB is preferred
  • Great exposure to microservices architecture
  • API first design thinking and implementation using Rest
  • Experience with building applications on cloud platform such as Docker, Kubernetes or OpenShift
  • Proven implementation of design patterns and enterprise level architecture
Job Responsibility
Job Responsibility
  • Lead application systems analysis and programming activities, ensuring application design adheres to the overall architecture blueprint
  • Drive product quality and delivery through automation initiatives, especially in generative AI, targeting a fully automated platform with minimal manual QA intervention
  • Partner with management teams to define necessary system enhancements, deploy new products, and resolve high-impact problems through in-depth evaluation of complex business processes
  • Collaborate with development teams and Product Owners to formulate comprehensive requirements and propose innovative, efficient solutions
  • Act as a central point of contact for interdepartmental communication, ensuring alignment and seamless collaboration across various project impacts
  • Provide technical expertise, mentor mid-level developers and analysts, and establish standards for coding, testing, debugging, and implementation
  • Proactively assess risk, ensure compliance with laws and regulations, and maintain clear, concise communication across all organizational levels
  • Fulltime
Read More
Arrow Right
New

AI Engineer (Agentic AI/Multi-Agent Systems)

We are building a next-generation AI-powered software testing platform and are l...
Location
Location
Vietnam , Ho Chi Minh City
Salary
Salary:
Not provided
amaris.com Logo
Amaris Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Artificial Intelligence, Data Science, Software Engineering, Information Systems, or a related field
  • Minimum 3 years of experience in AI Engineering, Machine Learning Engineering, Data Science, or related disciplines
  • Hands-on experience building and deploying Generative AI or LLM-powered applications
  • Strong proficiency in Python and experience building APIs using FastAPI, Flask, or similar frameworks
  • Hands-on experience developing Generative AI or LLM-powered applications using platforms such as OpenAI, Vertex AI, or open-source models
  • Familiarity with Agentic AI frameworks such as LangChain/LangGraph, CrewAI, AutoGen, or LlamaIndex
  • Understanding of Prompt Engineering, RAG, Tool Calling, and AI workflow orchestration
  • Strong analytical and problem-solving skills, with good English communication abilities
Job Responsibility
Job Responsibility
  • Design and develop Agentic AI and Multi-Agent Systems for software testing automation
  • Build and integrate LLM-powered workflows using modern AI frameworks and APIs
  • Develop backend services and APIs to support agent interactions and orchestration
  • Conduct experiments and evaluate AI model performance, accuracy, and reliability
  • Collaborate with Product, QA, and Engineering teams to define and implement AI-driven solutions
  • Deploy, monitor, and maintain AI services in development and testing environments
  • Research emerging AI technologies and recommend improvements to existing solutions
What we offer
What we offer
  • Competitive salary and 13th-month salary
  • 14+ annual leaves per year
  • Premium healthcare insurance, starting from your probation period
  • Project reviews and yearly performance appraisals
  • Annual company trip
  • Teambuilding activities: Team lunch/dinner, events, and celebrations, sports clubs (football, basketball, badminton, pickleball)
  • International team with flexible working time
  • Tailor-made career path
  • Technical workshops and training courses
  • Mobility: Opportunities to be on-site abroad in our offices in over 60+ countries
  • Fulltime
Read More
Arrow Right

AI Lead

We are seeking a highly skilled and experienced Senior AI Engineer a deep unders...
Location
Location
Qatar , Doha
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's in Computer Science, Artificial Intelligence, Machine Learning, or related field
  • 5+ years of experience in AI/ML engineering with end-to-end pipeline development
  • Hands-on experience building and deploying LLM/RAG systems in production
  • Strong experience with public cloud platforms (AWS, Azure, or GCP)
  • 2+ years of experience in asset-heavy industries (e.g., oil & gas, utilities, manufacturing)
  • Proficient in Python and libraries such as Transformers, SentenceTransformers, PyTorch
  • Deep understanding of GenAI infrastructure, LLM APIs, and toolchains like LangChain/LangGraph
  • Experience with RESTful API development and version control using Git
  • Knowledge of vector DBs (Qdrant, FAISS, Weaviate) and similarity-based retrieval
  • Familiarity with Docker, Kubernetes, and scalable microservice design
Job Responsibility
Job Responsibility
  • Design and implement scalable and modular pipelines for data ingestion, transformation, and orchestration across GenAI workloads
  • Manage data and model flow across LLMs, embedding services, vector stores, SQL sources, and APIs
  • Build CI/CD pipelines with integrated prompt regression testing and version control
  • Use orchestration frameworks like LangChain or LangGraph for tool routing and multi-hop workflows
  • Monitor system performance using tools like Langfuse or Prometheus
  • Develop systems to ingest unstructured (PDF, OCR) and structured (SQL, APIs) data
  • Apply preprocessing pipelines for text, images, and code
  • Ensure data integrity, format consistency, and security across sources
  • Integrate external and internal LLM APIs (OpenAI, Claude, Mistral, Qwen, etc.)
  • Build internal APIs for smooth backend-AI communication
  • Fulltime
Read More
Arrow Right

AI / ML Engineer/Lead

We are seeking a highly skilled and experienced Senior AI Engineer to lead the d...
Location
Location
India , Pune; Mumbai; Indore; Jaipur
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s in Computer Science, Artificial Intelligence, Machine Learning, or related field
  • 5+ years of experience in AI/ML engineering with end-to-end pipeline development
  • Hands-on experience building and deploying LLM/RAG systems in production
  • Strong experience with public cloud platforms (AWS, Azure, or GCP)
  • Proficient in Python and libraries such as Transformers, SentenceTransformers, PyTorch
  • Deep understanding of GenAI infrastructure, LLM APIs, and toolchains like LangChain/LangGraph
  • Experience with RESTful API development and version control using Git
  • Knowledge of vector DBs (Qdrant, FAISS, Weaviate) and similarity-based retrieval
  • Familiarity with Docker, Kubernetes, and scalable microservice design
  • Experience with observability tools like Prometheus, Grafana, or Langfuse
Job Responsibility
Job Responsibility
  • Generative AI Pipeline Development
  • Data and Document Ingestion
  • AI Service Integration
  • Retrieval-Augmented Generation (RAG) Pipelines
  • LLM Integration and Optimization
  • Backend Services Ownership
  • Fulltime
Read More
Arrow Right

Operational Reporting and Decision Support Analyst

Collinson is the global, privately-owned company dedicated to helping the world ...
Location
Location
South Africa , Cape Town
Salary
Salary:
Not provided
collinsongroup.com Logo
Collinson
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong knowledge and skills associated with data on Insurance systems, telephony platforms (esp AWS Connect), Microsoft SQL Server, Microsoft SSRS/SSIS/SSAS, Advanced Excel, PowerBI skills
  • Knowledge of SQL Server to store and manage operational data from various systems across the Insurance organisation. Able to build data structures, but to then build advanced data queries using SQL and other toolsets e.g. python
  • Sound understanding of contact centre processes and the ability to apply this knowledge to produce high quality reports for senior management
  • Knowledge of workforce capacity and performance planning and reporting
  • Analytics expertise for operational service functions
  • Knowledge of Insurance operations, technical claims and network areas, and the processes and data, KPIs and dimensions that support their performance tracking
  • Understanding regarding data management and governance
  • Sound stakeholder engagement skills, willing to develop and delight stakeholders
  • Self-motivated, able to use initiative to solve problems and improve work processes
  • Ability to ensure detail is taken care or, accuracy, reliability is built in, with a quality ethos, ensuring that live data reported has been and continues to be correct
Job Responsibility
Job Responsibility
  • Support the sourcing of all data needed to support the servicing organisations (CISEL, CISL etc)
  • Manage all data appropriately, including granularity, retention, access, measures, dimensions, and uses. Coordinate with the data squad, to ensure they provide the data engineering to support the roadmap
  • Support a culture of continuous improvement, efficiency and effectiveness and work to help minimise areas of technical and operational debt (as relates to operational reporting and decision support). Support ways to deliver automation efficiencies
  • Design, build, deliver and maintain a suite of reports, dashboards, data extracts etc on a frequent basis (e.g. Daily, Weekly, forecast plan)
  • Work closely with operational owners to understand existing and future workforce capacity, performance, and outcome metrics, including voice, claims, assistance, complaints, and QA data. Build and maintain reporting to track status and inform decisioning and workforce optimisation across all locations and channels, including tracking all pipeline hiring
  • Enhance reporting to include predictive analytics, focused on KPIs and key ratios to inform and support proactive decisioning. Support the use of advanced tools for dashboards and insights, including PowerBI
  • Support the roll-out of new reporting features to customers and communicate updates with stakeholders
  • Utilise contact centre (voice and workforce) data from AWS Connect and other sources, taking advantage of cloud tools where possible including emerging machine learning and artificial intelligence capabilities
  • Support budgeting, forecasting, reforecasting, and client reporting needs for the operational reporting domain
  • Support the expertise for operational reporting for the Insurance organisation, and feed into the decision-making process
  • Fulltime
Read More
Arrow Right

Issue Management Lead Analyst Vice President

The Chief Operating Office (COO) Chief Administrative Office (COO CAO) is instru...
Location
Location
India , Mumbai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 10 years of experience in technical domains with hands-on responsibilities in analytics projects
  • Prior experience in risk and control, internal audit, quality assurance, or control/monitoring processes is highly advantageous
  • Demonstrated excellence in creating reports and possessing strong data visualization skills
  • Knowledge of Python, SQL, Tableau, and Artificial Intelligence (AI) tools is a significant asset
  • Exceptional technical, programming, and database skills
  • Proven ability to rapidly acquire proficiency in new programming languages to support review teams
  • Documented success in independently leading projects from inception to completion
  • Proven ability to maintain high-quality standards across multiple competing deliverables
  • Superior oral and written communication skills in English
  • Intellectually curious
Job Responsibility
Job Responsibility
  • Serve as a Subject Matter Expert, providing expert opinions across diverse technical domains to ensure timely and high-quality completion of issue remediation
  • Apply strong visualization skills to independently create effective and impactful reports
  • Lead the development and implementation of data analytics projects within the function
  • Support the maintenance and enhancement of IQA's in-house workflow tooling
  • Assist the COO IQA Management Team in establishing and implementing escalation criteria and practices, ensuring timely and appropriate escalation of issues and risks, and accurate reporting to senior management
  • Cultivate strong working relationships with stakeholders and management to facilitate seamless coordination of activities
  • Proactively drive the quality and timely end-to-end completion of projects
  • Contribute to the continuous improvement of COO IQA procedures and coverage through the delivery of high-quality QA Book of Work and reporting products
  • Provide day-to-day analytical and project support to the COO IQA Lead, including review of COO IQA deliverables
  • This is a global position requiring interaction with stakeholders across APAC, EMEA, and NAM, necessitating flexible work timings
  • Fulltime
Read More
Arrow Right

Technical Sales Executive

We are seeking a highly motivated Technical Sales Executive with a strong techni...
Location
Location
Pakistan , Karachi
Salary
Salary:
Not provided
Fleekbiz
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BSCS (Bachelor of Science in Computer Science) — preferred
  • BS Software Engineering
  • BS Information Technology (BSIT)
  • BS Artificial Intelligence
  • BS Data Science
  • BS Computer Engineering
  • Additional coursework or certifications in Web Development, AI/ML, or Cloud Computing will be a plus
  • Experience required 1 to 3 Years
  • Strong understanding of software development lifecycle and modern tech trends
  • Excellent written and verbal communication skills (English proficiency required)
Job Responsibility
Job Responsibility
  • Actively manage bidding on Upwork and similar freelance platforms
  • Identify high-potential client opportunities aligned with our service stack
  • Write tailored, high-quality proposals (not generic templates)
  • Communicate effectively with prospects to understand project scope, tech needs, and business goals
  • Conduct initial discovery conversations to qualify leads and prepare project briefs for technical teams
  • Collaborate with Product Owners for accurate estimations and solution recommendations
  • Maintain proposal metrics, win-rate reports, and client communications in Zoho CRM
  • Assist in preparing Upwork profile updates, case studies, and portfolio maintenance
What we offer
What we offer
  • Market Competitive salary
  • On target achievement 2% Commission
  • Clear growth roadmap with increasing responsibilities and exposure to international clients
  • Transportation facility for the female staff
  • Monetary benefits include Eid Bonuses, Performance Bonuses, EOBI Pension plan, Paid leave compensation
  • Medical benefits: Family healthcare Including maternity, Family OPD reimbursable, Maternal/Paternal leaves
  • In-house recreational facilities: Outdoor sports area, Billiards & Foosball table, Xbox & Media Room, Gym facility
  • Fulltime
Read More
Arrow Right

Principal Software Consultant - AI/ML Engineer

As an ML Team Lead, you will be responsible for leading the technical direction ...
Location
Location
Pakistan , Lahore, Karachi, Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in computer science, Artificial Intelligence, Data Science, Software Engineering, or a related field
  • 7+ years of professional software engineering experience with at least 5 years of hands-on experience building and deploying ML systems into production
  • Prior experience as a Tech Lead, Staff Engineer, or hands-on lead for AI/ML engineering teams
  • Strong expertise in classical machine learning domains such as forecasting, ranking, classification, and optimization
  • Hands-on experience building modern LLM and agentic AI systems including RAG pipelines, tool-using agents, multi-step workflows, and evaluation systems
  • Strong proficiency in Python and backend system development
  • Experience with ML frameworks such as PyTorch or TensorFlow
  • Strong understanding of scalable distributed systems, APIs, system integration, architecture design, and production engineering practices
  • Experience operating ML services at scale, including SLO management, monitoring, on-call practices, and incident response
  • Experience working with Kubernetes-based deployments, CI/CD pipelines, and modern cloud-native engineering practices
Job Responsibility
Job Responsibility
  • Lead the technical direction for the team’s ML and LLM systems, including architecture patterns, platform choices, evaluation frameworks, and engineering standards
  • Stay hands-on by designing and implementing complex ML and agentic AI systems, writing production-grade code, and leading through technical execution
  • Design, develop, and deploy scalable ML and LLM-powered applications and services in production environments
  • Build and optimize AI-powered solutions such as RAG systems, multi-step agents, AI assistants, chatbots, forecasting systems, ranking models, classification models, and optimization systems
  • Drive architecture and design reviews to ensure scalability, reliability, security, and maintainability of AI/ML systems
  • Own the technical roadmap for ML/LLM initiatives and translate business objectives into execution plans and scalable solutions
  • Collaborate closely with Product Managers, Engineers, Data Engineers, MLOps Engineers, QA Engineers, and cross-functional stakeholders to deliver business-aligned AI solutions
  • Establish engineering best practices for prompt engineering, model evaluation, regression testing, observability, and production readiness
  • Define and implement quality standards, evaluation suites, acceptance metrics, and regression plans for all AI/ML features
  • Ensure high availability, scalability, and resilience of tier-1 ML services through SLOs, monitoring, incident response, failover strategies, circuit breakers, and multi-zone deployments
  • Fulltime
Read More
Arrow Right