CrawlJobs Logo

Senior QA Engineer (AI-based)

United Arab Emirates, Dubai · Job Posted May 20, 2026
Apply Position
Job Link Share

Job Description

We are seeking a detail-oriented Senior QA Engineer to keep the quality assurance efforts across our complex data flows and AI-driven products, specifically focusing on conversational agents. This role requires a blend of automation expertise and strong analytical skills to define quality standards, validate complex data outputs, and ensure the reliable and responsible behavior of our generative AI systems.

Job Responsibility

  • Expertise in quality assurance efforts for data pipelines, APIs, and conversational agents
  • Design and execute generative AI testing scenarios, including exploratory testing for chatbot interactions, intent recognition, tone, and edge-case behavior
  • Experience in LLM test designs, including prompt and grounding validation, golden sets, and non-deterministic assertions
  • Perform crucial safety and quality checks, such as testing for hallucination, bias, toxicity, and PII leakage
  • Validate structured and unstructured data outputs, ensuring consistency, accuracy, and compliance
  • Establish and drive real-time testing approaches, including streaming data validation and API monitoring
  • Collaborate with ML and NLP teams to define comprehensive evaluation metrics and criteria for agent performance
  • Integrate AI-driven tools (like Copilot) into the QA lifecycle to accelerate test design, documentation, and defect analysis

Requirements

  • 5+ years of experience in QA engineering, with proven experience in testing data systems or AI applications
  • Strong analytical skills and attention to detail, capable of spotting subtle inconsistencies in data and agent behavior
  • Proficiency in Python and SQL for data validation, automation scripting, and test preparation
  • Experience with API testing (REST/GraphQL automation and validation)
  • Familiarity with chatbot frameworks, LLMs, or conversational testing
  • (Desirable) Experience or strong interest in using LLM-based assistants (e.g., GitHub Copilot, ChatGPT) in test and execution
  • (Desirable) Exposure to QA automation tools (e.g., PyTest, Postman, dbt tests)

Nice to have

  • Experience or strong interest in using LLM-based assistants (e.g., GitHub Copilot, ChatGPT) in test and execution
  • Exposure to QA automation tools (e.g., PyTest, Postman, dbt tests)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior QA Engineer (AI-based)

8 matching positions

Senior Automation Test Engineer

Our customer is among the top-5 health insurance companies in the US. They are d...
Location
Location
Argentina , Buenos Aires
Salary
Salary:
Not provided
eleks.com Logo
ELEKS
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5 years of professional experience in test automation engineering, with a proven track record of framework development
  • Proficient in Java, including experience with TestNG and/or JUnit for building automated test suites
  • Demonstrated expertise in Selenium WebDriver (web) and Appium (mobile) for UI automation. qTest skills
  • Strong knowledge of secure coding/testing principles, as well as QA methodology and best practices
  • Hands-on experience with GitHub Copilot or other AI-based coding assistants
  • Proficiency in Git, including the use of branching workflows, code reviews, and pull requests
  • Familiarity with CI/CD tools (Jenkins, GitLab CI, etc.) and build tools (Maven, Gradle)
  • Good understanding of web technologies (HTML, CSS, JavaScript) and modern software architectures
  • Experience with Postman or REST Assured for API testing
  • At least Upper-Intermediate level of English
Job Responsibility
Job Responsibility
  • Review, analyse and assess project requirements and specifications as well as product functionality to convert them into quality control process artefacts
  • Prepare and acquire test data
  • Develop, execute, refactor and optimize automation scripts
  • Log and evaluate results and document deviations from the expected results
  • Use automation scripts administration, monitoring, and management tools
  • Provide automation test environment setup
  • Review test artefacts developed by others
  • Contribute to automation process control definition and improvement
  • Provide new automation tools or approaches investigation and implementation
  • Provide test documentation creation
What we offer
What we offer
  • Close cooperation with a customer
  • Challenging tasks
  • Competence development
  • Ability to influence project technologies
  • Team of professionals
  • Dynamic environment with low level of bureaucracy
Read More
Arrow Right

Senior Software Development Engineer in Test

Join ResMed: A Global Leader in Digital Health. At ResMed, we're changing lives ...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
resmed.com Logo
ResMed
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or a related technical field involving coding
  • 5+ years of experience in software testing, including manual and automated testing
  • Proven ability to develop and execute automated test scripts using tools like Cypress and Playwright, with hands-on experience testing across iOS and Android platforms, and integrating with AWS-based environments
  • Experience designing and maintaining test automation frameworks in JavaScript or Python
  • Familiarity with mobile test automation tools and platforms such as UI Testing, XCUITest (iOS), UI Automator (Android), and experience testing on both Android and iOS devices
  • Strong knowledge of REST API testing with tools like Rest Assured and JMeter
  • Hands-on experience with cloud-based architectures, including microservices, multitenancy, and batch services
  • Proficiency in AWS and continuous integration tools such as GitHub Actions or similar
  • Experience using tools and platforms like JIRA, Confluence, Git and Cucumber
  • Understanding of Agile and Scrum methodologies and the product development lifecycle
Job Responsibility
Job Responsibility
  • Leverage AI-powered tools (e.g., GitHub Copilot, ChatGPT, custom LLMs) to accelerate test case generation, automation script development, and step definition creation
  • Design, develop, and maintain intelligent test automation frameworks that incorporate AI to improve scalability, accuracy, and maintainability
  • Implement machine learning techniques and data analysis to identify high-risk areas, guide exploratory testing, and prioritize test coverage
  • Build and optimize CI/CD pipelines that integrate AI-driven static code analysis, test selection, and failure prediction mechanisms
  • Collaborate with development and quality teams to define and evolve strategies for AI-assisted quality assurance, ensuring testability is built into product design
  • Evaluate and introduce AI-based test optimization tools to reduce redundant testing and improve regression cycles
  • Monitor and maintain automation coverage using AI tools to detect gaps, outdated tests, and potential redundancies in the test suite
  • Participate in code reviews and architecture discussions, offering insight into how AI can support testability, performance validation, and risk assessment
  • Mentor junior engineers in the use of AI-driven tools for test development and debugging workflows
  • Research and stay informed on the latest trends in AI for software testing, including generative testing, predictive QA, autonomous test agents, and prompt engineering
What we offer
What we offer
  • bonus plan
  • Working from home flexibility
  • referral bonus
  • ResMed's preferred shareholding programme
  • Internal career opportunity - joining an international fast-pace and massively growing company
  • Fulltime
Read More
Arrow Right

Senior Engineering Lead

We are seeking a Senior Engineering Lead(Individual Contributor) responsible for...
Location
Location
United States , Austin
Salary
Salary:
105600.00 - 180000.00 USD / Year
schwab.com Logo
Charles Schwab
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience
  • 5+ years in technical leadership role
  • Proven experience building large-scale distributed systems
  • Strong backend development (Java/.NET or similar)
  • Deep understanding of System Design, Scalability, Distributed systems, Performance optimization
  • Experience building APIs and microservices
  • Strong Agile experience
  • Experience with CI/CD and test automation
Job Responsibility
Job Responsibility
  • Lead design of large-scale distributed systems (high throughput, low latency)
  • Define architecture for scalability, resiliency, and performance (P95/P99 driven)
  • Make key decisions on data flow, APIs, fault tolerance, and system boundaries
  • Review and approve designs across components and services
  • Build and optimize backend services and APIs (Java/.NET or similar)
  • Solve complex engineering problems in multi-threaded and distributed environments
  • Drive performance tuning, debugging, and system optimization
  • Contribute critical production code
  • Drive adoption of AI-assisted development (Copilot, agentic workflows)
  • Improve productivity through AI-based code generation, Automated testing, Code review acceleration
What we offer
What we offer
  • 401(k) with company match and Employee stock purchase plan
  • Paid time for vacation, volunteering, and 28-day sabbatical after every 5 years of service for eligible positions
  • Paid parental leave and family building benefits
  • Tuition reimbursement
  • Health, dental, and vision insurance
  • Medical, dental and vision benefits
  • Sabbatical leave available after five years of employment
  • Fulltime
Read More
Arrow Right

Senior Platform Consultant - Salesforce

We are looking for an experienced Senior Platform Consultant to design, develop,...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Software Engineering, or a related field (preferred)
  • 3+ years of hands-on Salesforce development experience, including Apex, Aura, Lightning Web Components (LWC), Flows, Triggers, Visualforce, SOQL/SOSL, Salesforce APIs, Metadata, Unit Tests, Approval Processes, and data migration tools
  • Proven experience with Salesforce DX, Visual Studio Code, and Salesforce development tools
  • Proficiency in using Agentforce for Developers (Vibes & Chat) to leverage AI-based development with improved productivity outcomes
  • Experience with inbound and outbound integrations using REST/SOAP APIs
  • Proficient in event-based architecture using Platform Events and Change Data Capture (CDC) to build scalable and reactive solutions
  • Strong understanding of asynchronous programming with Future, Batch, and Queueable Apex to optimize system performance and manage large-scale data processing
  • Excellent problem-solving, debugging, and troubleshooting skills
  • Experience working with Salesforce Nonprofit Cloud (preferred)
  • Ability to understand cloud-specific features and underlying data models, and drive solution design based on those capabilities and constraints
Job Responsibility
Job Responsibility
  • Design, develop, test, and deploy custom Salesforce solutions using Apex, Lightning Components, and related technologies
  • Customize and configure Salesforce to meet evolving business needs, particularly within Nonprofit Cloud environments
  • Develop integrations between Salesforce and third-party applications using APIs and middleware tools
  • Build and maintain custom objects, flows, validation rules, triggers, and automation processes
  • Ensure system performance, scalability, security, and data integrity
  • Collaborate with cross-functional teams including business stakeholders, QA, and project managers to deliver high-quality solutions
  • Perform code reviews, maintain documentation, and follow best practices in Salesforce development
  • Troubleshoot and resolve technical issues while providing ongoing system support and enhancements
  • Design, Customize and implement solutions using OmniStudio (OmniScripts, Data Mappers) to build guided user experiences and scalable declarative architectures
  • Implement, Customize and configure Salesforce DocGen solutions to generate dynamic, template-driven documents such as PDF, DOCX, PPTX, etc.
Read More
Arrow Right

Senior Platform Consultant - Salesforce

We are looking for an experienced Senior Platform Consultant to design, develop,...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Software Engineering, or a related field (preferred)
  • 3+ years of hands-on Salesforce development experience, including Apex, Aura, Lightning Web Components (LWC), Flows, Triggers, Visualforce, SOQL/SOSL, Salesforce APIs, Metadata, Unit Tests, Approval Processes, and data migration tools
  • Proven experience with Salesforce DX, Visual Studio Code, and Salesforce development tools
  • Proficiency in using Agentforce for Developers (Vibes & Chat) to leverage AI-based development with improved productivity outcomes
  • Experience with inbound and outbound integrations using REST/SOAP APIs
  • Proficient in event-based architecture using Platform Events and Change Data Capture (CDC) to build scalable and reactive solutions
  • Strong understanding of asynchronous programming with Future, Batch, and Queueable Apex to optimize system performance and manage large-scale data processing
  • Excellent problem-solving, debugging, and troubleshooting skills
  • Experience working with Salesforce Nonprofit Cloud (preferred)
  • Ability to understand cloud-specific features and underlying data models, and drive solution design based on those capabilities and constraints
Job Responsibility
Job Responsibility
  • Design, develop, test, and deploy custom Salesforce solutions using Apex, Lightning Components, and related technologies
  • Customize and configure Salesforce to meet evolving business needs, particularly within Nonprofit Cloud environments
  • Develop integrations between Salesforce and third-party applications using APIs and middleware tools
  • Build and maintain custom objects, flows, validation rules, triggers, and automation processes
  • Ensure system performance, scalability, security, and data integrity
  • Collaborate with cross-functional teams including business stakeholders, QA, and project managers to deliver high-quality solutions
  • Perform code reviews, maintain documentation, and follow best practices in Salesforce development
  • Troubleshoot and resolve technical issues while providing ongoing system support and enhancements
  • Design, Customize and implement solutions using OmniStudio (OmniScripts, Data Mappers) to build guided user experiences and scalable declarative architectures
  • Implement, Customize and configure Salesforce DocGen solutions to generate dynamic, template-driven documents such as PDF, DOCX, PPTX, etc.
Read More
Arrow Right

Senior Platform Consultant - Salesforce

We are looking for an experienced Senior Platform Consultant to design, develop,...
Location
Location
Pakistan , Karachi; Lahore; Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Software Engineering, or a related field (preferred)
  • 3+ years of hands-on Salesforce development experience, including Apex, Aura, Lightning Web Components (LWC), Flows, Triggers, Visualforce, SOQL/SOSL, Salesforce APIs, Metadata, Unit Tests, Approval Processes, and data migration tools
  • Proven experience with Salesforce DX, Visual Studio Code, and Salesforce development tools
  • Proficiency in using Agentforce for Developers (Vibes & Chat) to leverage AI-based development with improved productivity outcomes
  • Experience with inbound and outbound integrations using REST/SOAP APIs
  • Proficient in event-based architecture using Platform Events and Change Data Capture (CDC) to build scalable and reactive solutions
  • Strong understanding of asynchronous programming with Future, Batch, and Queueable Apex to optimize system performance and manage large-scale data processing
  • Excellent problem-solving, debugging, and troubleshooting skills
  • Experience working with Salesforce Nonprofit Cloud (preferred)
  • Ability to understand cloud-specific features and underlying data models, and drive solution design based on those capabilities and constraints
Job Responsibility
Job Responsibility
  • Design, develop, test, and deploy custom Salesforce solutions using Apex, Lightning Components, and related technologies
  • Customize and configure Salesforce to meet evolving business needs, particularly within Nonprofit Cloud environments
  • Develop integrations between Salesforce and third-party applications using APIs and middleware tools
  • Build and maintain custom objects, flows, validation rules, triggers, and automation processes
  • Ensure system performance, scalability, security, and data integrity
  • Collaborate with cross-functional teams including business stakeholders, QA, and project managers to deliver high-quality solutions
  • Perform code reviews, maintain documentation, and follow best practices in Salesforce development
  • Troubleshoot and resolve technical issues while providing ongoing system support and enhancements
  • Design, Customize and implement solutions using OmniStudio (OmniScripts, Data Mappers) to build guided user experiences and scalable declarative architectures
  • Implement, Customize and configure Salesforce DocGen solutions to generate dynamic, template-driven documents such as PDF, DOCX, PPTX, etc
Read More
Arrow Right

District Support Pharmacist

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Forney
Salary
Salary:
60.00 - 76.00 USD / Hour
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
September 25, 2026
Flip Icon
Requirements
Requirements
  • Active Pharmacy License in the state in which you are employed
  • Not on the DEA Excluded Parties List
  • Immunization Certification through an accredited organization (i.e. APhA)
  • Free of pending felony charges or convictions for criminal offenses involving controlled substances
Job Responsibility
Job Responsibility
  • Supporting the Pharmacy Manager in leading and directing your Pharmacy Technician Support Staff
  • Supporting the management, oversight and operation of all aspects within your pharmacy including Patient Safety, Pharmacy Professional Practice, Regulatory Requirements, Quality Assurance, Customer Service, Personnel Management, Inventory Management, Financial Profitability, Loss Prevention, Workflow Management
  • Keeping customers and patients healthy through adoption and management of patient care programs
  • Leading with Heart – displaying empathy and compassion for patients, customers, caregivers and colleagues
  • Motivating, inspiring and developing Pharmacy Support Staff
  • Identifying critical business opportunities and contributing to the development of meaningful solutions
  • Implementing solutions by leading the team to achieve specified goals
  • Adapting to change and adjusting plans to thrive in a dynamic community healthcare setting
  • Seeking new ways to grow, collaborate with others and deliver better outcomes
  • Aligning others around purpose to gain support and commitment
What we offer
What we offer
  • Medical, dental, and vision coverage
  • Paid time off
  • Retirement savings options
  • Wellness programs
  • Bonus, commission or short-term incentive program
  • Fulltime
Read More
Arrow Right

Program Management Lead

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6-10 years of experience
  • Negotiate skills with external parties
  • Required Licensing/Registration: Series 6
  • Bachelor’s/University degree or equivalent experience, potentially Masters degree
Job Responsibility
Job Responsibility
  • Supports planning, directing and coordination of day-to-day activities of running a program or portfolio of programs
  • Applies in-depth understanding of how areas collectively integrate within the subfunction as well as coordinate and contribute to the objectives of the entire function
  • and, requires basic commercial awareness
  • Assesses creation and signoff of program plan and charter, benefits management plan, stakeholder management plan, acceptance plan, and central program issue log
  • Oversees program plans meet business needs as described in the program initiation documents
  • Ensures all stakeholders are identified and included in scope definition activities and understand the program schedule and key milestones
  • Works with Program Sponsor to ensure business case cost benefit analysis is in line with business objectives
  • Ensures all areas of the program are appropriately staffed
  • Monitors program commitment from those assigning resources
  • Escalates program risks to the Program Director, or Program Sponsor, when appropriate
  • Fulltime
Read More
Arrow Right