CrawlJobs Logo

Senior QA Engineer – AI Platform Testing

northbaysolutions.com Logo

NorthBay

Location Icon

Location:
United Arab Emirates , Abu Dhabi

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

NorthBay Solutions is looking for a Senior QA Engineer with strong automation skills to support testing efforts across our AI-driven platforms. In this role, you will ensure the functional accuracy, performance, and quality of features while also contributing to validation of AI model outputs, training data quality, and overall user experience across web and API-based systems.

Job Responsibility:

  • Design, write, and execute test cases to validate features, APIs, and end-to-end system integrations
  • Develop and maintain automated test scripts using Java-based frameworks (e.g., Selenium, TestNG, or similar)
  • Conduct manual and exploratory testing for AI model outputs and user workflows
  • Validate training datasets, detect anomalies, and evaluate model-generated content
  • Log and track defects with comprehensive documentation using bug tracking tools
  • Collaborate closely with Machine Learning, Development, and Automation teams to define test strategies and acceptance criteria
  • Contribute to regression testing cycles and final release validations

Requirements:

  • 7+ years of professional experience in QA or software testing
  • Proven experience in QA automation using Java
  • Solid understanding of Agile methodologies, QA processes, and test lifecycle management
  • Hands-on experience with test management tools (TestRail, Zephyr) and defect tracking tools (JIRA, Azure DevOps)
  • Strong experience with API testing tools such as Postman
  • Excellent analytical skills and attention to detail

Nice to have:

  • Exposure to AI/ML concepts, particularly around testing LLM outputs, computer vision, or NLP systems
  • Experience validating training data quality and evaluating model behavior in production environments

Additional Information:

Job Posted:
January 05, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior QA Engineer – AI Platform Testing

Senior Software Test Engineer

You are passionate about building rock solid software. Now is your chance to do ...
Location
Location
Germany
Salary
Salary:
80000.00 - 90000.00 EUR / Year
linuxrecruit.co.uk Logo
Linux Recruit
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong background in software engineering
  • Ideally with a JVM based language
  • Ability to both write and evaluate clean, maintainable code
  • Solid understanding of modern testing and QA practices and frameworks
  • Experience in automation
  • Real curiosity about AI tools and their testing challenges
  • Collaborative mindset
Job Responsibility
Job Responsibility
  • Take ownership of the end to end of software testing projects within a platform team
  • Support dozens of other engineering teams across the organisation
  • Bring software engineering excellence into testing
  • Work with backend languages such as Kotlin, Java, or Go
  • Drive full automation across the stack
  • Collaborate closely with product managers and engineering leaders
  • Shape solutions that will have an impact far beyond your own team
  • Fulltime
Read More
Arrow Right

Senior Quality Assurance Engineer

You’ll join as a Senior Quality Assurance Engineer, building the QA function fro...
Location
Location
Poland , Warsaw
Salary
Salary:
40000.00 - 85000.00 USD / Year
dualentry.com Logo
DualEntry
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in Software QA for SaaS/web applications
  • Proven track record in high-growth environments
  • Deep expertise in UI & API testing, bug reporting tools (Jira), and test management (TestRail)
  • Familiarity with CI/CD, AWS, Docker/Kubernetes
  • Experience with Selenium/Cypress
  • knowledge of performance and database testing
  • Strong product intuition and testability thinking
  • Excellent English communication (C1)
  • Ability to work hard (we work most weekends), move fast, and thrive in high-velocity environments
Job Responsibility
Job Responsibility
  • Establish and lead QA practices for a new AI-first SaaS platform
  • Design and execute test strategies across UI, API, and integrations
  • Build and maintain test case management and reporting systems
  • Collaborate closely with founders, engineering, and product to embed QA across development
  • Own bug reporting, triage, and release validation
  • Lay the foundation for future automated testing and CI/CD integration
  • Champion user empathy and customer feedback to drive product reliability
What we offer
What we offer
  • Significant equity ownership
  • Equity: ~$25K+
  • Remote-first team
  • Time Off: 15 PTO days + 12 public holidays
  • Visa sponsorship option for relocation to NYC within 2+ years
  • Early-stage role with high autonomy and real long-term upside
  • Fulltime
Read More
Arrow Right

Senior Quality Analyst

The role focuses on quality engineering and automation strategy for the Global F...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in functional and non-functional software testing
  • 3+ years of experience as Test Automation Lead
  • Expertise in test automation frameworks / tools like Jenkins, Selenium, Cucumber, TestNG, Junit, Cypress
  • Strong programming skills in Java, Python or any other programming or scripting language
  • Expertise in SQL
  • Experience with API testing tools (Postman, RestAssured) and performance testing tools (JMeter, LoadRunner)
  • Expertise in build tools like Maven / Gradle, continuous integration tools like Jenkins, source management tools like Git/GitHub
  • Strong knowledge of Agile, Scrum, and DevOps practices
  • Strong knowledge of functional Test tool (JIRA)
  • Familiarity with cloud-based test execution – AWS, Azure, or GCP
Job Responsibility
Job Responsibility
  • Plan, lead, and execute testing automation strategy for CitiFTP
  • Continuously monitor automation coverage and enhance the existing automation framework to increase the automation coverage
  • Design, Develop, and Implement scalable and maintainable automation frameworks for UI, API, and data validation testing on Big Data/Hadoop platform
  • Collaborate with other testing areas, development teams, product owners, and business partners to integrate automation into the agile SDLC
  • Enhance the efficiency of regression, and end-to-end testing using automation
  • Develop robust test scripts and maintain automation suites to support rapid software releases
  • Improve overall test coverage, defect detection, and release quality through automation
  • Establish and track key QA metrics e.g. defect leakage, test execution efficiency, automation coverage
  • Advocate for best practices in test automation, including code reviews, re-usability and maintainability
  • Drive the adoption of AI/ML-based testing tools and emerging trends in test automation
What we offer
What we offer
  • Global workforce benefits designed to support well-being, growth, and work-life balance
  • Fulltime
Read More
Arrow Right

Senior Software Development Engineer in Test

Join ResMed: A Global Leader in Digital Health. At ResMed, we're changing lives ...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
resmed.com Logo
ResMed
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or a related technical field involving coding
  • 5+ years of experience in software testing, including manual and automated testing
  • Proven ability to develop and execute automated test scripts using tools like Cypress and Playwright, with hands-on experience testing across iOS and Android platforms, and integrating with AWS-based environments
  • Experience designing and maintaining test automation frameworks in JavaScript or Python
  • Familiarity with mobile test automation tools and platforms such as UI Testing, XCUITest (iOS), UI Automator (Android), and experience testing on both Android and iOS devices
  • Strong knowledge of REST API testing with tools like Rest Assured and JMeter
  • Hands-on experience with cloud-based architectures, including microservices, multitenancy, and batch services
  • Proficiency in AWS and continuous integration tools such as GitHub Actions or similar
  • Experience using tools and platforms like JIRA, Confluence, Git and Cucumber
  • Understanding of Agile and Scrum methodologies and the product development lifecycle
Job Responsibility
Job Responsibility
  • Leverage AI-powered tools (e.g., GitHub Copilot, ChatGPT, custom LLMs) to accelerate test case generation, automation script development, and step definition creation
  • Design, develop, and maintain intelligent test automation frameworks that incorporate AI to improve scalability, accuracy, and maintainability
  • Implement machine learning techniques and data analysis to identify high-risk areas, guide exploratory testing, and prioritize test coverage
  • Build and optimize CI/CD pipelines that integrate AI-driven static code analysis, test selection, and failure prediction mechanisms
  • Collaborate with development and quality teams to define and evolve strategies for AI-assisted quality assurance, ensuring testability is built into product design
  • Evaluate and introduce AI-based test optimization tools to reduce redundant testing and improve regression cycles
  • Monitor and maintain automation coverage using AI tools to detect gaps, outdated tests, and potential redundancies in the test suite
  • Participate in code reviews and architecture discussions, offering insight into how AI can support testability, performance validation, and risk assessment
  • Mentor junior engineers in the use of AI-driven tools for test development and debugging workflows
  • Research and stay informed on the latest trends in AI for software testing, including generative testing, predictive QA, autonomous test agents, and prompt engineering
What we offer
What we offer
  • bonus plan
  • Working from home flexibility
  • referral bonus
  • ResMed's preferred shareholding programme
  • Internal career opportunity - joining an international fast-pace and massively growing company
  • Fulltime
Read More
Arrow Right

Senior QA Engineer – AI Platform Testing

NorthBay Solutions is looking for a Senior QA Engineer with strong automation sk...
Location
Location
United Arab Emirates , Abu Dhabi
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional experience in QA or software testing
  • Proven experience in QA automation using Java
  • Solid understanding of Agile methodologies, QA processes, and test lifecycle management
  • Hands-on experience with test management tools (TestRail, Zephyr) and defect tracking tools (JIRA, Azure DevOps)
  • Strong experience with API testing tools such as Postman
  • Excellent analytical skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, write, and execute test cases to validate features, APIs, and end-to-end system integrations
  • Develop and maintain automated test scripts using Java-based frameworks (e.g., Selenium, TestNG, or similar)
  • Conduct manual and exploratory testing for AI model outputs and user workflows
  • Validate training datasets, detect anomalies, and evaluate model-generated content
  • Log and track defects with comprehensive documentation using bug tracking tools
  • Collaborate closely with Machine Learning, Development, and Automation teams to define test strategies and acceptance criteria
  • Contribute to regression testing cycles and final release validations
  • Fulltime
Read More
Arrow Right

Senior QA Engineer – AI Platform Testing

NorthBay Solutions is looking for a Senior QA Engineer with strong automation sk...
Location
Location
United Arab Emirates , Abu Dhabi
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional experience in QA or software testing
  • Proven experience in QA automation using Java
  • Solid understanding of Agile methodologies, QA processes, and test lifecycle management
  • Hands-on experience with test management tools (TestRail, Zephyr) and defect tracking tools (JIRA, Azure DevOps)
  • Strong experience with API testing tools such as Postman
  • Excellent analytical skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, write, and execute test cases to validate features, APIs, and end-to-end system integrations
  • Develop and maintain automated test scripts using Java-based frameworks (e.g., Selenium, TestNG, or similar)
  • Conduct manual and exploratory testing for AI model outputs and user workflows
  • Validate training datasets, detect anomalies, and evaluate model-generated content
  • Log and track defects with comprehensive documentation using bug tracking tools
  • Collaborate closely with Machine Learning, Development, and Automation teams to define test strategies and acceptance criteria
  • Contribute to regression testing cycles and final release validations
  • Fulltime
Read More
Arrow Right

Senior Quality Assurance / SDET Engineer, GenAI/AI Platform

LogicMonitor is looking for a highly skilled Senior QA/SDET with 4 to 5 years of...
Location
Location
India , Pune
Salary
Salary:
Not provided
logicmonitor.com Logo
LogicMonitor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4 to 5 years of experience as an SDET / QA Automation Engineer
  • Strong programming skills in Python or Java
  • Strong hands-on automation experience with: API testing frameworks (PyTest, Requests, RestAssured, etc.), UI testing frameworks (Playwright / Cypress / Selenium), CI/CD automation (GitHub Actions / Jenkins)
  • Strong understanding of: Microservices and distributed systems testing, Asynchronous workflows and queues, Cloud-native architecture and reliability testing
  • Proven ability to build test strategies for: Functional, regression, integration, contract, and performance testing
  • Experience testing LLM-based systems, such as: AI assistants (multi-turn chat), RAG pipelines, Agentic workflows (tool calling, orchestration)
  • Strong understanding of common GenAI failure patterns: Hallucinations, Prompt injection, Retrieval failures, Toxicity and unsafe responses
  • Ability to create evaluation datasets and rubrics for AI correctness
Job Responsibility
Job Responsibility
  • Test Strategy for GenAI Features: Define end-to-end test strategies for GenAI-driven product features
  • Establish quality standards for AI output
  • Automation Framework & End-to-End Testing: Build scalable automation test frameworks for API and UI experiences
  • Automate validation of AI endpoints, workflows, and behaviors
  • Develop regression test packs
  • AI Evaluation (LLM Testing): Create and maintain LLM evaluation test suites
  • Build automated pipelines for drift testing and regression testing
  • Reliability, Performance & Scale Testing: Design and implement performance and load tests for AI systems
  • Ensure AI systems meet SLOs and performance targets
  • Safety, Security & Compliance Testing: Validate AI system robustness against attacks and risks
Read More
Arrow Right

Senior QA Engineer – AI Platform Testing

NorthBay Solutions is looking for a Senior QA Engineer with strong automation sk...
Location
Location
United Arab Emirates , Abu Dhabi
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional experience in QA or software testing
  • Proven experience in QA automation using Java
  • Solid understanding of Agile methodologies, QA processes, and test lifecycle management
  • Hands-on experience with test management tools (TestRail, Zephyr) and defect tracking tools (JIRA, Azure DevOps)
  • Strong experience with API testing tools such as Postman
  • Excellent analytical skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, write, and execute test cases to validate features, APIs, and end-to-end system integrations
  • Develop and maintain automated test scripts using Java-based frameworks (e.g., Selenium, TestNG, or similar)
  • Conduct manual and exploratory testing for AI model outputs and user workflows
  • Validate training datasets, detect anomalies, and evaluate model-generated content
  • Log and track defects with comprehensive documentation using bug tracking tools
  • Collaborate closely with Machine Learning, Development, and Automation teams to define test strategies and acceptance criteria
  • Contribute to regression testing cycles and final release validations
  • Fulltime
Read More
Arrow Right