CrawlJobs Logo

Senior AI QA Engineer

northbaysolutions.com Logo

NorthBay

Location Icon

Location:
Pakistan , Lahore

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

We are looking for a Senior AI QA Engineer with 8+ years of experience in software quality assurance, test automation, and validation of AI/ML and data-driven systems. The role involves defining test strategies, building and maintaining automation frameworks, API testing, CI/CD integration, and end-to-end testing of AI and data pipelines. The ideal candidate will work closely with Engineering, Data, ML, and DevOps teams to ensure high-quality, scalable, and reliable AI solutions in a fast-paced, collaborative environment.

Job Responsibility:

  • Define and execute test plans, test strategies, and test cases for AI/ML and data-driven applications
  • Design, develop, and maintain automated test frameworks using Selenium and Pytest
  • Perform API testing for RESTful services
  • Validate data pipelines, ETL workflows, and ML model outputs
  • Conduct end-to-end testing across the AI/ML lifecycle, including data ingestion, model training, inference, and deployment
  • Integrate automated test suites into CI/CD pipelines
  • Perform regression, integration, system, and performance testing
  • Identify, document, prioritize, and track defects through resolution
  • Collaborate closely with Data Engineers, ML Engineers, and DevOps teams
  • Ensure adherence to QA standards, best practices, and compliance requirements
  • Provide guidance and mentorship to junior QA engineers when required

Requirements:

  • Strong experience in Software Quality Assurance
  • Test Planning and Test Strategy
  • Test Automation
  • Selenium
  • Pytest
  • Python
  • API Testing (REST)
  • CI/CD Integration
  • Data Pipeline Testing
  • AI/ML Pipeline Testing
  • Regression and Integration Testing
  • Defect Tracking and Reporting
  • Git / Version Control

Nice to have:

  • ML model validation (accuracy, drift, bias)
  • Experience with cloud platforms (AWS, Azure, or GCP)
  • Docker and Kubernetes
  • Performance and Load Testing
  • Data Quality and Monitoring frameworks

Additional Information:

Job Posted:
February 02, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior AI QA Engineer

Principal QA Automation Engineer w/ AI experience

We seek a Principal QA Automation Engineer with a strong background in Cypress, ...
Location
Location
Argentina , Gran Buenos Aires; Capital Federal; Mar del Plata
Salary
Salary:
Not provided
basicagency.com Logo
BASIC/DEPT®
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands-on experience with Cypress for UI and end-to-end automation testing
  • Expert-level proficiency in TypeScript, JavaScript and Python
  • Proven experience testing AI-powered or machine learning applications, including AI model validation techniques
  • Strong understanding of AWS services (e.g., Lambda, S3, SQS, CloudWatch, ECS/EKS) and how to validate applications deployed in cloud environments
  • Experience with threaded/multi-agent AI tools and how they impact test design and validation
  • Familiarity with version control (Git), containerization (Docker), and CI/CD pipelines (e.g., GitHub Actions, Jenkins, or CircleCI)
  • Strong communication, leadership, and mentoring skills
Job Responsibility
Job Responsibility
  • Lead the design and implementation of end-to-end test automation frameworks using Cypress with TypeScript
  • Define quality strategies for applications with AI/ML components, including deterministic and non-deterministic testing approaches
  • Collaborate with engineering, DevOps, and AI/ML teams to ensure quality across AI-infused features in production environments
  • Build and scale testing strategies for threaded AI applications running in AWS cloud infrastructure
  • Integrate automated tests into CI/CD pipelines to support frequent, reliable deployments
  • Mentor and guide mid- and senior-level QA engineers, setting best practices and driving a culture of quality-first development
  • Evaluate and introduce new tools, libraries, and frameworks to improve test coverage, performance, and developer experience
  • Participate in architectural discussions to ensure testability and reliability are baked into software designs from the start
  • Analyze test results, track quality metrics, and communicate risk and coverage to stakeholders
What we offer
What we offer
  • Premium healthcare through OSDE for the employee and their immediate family members
  • Mendel prepaid card with a monthly allowance for grocery purchases
  • Monthly reimbursements for Wi-Fi/electricity expenses
  • Monthly reimbursements for training/English classes
  • 100% covered “Plan Total” membership at Sportclub
  • Access to a our benefits platform through Bonda
  • A flexible vacation policy
  • Fulltime
Read More
Arrow Right

Senior AI Product Engineer

As a one person team to start, you are both a product lead and the technical SME...
Location
Location
Australia , Melbourne
Salary
Salary:
Not provided
frankieone.com Logo
FrankieOne
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Recent experience in building AI applications with end to end ownership
  • 10 plus years experience in engineering teams in an Agile environment using JS based frameworks like React
  • 5 plus years developing & supporting Full Stack TS-based SaaS applications production in AWS/Cloud ecosystem
  • Experience in HTML5, ES6, CSS3/Sass, javascript, typescript, React, React Native for Web (optional), npm and other front-end technologies to deliver enterprise grade frontend applications
  • Experience in depth of back-end oriented technologies such as nodejs, typescript for managing BFF
  • Knowledge and experience in tracking technological developments especially AI with vendor offerings and ability to quickly evaluate their value proposition e.g AWS Bedrock
  • Experience in architecting & building enterprise grade AI applications with Data and AI governance, AI gateways, context management (RAG), inference/prompt management, tools/functions (MCP, A2A), memory & fine-tuning
  • Experience in capturing business requirements from stakeholders to documenting, architect and building AI applications for both internal and external users
  • Experience in designing web applications based on AWS well architectured principles, 12 factor web application principles, cloud based software architecture patterns (pub-sub, saga, circuit breaker etc)
  • Experience in designing reactjs based frontend and backend in nodejs or golang
Job Responsibility
Job Responsibility
  • Inspire others
  • Design with quality
  • Collaborate
  • Be proactive
  • Be an advocate for FrankieOne, for our product, and our values
Read More
Arrow Right

Senior Software Test Engineer

You are passionate about building rock solid software. Now is your chance to do ...
Location
Location
Germany
Salary
Salary:
80000.00 - 90000.00 EUR / Year
linuxrecruit.co.uk Logo
Linux Recruit
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong background in software engineering
  • Ideally with a JVM based language
  • Ability to both write and evaluate clean, maintainable code
  • Solid understanding of modern testing and QA practices and frameworks
  • Experience in automation
  • Real curiosity about AI tools and their testing challenges
  • Collaborative mindset
Job Responsibility
Job Responsibility
  • Take ownership of the end to end of software testing projects within a platform team
  • Support dozens of other engineering teams across the organisation
  • Bring software engineering excellence into testing
  • Work with backend languages such as Kotlin, Java, or Go
  • Drive full automation across the stack
  • Collaborate closely with product managers and engineering leaders
  • Shape solutions that will have an impact far beyond your own team
  • Fulltime
Read More
Arrow Right

Senior Quality Assurance Engineer

You’ll join as a Senior Quality Assurance Engineer, building the QA function fro...
Location
Location
Poland , Warsaw
Salary
Salary:
40000.00 - 85000.00 USD / Year
dualentry.com Logo
DualEntry
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in Software QA for SaaS/web applications
  • Proven track record in high-growth environments
  • Deep expertise in UI & API testing, bug reporting tools (Jira), and test management (TestRail)
  • Familiarity with CI/CD, AWS, Docker/Kubernetes
  • Experience with Selenium/Cypress
  • knowledge of performance and database testing
  • Strong product intuition and testability thinking
  • Excellent English communication (C1)
  • Ability to work hard (we work most weekends), move fast, and thrive in high-velocity environments
Job Responsibility
Job Responsibility
  • Establish and lead QA practices for a new AI-first SaaS platform
  • Design and execute test strategies across UI, API, and integrations
  • Build and maintain test case management and reporting systems
  • Collaborate closely with founders, engineering, and product to embed QA across development
  • Own bug reporting, triage, and release validation
  • Lay the foundation for future automated testing and CI/CD integration
  • Champion user empathy and customer feedback to drive product reliability
What we offer
What we offer
  • Significant equity ownership
  • Equity: ~$25K+
  • Remote-first team
  • Time Off: 15 PTO days + 12 public holidays
  • Visa sponsorship option for relocation to NYC within 2+ years
  • Early-stage role with high autonomy and real long-term upside
  • Fulltime
Read More
Arrow Right

Senior Software Quality Engineer (SDET)

We are looking for a highly skilled Senior Software Quality Engineer (SDET) to l...
Location
Location
United States , Mountain View
Salary
Salary:
210000.00 - 257000.00 USD / Year
earnin.com Logo
EarnIn
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in web and mobile testing, with a strong emphasis on test automation
  • Proven expertise in designing and maintaining scalable test automation frameworks
  • Hands-on experience with mobile testing frameworks such as XCUITest (iOS) and Espresso (Android), and web frameworks like Playwright
  • Strong understanding of testing across microservices, APIs, and distributed systems
  • Ability to analyze and debug complex test failures, automation issues, and defects efficiently
  • Familiarity with generative AI applications in quality engineering (test case generation, API contract validation, log intelligence, etc.)
  • Passion for leveraging AI to reduce manual effort, increase coverage, and accelerate release cycles
  • Proven experience supporting weekly release cycles with a mix of manual and automated regression testing
  • Strong analytical, debugging, and problem-solving skills
  • Experience collaborating with global teams across multiple time zones
Job Responsibility
Job Responsibility
  • Lead the design, development, and execution of comprehensive test plans and test cases across frontend (web & mobile), backend services, APIs, and databases
  • Implement industry best practices in manual and automated testing to ensure exceptional product quality, reliability, scalability, and performance
  • Identify, document, and track software defects and inconsistencies with a data-driven, proactive approach to prevention and continuous improvement
  • Introduce and operationalize AI-based testing techniques
  • Integrate AI code analysis, anomaly detection, and observability insights into quality workflows to improve speed, coverage, and accuracy
  • Evaluate and implement emerging AI-driven QA tools to evolve the quality engineering ecosystem
  • Champion an AI-first quality culture by promoting experimentation, learning, and collaboration across engineering teams
  • Design, build, optimize, and maintain scalable automation frameworks using Playwright, Appium, Espresso, XCUITest, REST Assured, and other relevant tools
  • Integrate automated tests into CI/CD pipelines (Jenkins, GitHub Actions, etc.) to ensure fast, reliable, and safe deployments and releases on both apps(iOS and Android) and services
  • Build tooling that empowers developers with self-service test execution, reporting, and analysis
What we offer
What we offer
  • equity
  • healthcare
  • internet/cell phone reimbursement
  • learning and development stipend
  • Fulltime
Read More
Arrow Right

Engineering Director

We are seeking a seasoned Engineering Director who thrives in challenging and fa...
Location
Location
Puerto Rico , Aguadilla
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant work experience as a director or similar position working across multiple stakeholder organizations, with at least 10+ years of people leadership experience specific to SW and Cloud engineering
  • Solid experience leading SW development across storage, networking, on-prem, and SaaS is a must
  • Experience in setting up geographically distributed sites
  • Must have a strong background in software development lifecycle including cloud infrastructure
  • Familiarity with agile methodologies and tools like JIRA
  • Prior experience in cloud product development and deployments
  • end to end ownership and accountability
  • Solid understanding of fundamental AI and machine learning concepts, including supervised and unsupervised learning, deep learning, reinforcement learning, natural language processing, computer vision, and statistical modeling
  • Extensive business acumen, technical knowledge, and industry experience encompassing one or more engineering, technology, and product domains
  • Demonstrated abilities to drive transformation across a business with exceptional skills in the management of change
Job Responsibility
Job Responsibility
  • Oversee the Puerto Rico Site daily operations, strategic planning and cross-functional team leadership for Hybrid Cloud
  • Recruit, mentor, and manage teams of AI/ML engineers, QA Engineers, Design Engineers and innovation specialists to deliver cutting-edge solutions
  • Continuously evaluate new tools, platforms, and frameworks in AI/ML to drive competitive advantage and operational efficiency
  • Ensure alignment with corporate goals while fostering a high-performance culture, operational efficiency, and employee engagement
  • Lead the development and execution of AI/ML strategies that align with business goals and drive innovation across products, services, or operations
  • Create strategic and tactical operations and resource plans, goals, and priorities for assigned organization based on business and technology roadmap and functional objectives
  • Engage with various senior leaders across the organization, program managers, R&D, support, Quality, product managers, technical leaders and executives to communicate program status, escalate issues, and guide and influence strategic decision-making
  • Manage senior relationships and escalated issues with outsourced partners and suppliers, including setting expectations regarding deliverables, product quality, schedules, and costs
  • ensures that organization is effectively leveraging outsourced resources
  • Identify opportunities for and drive organizational initiatives and programs to support business process improvements and cost reductions
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right
New

Senior QA Engineer – AI & Conversational Products

We're looking for a Senior QA Engineer who's passionate about quality, thrives i...
Location
Location
Israel
Salary
Salary:
Not provided
radancy.com Logo
Radancy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of QA engineering experience, with at least 2 years in a senior or lead capacity
  • Hands-on experience testing AI/ML features, LLM-based products, or conversational systems (a plus)
  • Strong proficiency with test automation frameworks (e.g., Playwright, Selenium, Cypress, Pytest)
  • Solid understanding of API testing (REST/GraphQL) and tools like Postman or similar
  • Experience with CI/CD pipelines (GitHub Actions, Jenkins, or equivalent)
  • Ability to think like a user and an engineer — identifying failure modes others miss
  • Excellent communication skills and a collaborative approach to cross-functional teamwork
Job Responsibility
Job Responsibility
  • Own the end-to-end quality assurance process for features across web, API, and backend services within Radancy's talent platform
  • Design and implement test strategies for LLM-based features and AI agents — ensuring accuracy, consistency, and robustness at scale
  • Build and maintain automated test frameworks covering UI, API, performance, and regression testing
  • Develop comprehensive test plans and test cases that address both functional requirements and edge scenarios unique to AI-driven hiring experiences
  • Partner closely with Product, Engineering, and Data teams to surface quality gaps early in the development cycle
  • Analyze and report bugs with precision, advocating for high-impact fixes that protect candidate and employer experience
  • Participate in release processes, CI/CD pipeline validation, and production monitoring
Read More
Arrow Right

Senior QA Engineer with AI experience

N-iX is looking for a Senior QA Engineer with AI experience to join our team. We...
Location
Location
Ukraine
Salary
Salary:
Not provided
n-ix.com Logo
N-iX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in manual QA, with exposure to frontend, backend and AI testing
  • Solid experience with API testing using tools such as Postman, REST Client, or similar
  • Experience testing web UIs and understanding of cross-browser/cross-environment considerations
  • Ability to read and interpret API documentation, data schemas, and system architecture descriptions
  • Hands-on experience working on projects that included AI, ML, or NLP components — particularly validating outputs that are probabilistic or context-dependent
  • Familiarity with the concept of RAG (Retrieval-Augmented Generation) or LLM-based systems
  • Strong analytical thinking — especially the ability to assess whether an AI response is contextually correct, not just technically non-null
  • Good understanding of test documentation practices: test plans, test cases, bug reports, traceability
  • English level at least Upper-Intermediate
Job Responsibility
Job Responsibility
  • Follow a phased QA approach — begin with CMS and backend testing to establish a reliable baseline of expected system behavior, then apply those insights to validate AI agent outputs effectively
  • Design and execute test cases for REST APIs, covering functional correctness, edge cases, error handling, authentication, and data integrity
  • Perform UI testing across core user journeys, validating layout, behavior, and integration with backend services
  • Transition into AI output validation once the deterministic layers are stable — using your knowledge of business rules to identify inconsistencies, hallucinations, or degraded outputs in agent responses
  • Document and maintain test cases, test plans, and bug reports in a structured and traceable way
  • Participate in requirement reviews and technical discussions to identify testability gaps early
  • Collaborate with the Lead Big Data/AI Engineer and AI team to understand RAG pipeline behavior, document ingestion flows, and output quality expectations
  • Contribute to building reusable test assets and QA processes as the project scales
What we offer
What we offer
  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits
Read More
Arrow Right