Senior AI QA Engineer Job at NorthBay (Lahore)

Senior AI QA Engineer

We are seeking a Senior AI QA Engineer with 6–8+ years of experience in software...

Location

India

Salary:

3000000.00 - 3600000.00 INR / Year

NorthBay

Expiration Date

Until further notice

Requirements

Software Quality Assurance
Test Planning and Test Strategy
Test Automation
Selenium
Pytest
Python
API Testing (REST)
CI/CD Integration
Data Pipeline Testing
AI/ML Pipeline Testing

Job Responsibility

Define and execute test planning, test strategy, and test cases for AI/ML and data-driven applications
Develop and maintain automated test frameworks using Selenium and Pytest
Perform API testing for RESTful services
Validate data pipelines, ETL workflows, and ML model outputs
Conduct end-to-end testing across AI/ML lifecycle including data ingestion, training, inference, and deployment
Integrate automated test suites into CI/CD pipelines
Perform regression, integration, system, and performance testing
Identify, document, and track defects to closure
Collaborate with Data Engineers, ML Engineers, and DevOps teams
Ensure adherence to QA standards, best practices, and compliance requirements

Fulltime

Senior QA Engineer – AI & Conversational Products

We're looking for a Senior QA Engineer who's passionate about quality, thrives i...

Location

Israel

Salary:

Not provided

Radancy

Expiration Date

Until further notice

Requirements

5+ years of QA engineering experience, with at least 2 years in a senior or lead capacity
Hands-on experience testing AI/ML features, LLM-based products, or conversational systems (a plus)
Strong proficiency with test automation frameworks (e.g., Playwright, Selenium, Cypress, Pytest)
Solid understanding of API testing (REST/GraphQL) and tools like Postman or similar
Experience with CI/CD pipelines (GitHub Actions, Jenkins, or equivalent)
Ability to think like a user and an engineer — identifying failure modes others miss
Excellent communication skills and a collaborative approach to cross-functional teamwork

Job Responsibility

Own the end-to-end quality assurance process for features across web, API, and backend services within Radancy's talent platform
Design and implement test strategies for LLM-based features and AI agents — ensuring accuracy, consistency, and robustness at scale
Build and maintain automated test frameworks covering UI, API, performance, and regression testing
Develop comprehensive test plans and test cases that address both functional requirements and edge scenarios unique to AI-driven hiring experiences
Partner closely with Product, Engineering, and Data teams to surface quality gaps early in the development cycle
Analyze and report bugs with precision, advocating for high-impact fixes that protect candidate and employer experience
Participate in release processes, CI/CD pipeline validation, and production monitoring

Senior QA Engineer, AI Experience

Location

United States , San Francisco; New York

Salary:

Not provided

Kiddom

Expiration Date

Until further notice

Requirements

Can you describe a time when you identified a critical defect late in the development cycle? How did you handle it, and what steps did you take to prevent similar issues in the future?
How have you leveraged AI or machine learning tools in your QA process (e.g., test generation, bug triage, self-healing scripts), and what was the impact on efficiency or quality?
Describe a time when you encountered a complex testing challenge with minimal guidance. How did you approach the problem, what resources did you leverage, and what was the outcome?
Will you need sponsorship to work in the United States? If yes, please explain.

Fulltime

Senior QA Engineer, AI Experience

As a Senior QA Engineer, you will play an important role in ensuring the quality...

Location

United States , San Francisco Or New York

Salary:

110000.00 - 165000.00 USD / Year

Kiddom

Expiration Date

Until further notice

Requirements

5+ years of professional experience in functional manual testing
Expert understanding of core QA concepts, testing strategies, and the software test cycle process
Deep experience with functional automation tools (Playwright, Selenium, and JUnit, etc.)
Proven ability to use AI tools for test automation, bug triage, and test data generation
Excellent verbal and written communication skills
Strong ability to solve technical issues in both familiar and unfamiliar functionality
Excellent attention to detail, high accountability, and the ability to handle problems from start to finish

Job Responsibility

Project Leadership: Keep team projects on track, demonstrating strong ownership and initiative, while effectively managing interactions with cross-functional partner groups
Technical Estimation & Strategy: Independently and accurately estimate the QA level of effort (costing) for projects, considering maintenance, timelines, and business pressures
Requirement Analysis & Design Feedback: Deeply understand and analyze user stories, product specifications, and requirements to ensure testability. Provide critical feedback on functional issues, acceptance criteria, and design flaws early in the development lifecycle
Testing & Debugging: Design and execute comprehensive tests, and debug complex issues, in possibly unfamiliar areas of the application
AI Tooling: Proactively integrate AI tools into your QA workflows to improve efficiency and accuracy, while evaluating and recommending specific testing tools (e.g., self-healing scripts, AI-driven test generation) to increase team velocity
Testing AI Features: Validate AI-driven educational features, such as personalized learning paths or automated grading systems, ensuring accuracy and bias mitigation
Automation & Code Quality: Create complex test scripts, and conduct high-quality code reviews for automated scripts with actionable feedback
Documentation: Develop thorough test plans that prioritize maintainability and address immediate business needs. Utilize LLMs to generate test data, summarize bug reports, and create initial drafts of test documentation
Defect Management: Conduct in-depth defect analysis to identify root causes and trends, improving overall product quality
Support: support customers by triaging user-reported issues

What we offer

Competitive salary
Meaningful equity
Health insurance benefits: medical (various PPO/HMO/HSA plans), dental, vision, disability and life insurance
One Medical membership (in participating locations)
Flexible vacation time policy (subject to internal approval). Average use 4 weeks off per year
10 paid sick days per year (pro rated depending on start date)
Paid holidays
Paid bereavement leave
Paid family leave after birth/adoption. Minimum of 16 paid weeks for birthing parents, 10 weeks for caretaker parents. Meant to supplement benefits offered by State
Commuter and FSA plans

Fulltime

Senior QA Engineer (AI-based)

We are seeking a detail-oriented Senior QA Engineer to keep the quality assuranc...

Location

United Arab Emirates , Dubai

Salary:

Not provided

Parser Limited

Expiration Date

Until further notice

Requirements

5+ years of experience in QA engineering, with proven experience in testing data systems or AI applications
Strong analytical skills and attention to detail, capable of spotting subtle inconsistencies in data and agent behavior
Proficiency in Python and SQL for data validation, automation scripting, and test preparation
Experience with API testing (REST/GraphQL automation and validation)
Familiarity with chatbot frameworks, LLMs, or conversational testing
(Desirable) Experience or strong interest in using LLM-based assistants (e.g., GitHub Copilot, ChatGPT) in test and execution
(Desirable) Exposure to QA automation tools (e.g., PyTest, Postman, dbt tests)

Job Responsibility

Expertise in quality assurance efforts for data pipelines, APIs, and conversational agents
Design and execute generative AI testing scenarios, including exploratory testing for chatbot interactions, intent recognition, tone, and edge-case behavior
Experience in LLM test designs, including prompt and grounding validation, golden sets, and non-deterministic assertions
Perform crucial safety and quality checks, such as testing for hallucination, bias, toxicity, and PII leakage
Validate structured and unstructured data outputs, ensuring consistency, accuracy, and compliance
Establish and drive real-time testing approaches, including streaming data validation and API monitoring
Collaborate with ML and NLP teams to define comprehensive evaluation metrics and criteria for agent performance
Integrate AI-driven tools (like Copilot) into the QA lifecycle to accelerate test design, documentation, and defect analysis

Fulltime

Senior QA Engineer with AI experience

N-iX is looking for a Senior QA Engineer with AI experience to join our team. We...

Location

Ukraine

Salary:

Not provided

N-iX

Expiration Date

Until further notice

Requirements

4+ years of experience in manual QA, with exposure to frontend, backend and AI testing
Solid experience with API testing using tools such as Postman, REST Client, or similar
Experience testing web UIs and understanding of cross-browser/cross-environment considerations
Ability to read and interpret API documentation, data schemas, and system architecture descriptions
Hands-on experience working on projects that included AI, ML, or NLP components — particularly validating outputs that are probabilistic or context-dependent
Familiarity with the concept of RAG (Retrieval-Augmented Generation) or LLM-based systems
Strong analytical thinking — especially the ability to assess whether an AI response is contextually correct, not just technically non-null
Good understanding of test documentation practices: test plans, test cases, bug reports, traceability
English level at least Upper-Intermediate

Job Responsibility

Follow a phased QA approach — begin with CMS and backend testing to establish a reliable baseline of expected system behavior, then apply those insights to validate AI agent outputs effectively
Design and execute test cases for REST APIs, covering functional correctness, edge cases, error handling, authentication, and data integrity
Perform UI testing across core user journeys, validating layout, behavior, and integration with backend services
Transition into AI output validation once the deterministic layers are stable — using your knowledge of business rules to identify inconsistencies, hallucinations, or degraded outputs in agent responses
Document and maintain test cases, test plans, and bug reports in a structured and traceable way
Participate in requirement reviews and technical discussions to identify testability gaps early
Collaborate with the Lead Big Data/AI Engineer and AI team to understand RAG pipeline behavior, document ingestion flows, and output quality expectations
Contribute to building reusable test assets and QA processes as the project scales

What we offer

Flexible working format - remote, office-based or flexible
A competitive salary and good compensation package
Personalized career growth
Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
Active tech communities with regular knowledge sharing
Education reimbursement
Memorable anniversary presents
Corporate events and team buildings
Other location-specific benefits

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...

Location

Pakistan , Lahore; Karachi; Islamabad

Salary:

Not provided

NorthBay

Expiration Date

Until further notice

Requirements

8+ years of experience in Software Quality Assurance and Test Automation
Strong expertise in Test Planning, Test Strategy, and Test Execution
Hands-on experience with Selenium, Pytest, and Python-based automation
Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
Experience testing Data platforms, ETL pipelines, and large-scale datasets
Exposure to AI/ML pipeline testing, including model validation and data quality checks
Strong understanding of SDLC, Agile/Scrum, and DevOps practices
Excellent analytical, debugging, and communication skills

Job Responsibility

Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
Design, develop, and maintain automation frameworks using Selenium and Pytest
Perform API testing (RESTful services) including functional, regression, and integration testing
Validate data pipelines, ETL workflows, and data quality checks across large datasets
Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
Integrate automated test suites into CI/CD pipelines to enable continuous testing
Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
Perform root cause analysis and drive defect resolution with engineering teams
Ensure adherence to QA best practices, SDLC, and Agile methodologies
Mentor junior QA engineers and contribute to improving overall QA maturity

What we offer

Work on cutting-edge Data and AI/ML platforms
Hybrid work model across Lahore, Karachi, and Islamabad
Opportunity to influence quality strategy at scale
Collaborative engineering culture with strong focus on automation and innovation

Fulltime

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...

Location

Pakistan , Lahore; Karachi; Islamabad

Salary:

Not provided

NorthBay

Expiration Date

Until further notice

Requirements

8+ years of experience in Software Quality Assurance and Test Automation
Strong expertise in Test Planning, Test Strategy, and Test Execution
Hands-on experience with Selenium, Pytest, and Python-based automation
Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
Experience testing Data platforms, ETL pipelines, and large-scale datasets
Exposure to AI/ML pipeline testing, including model validation and data quality checks
Strong understanding of SDLC, Agile/Scrum, and DevOps practices
Excellent analytical, debugging, and communication skills

Job Responsibility

Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
Design, develop, and maintain automation frameworks using Selenium and Pytest
Perform API testing (RESTful services) including functional, regression, and integration testing
Validate data pipelines, ETL workflows, and data quality checks across large datasets
Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
Integrate automated test suites into CI/CD pipelines to enable continuous testing
Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
Perform root cause analysis and drive defect resolution with engineering teams
Ensure adherence to QA best practices, SDLC, and Agile methodologies
Mentor junior QA engineers and contribute to improving overall QA maturity

What we offer

Work on cutting-edge Data and AI/ML platforms
Hybrid work model across Lahore, Karachi, and Islamabad
Opportunity to influence quality strategy at scale
Collaborative engineering culture with strong focus on automation and innovation

Fulltime

Select Country

Senior AI QA Engineer

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?

Senior AI QA Engineer

Senior AI QA Engineer

Senior QA Engineer – AI & Conversational Products

Senior QA Engineer, AI Experience

Senior QA Engineer, AI Experience

Senior QA Engineer (AI-based)

Senior QA Engineer with AI experience

Senior QA Automation Engineer – Data & AI Platforms

Senior QA Automation Engineer – Data & AI Platforms

Our AI answers in your language