CrawlJobs Logo

Senior AI QA Engineer

northbaysolutions.com Logo

NorthBay

Location Icon

Location:
India

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

3000000.00 - 3600000.00 INR / Year

Job Description:

We are seeking a Senior AI QA Engineer with 6–8+ years of experience in software quality assurance, test automation, and validation of data-driven and AI/ML systems. The role involves test planning, automation framework development, API testing, CI/CD integration, and end-to-end testing of AI and data pipelines. The candidate will work closely with engineering, data, and DevOps teams to ensure high-quality, scalable AI solutions.

Job Responsibility:

  • Define and execute test planning, test strategy, and test cases for AI/ML and data-driven applications
  • Develop and maintain automated test frameworks using Selenium and Pytest
  • Perform API testing for RESTful services
  • Validate data pipelines, ETL workflows, and ML model outputs
  • Conduct end-to-end testing across AI/ML lifecycle including data ingestion, training, inference, and deployment
  • Integrate automated test suites into CI/CD pipelines
  • Perform regression, integration, system, and performance testing
  • Identify, document, and track defects to closure
  • Collaborate with Data Engineers, ML Engineers, and DevOps teams
  • Ensure adherence to QA standards, best practices, and compliance requirements
  • Mentor junior QA team members when required

Requirements:

  • Software Quality Assurance
  • Test Planning and Test Strategy
  • Test Automation
  • Selenium
  • Pytest
  • Python
  • API Testing (REST)
  • CI/CD Integration
  • Data Pipeline Testing
  • AI/ML Pipeline Testing
  • Regression Testing
  • Defect Tracking
  • Git / Version Control

Nice to have:

  • Machine Learning model validation (accuracy, drift, bias)
  • Cloud platforms (AWS, Azure, GCP)
  • Docker and Kubernetes
  • Performance and Load Testing
  • Data Quality and Monitoring frameworks

Additional Information:

Job Posted:
January 05, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior AI QA Engineer

Senior QA Engineer

At JFrog, we’re reinventing DevOps to help the world’s greatest companies innova...
Location
Location
Israel , Netanya/Tel Aviv
Salary
Salary:
Not provided
jfrog.com Logo
JFrog
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 6 years of experience in quality testing complex systems – SaaS and on-premises
  • Practical hands-on knowledge of cloud technologies (AWS, GCP, Azure), Kubernetes, Docker
  • Hands-on experience with automation frameworks such as Playwright with Python
  • Experience with leveraging Generative AI tools to accelerate quality-related tasks: test case creation, bug reporting, scripting/tooling, and more – an advantage
  • Ability to guide development teams, provide clear and constructive quality feedback, and challenge design or implementation decisions
  • Ability to take ownership using strong problem-solving and decision-making skills
Job Responsibility
Job Responsibility
  • Work closely with multiple R&D teams across JFrog Security
  • Enable development teams to own testing and automation as an integral part of delivery
  • Design scalable quality strategies, testing frameworks, and quality gates to ensure high standards without slowing down development
  • Act as a technical authority as you guide teams on testability, observability, and risk-based testing, as well as non-functional quality aspects such as security, performance, and reliability
  • Partner with Engineering, Product, and DevOps to continuously improve how quality is designed, measured, and enforced across the product lifecycle
Read More
Arrow Right

Principal QA Automation Engineer w/ AI experience

We seek a Principal QA Automation Engineer with a strong background in Cypress, ...
Location
Location
Argentina , Gran Buenos Aires; Capital Federal; Mar del Plata
Salary
Salary:
Not provided
basicagency.com Logo
BASIC/DEPT®
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands-on experience with Cypress for UI and end-to-end automation testing
  • Expert-level proficiency in TypeScript, JavaScript and Python
  • Proven experience testing AI-powered or machine learning applications, including AI model validation techniques
  • Strong understanding of AWS services (e.g., Lambda, S3, SQS, CloudWatch, ECS/EKS) and how to validate applications deployed in cloud environments
  • Experience with threaded/multi-agent AI tools and how they impact test design and validation
  • Familiarity with version control (Git), containerization (Docker), and CI/CD pipelines (e.g., GitHub Actions, Jenkins, or CircleCI)
  • Strong communication, leadership, and mentoring skills
Job Responsibility
Job Responsibility
  • Lead the design and implementation of end-to-end test automation frameworks using Cypress with TypeScript
  • Define quality strategies for applications with AI/ML components, including deterministic and non-deterministic testing approaches
  • Collaborate with engineering, DevOps, and AI/ML teams to ensure quality across AI-infused features in production environments
  • Build and scale testing strategies for threaded AI applications running in AWS cloud infrastructure
  • Integrate automated tests into CI/CD pipelines to support frequent, reliable deployments
  • Mentor and guide mid- and senior-level QA engineers, setting best practices and driving a culture of quality-first development
  • Evaluate and introduce new tools, libraries, and frameworks to improve test coverage, performance, and developer experience
  • Participate in architectural discussions to ensure testability and reliability are baked into software designs from the start
  • Analyze test results, track quality metrics, and communicate risk and coverage to stakeholders
What we offer
What we offer
  • Premium healthcare through OSDE for the employee and their immediate family members
  • Mendel prepaid card with a monthly allowance for grocery purchases
  • Monthly reimbursements for Wi-Fi/electricity expenses
  • Monthly reimbursements for training/English classes
  • 100% covered “Plan Total” membership at Sportclub
  • Access to a our benefits platform through Bonda
  • A flexible vacation policy
  • Fulltime
Read More
Arrow Right

Senior AI Product Engineer

As a one person team to start, you are both a product lead and the technical SME...
Location
Location
Australia , Melbourne
Salary
Salary:
Not provided
frankieone.com Logo
FrankieOne
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Recent experience in building AI applications with end to end ownership
  • 10 plus years experience in engineering teams in an Agile environment using JS based frameworks like React
  • 5 plus years developing & supporting Full Stack TS-based SaaS applications production in AWS/Cloud ecosystem
  • Experience in HTML5, ES6, CSS3/Sass, javascript, typescript, React, React Native for Web (optional), npm and other front-end technologies to deliver enterprise grade frontend applications
  • Experience in depth of back-end oriented technologies such as nodejs, typescript for managing BFF
  • Knowledge and experience in tracking technological developments especially AI with vendor offerings and ability to quickly evaluate their value proposition e.g AWS Bedrock
  • Experience in architecting & building enterprise grade AI applications with Data and AI governance, AI gateways, context management (RAG), inference/prompt management, tools/functions (MCP, A2A), memory & fine-tuning
  • Experience in capturing business requirements from stakeholders to documenting, architect and building AI applications for both internal and external users
  • Experience in designing web applications based on AWS well architectured principles, 12 factor web application principles, cloud based software architecture patterns (pub-sub, saga, circuit breaker etc)
  • Experience in designing reactjs based frontend and backend in nodejs or golang
Job Responsibility
Job Responsibility
  • Inspire others
  • Design with quality
  • Collaborate
  • Be proactive
  • Be an advocate for FrankieOne, for our product, and our values
Read More
Arrow Right

Senior Software Engineer – AI Assistant Integration Expert

Take your career to the next level with Amaris Consulting as a Senior Software E...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
amaris.com Logo
Amaris Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 5 years of experience as a Software Engineer
  • At least 1 year of hands-on experience using GitHub Copilot in real-world projects
  • Strong practical knowledge of Java or .NET (C#)
  • Deep understanding of software architecture patterns and SOLID principles
  • Proven ability to write clean, maintainable code and follow best practices
  • Experience configuring GitHub Copilot in IDEs such as Visual Studio, VS Code, IntelliJ, or Eclipse
  • Ability to coach and train developers and QA engineers
  • Fluent in English (Spanish is a plus)
  • Hands-on mindset – not theoretical, but someone who codes daily
Job Responsibility
Job Responsibility
  • Define and implement guidelines for AI usage in software development
  • Collaborate with software architects and tech leads to document best practices and antipatterns per programming language
  • Create documentation and training materials for developers and QA engineers
  • Provide hands-on support to ~40 software squads to integrate GitHub Copilot and other AI tools
  • Configure GitHub Copilot extensions and ensure proper repository setup
  • Train teams on using Copilot commands (e.g., createWorkspace, explain, doc, fix, optimize)
  • Guide QA teams on AI tools for test case generation and optimization
  • Conduct “train the trainer” sessions to empower internal champions
What we offer
What we offer
  • Tailored career path and salary evaluation
  • Tech Academy catalog, Udemy E-learning Platform, Languages Sessions, webinars, and workshops
  • Annual personal training budget and company-paid certifications
  • Flexible policies and remote work options
  • Transit and restaurant tickets
  • Kindergarten support
  • Private health insurance
  • WeCare program supporting employees in critical situations
  • Fulltime
Read More
Arrow Right

Senior Software Test Engineer

You are passionate about building rock solid software. Now is your chance to do ...
Location
Location
Germany
Salary
Salary:
80000.00 - 90000.00 EUR / Year
linuxrecruit.co.uk Logo
Linux Recruit
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong background in software engineering
  • Ideally with a JVM based language
  • Ability to both write and evaluate clean, maintainable code
  • Solid understanding of modern testing and QA practices and frameworks
  • Experience in automation
  • Real curiosity about AI tools and their testing challenges
  • Collaborative mindset
Job Responsibility
Job Responsibility
  • Take ownership of the end to end of software testing projects within a platform team
  • Support dozens of other engineering teams across the organisation
  • Bring software engineering excellence into testing
  • Work with backend languages such as Kotlin, Java, or Go
  • Drive full automation across the stack
  • Collaborate closely with product managers and engineering leaders
  • Shape solutions that will have an impact far beyond your own team
  • Fulltime
Read More
Arrow Right

Senior Quality Assurance Engineer

You’ll join as a Senior Quality Assurance Engineer, building the QA function fro...
Location
Location
Poland , Warsaw
Salary
Salary:
40000.00 - 85000.00 USD / Year
dualentry.com Logo
DualEntry
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in Software QA for SaaS/web applications
  • Proven track record in high-growth environments
  • Deep expertise in UI & API testing, bug reporting tools (Jira), and test management (TestRail)
  • Familiarity with CI/CD, AWS, Docker/Kubernetes
  • Experience with Selenium/Cypress
  • knowledge of performance and database testing
  • Strong product intuition and testability thinking
  • Excellent English communication (C1)
  • Ability to work hard (we work most weekends), move fast, and thrive in high-velocity environments
Job Responsibility
Job Responsibility
  • Establish and lead QA practices for a new AI-first SaaS platform
  • Design and execute test strategies across UI, API, and integrations
  • Build and maintain test case management and reporting systems
  • Collaborate closely with founders, engineering, and product to embed QA across development
  • Own bug reporting, triage, and release validation
  • Lay the foundation for future automated testing and CI/CD integration
  • Champion user empathy and customer feedback to drive product reliability
What we offer
What we offer
  • Significant equity ownership
  • Equity: ~$25K+
  • Remote-first team
  • Time Off: 15 PTO days + 12 public holidays
  • Visa sponsorship option for relocation to NYC within 2+ years
  • Early-stage role with high autonomy and real long-term upside
  • Fulltime
Read More
Arrow Right

Senior Director, Quality Engineering

The Senior Director of Quality Engineering is a transformational leadership role...
Location
Location
United States
Salary
Salary:
116100.00 - 191500.00 USD / Year
onecallcm.com Logo
One Call
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of progressive experience in software quality engineering, with at least 5+ years in leadership roles
  • Proven track record of transforming QA organizations into modern, automated QE functions
  • Deep expertise in test automation, CI/CD, DevSecOps, and agile delivery practices
  • Experience implementing AI-powered testing tools and frameworks (e.g., model-based testing, intelligent test generation, predictive analytics)
  • Hands-on experience with enterprise-scale applications and distributed systems
  • Strong understanding of hybrid cloud environments, microservices architecture, and containerized deployments
  • Experience managing global teams and vendor partnerships
  • Exceptional communication, executive presence, and stakeholder engagement skills
  • Expertise in test automation tools (e.g., Selenium, Playwright, Cypress), performance testing (e.g., JMeter, Gatling), and API testing (e.g., Postman, RestAssured)
  • Familiarity with AI/ML-based testing platforms and observability tools
Job Responsibility
Job Responsibility
  • Define and execute the quality engineering strategy aligned with One Call’s digital transformation and platform modernization goals
  • Lead the transition from manual QA to automated QE, embedding quality early in the PDLC and driving a shift-left culture
  • Champion the use of AI-driven testing tools and frameworks to improve coverage, accelerate feedback loops, and reduce regression risk
  • Partner with Engineering, Product, and Delivery leaders to ensure quality is a shared responsibility across teams
  • Build and scale automation frameworks for functional, performance, security, integration and production validation testing across web, application and API layers
  • Drive adoption of CI/CD-integrated testing pipelines to enable frequent, reliable releases
  • Establish and enforce quality gates, test data management practices, and defect triage processes
  • Define and track KPIs for test coverage, defect leakage, automation rates, release frequency, and cycle time
  • Drive measurable improvements in product quality, release confidence, and customer satisfaction
  • Provide transparency into quality metrics and trends across teams and applications
What we offer
What we offer
  • Remote Work: We are a remote-first company, and almost all positions receive the flexibility of working from home
  • Generous Time Off: Besides 8 company holidays and 2 personal days every year, all colleagues receive a minimum of 18 days of paid time off
  • Comprehensive Benefits Package: Including medical, dental, vision, and pet insurance
  • 401(k) matching program
  • and company-paid life insurance and short and long-term disability coverage
  • Supportive Services: We offer a Colleague Assistance Program that provides free counseling and financial services, and our One Call Foundation, a non-profit arm of our company, provides colleagues financial assistance during times of unexpected hardships
  • Fulltime
Read More
Arrow Right

Senior Software Engineer II

As a Senior Software Engineer II, you will collaborate closely with QA and the b...
Location
Location
Vietnam , Ho Chi Minh City
Salary
Salary:
Not provided
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in software engineering, with a strong focus on backend development and cloud-based systems
  • Proven experience in building test automation frameworks for complex, large-scale systems in cloud environments
  • Proficiency in programming languages such as Go, C#, Java, or similar
  • Deep understanding of distributed systems and cloud-native technologies (e.g., Kubernetes, Terraform, Kafka)
  • Experience using AI tools to improve test automation, software quality, and development pipelines
  • Strong communication skills to collaborate with cross-functional teams and articulate technical concepts effectively
Job Responsibility
Job Responsibility
  • Collaborate closely with QA and the broader engineering teams to develop a scalable test automation system for cloud environments
  • Drive the technical strategy for testing across DEMS, making it easier for developers to write tests and improve overall software quality
  • Utilize your backend engineering expertise to make architectural decisions, conduct code reviews, and contribute to continuous improvements in our development practices
  • Mentor junior engineers and help shape the technical direction of the team
What we offer
What we offer
  • Medical, Dental and Vision Insurance
  • Robust Paid Time Off policy
  • Bonuses
  • Lunch allowance
  • Cell phone stipend
  • Free LinkedIn Learning account or Udemy account
  • Access to 24/7 online emotional and mental support
  • Gym membership
  • Free parking
  • Stocked fridges and pantries - free coffee, cold beverages, snacks
  • Fulltime
Read More
Arrow Right