CrawlJobs Logo

AI Test Automation Engineer

ibm.com Logo

IBM Deutschland GmbH

Location Icon

Location:
India , Bangalore

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

At IBM Infrastructure & Technology, we design and operate the systems that keep the world running. From high-resiliency mainframes and hybrid cloud platforms to networking, automation, and site reliability. Our teams ensure the performance, security, and scalability that clients and industries depend on every day. Working in Infrastructure & Technology means tackling complex challenges with curiosity and collaboration. You’ll work with diverse technologies and colleagues worldwide to deliver resilient, future-ready solutions that power innovation. With continuous learning, career growth, and a supportive culture, IBM provides the opportunities to build expertise and shape the infrastructure that drives progress.

Job Responsibility:

  • Design, develop, and maintain robust automated test suites for web, API, and backend systems
  • Automate UI tests using Selenium (mandatory) with maintainable page-object or screen-play patterns
  • Build and maintain API automation for REST services ( integration, and regression tests using REST Assured)
  • Own regression, smoke, and sanity suites with clear quality gates
  • Integrate automated tests into CI/CD pipelines with reliable pass/fail signals
  • Drive best practices in test pyramid, test data management, and test stability
  • Analyze flaky tests and improve automation reliability and execution time
  • Test LLM and GenAI features, including prompt behavior, response quality, hallucinations, edge cases, and failure modes
  • Validate RAG pipelines for retrieval accuracy, relevance, grounding, and citation correctness
  • Perform ML regression testing across model versions, prompt changes, and data updates
  • Design test strategies for non-deterministic outputs, including scoring thresholds, tolerance bands, and golden datasets
  • Validate agentic or multi-step AI workflows where applicable
  • Validate performance characteristics: latency, throughput, concurrency, and scalability
  • Test reliability and resilience under load and failure scenarios
  • Validate security, privacy, and Responsible AI risks, including: PII leakage
  • Prompt injection and jailbreak attempts
  • Bias, toxicity, and unsafe outputs
  • Collaborate closely with backend, ML, SRE, platform, and product teams

Requirements:

  • Bachelor's Degree
  • 3-5 years of experience in software QA / test engineering
  • Strong hands-on experience in traditional QA automation
  • Proven experience with UI automation using Selenium (mandatory)
  • Solid experience in API automation (REST Assured / JSON)
  • Strong understanding of test pyramid, regression strategies, and CI/CD integration
  • Core Java, Python for test automation (mandatory)
  • Hands-on exposure to ML or GenAI systems testing
  • Solid understanding of: LLMs and prompt engineering
  • RAG architectures
  • AI regression and model drift concepts

Nice to have:

  • Experience testing enterprise storage platforms (block, file, object storage)
  • Familiarity with storage concepts such as: IOPS, latency, throughput, queue depth
  • Replication, snapshots, backups, disaster recovery
  • High availability (HA), failover, and resiliency testing
  • Experience testing storage management, observability, or infrastructure platforms
  • Exposure to distributed systems and data consistency concepts
  • Familiarity with on-prem, hybrid, or cloud storage environments
  • Experience validating scale, endurance, and long-running workloads
  • Experience with agentic AI frameworks (LangChain, LangGraph, etc.)
  • Familiarity with vector databases, embeddings, and semantic search
  • Exposure to MLOps / LLMOps practices
  • Experience with BDD frameworks (Cucumber / Behave)
  • Familiarity with performance testing tools (JMeter, Locust, k6)
  • Experience testing enterprise-grade or regulated systems
  • Data Analytics Knowledge: Exposure to data analytics concepts and techniques, with ability to apply data-driven insights to inform testing strategies and optimize test automation
  • Advanced Scripting Skills: Experience with advanced scripting languages, including the ability to develop and maintain complex scripts for test automation and data analysis
  • Industry Leading Practices: Familiarity with industry-leading testing practices and methodologies, including experience with testing frameworks and tools

Additional Information:

Job Posted:
January 26, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
IBM Deutschland GmbH - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for AI Test Automation Engineer

HPC & AI System Test Engineer

Our organization includes high-performance computing (HPC) server platforms, net...
Location
Location
Puerto Rico , Aguadilla
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Systems Engineering, or equivalent
  • Typically 4-6 years experience
  • Possess experience with XD, Apollo, Industry Standard Server, Storage, and Networking products
  • Have experience with Linux Operating Systems (OS) such as Ubuntu, RHEL and SUSE
  • Excellent understanding of testing methodologies
  • Excellent understanding of hardware and software interactions
  • Excellent analytical and problem-solving skills
  • Experience in the overall architecture of software and hardware for products and solutions
  • Strong analytical and problem solving skills
  • Knowledge of a programming or scripting language (Python, Perl, Linux Shell)
Job Responsibility
Job Responsibility
  • Work with Program & Product Management teams to understand test requirements
  • Debug and troubleshoot issues with various teams
  • Work with cross-functional teams to deliver quality HPC systems
  • Work with 3rd party product vendors and engineering teams to track development issues and solutions
  • Demonstrate the ability to effectively manage diverse test tasks and priorities in a fast-paced fluid environment
  • Effectively respond to changing program requirements, changes to product test plans and compressed schedules while meeting program development requirements
  • Work with product development teams to understand new product features required for test programs/projects, work with technical leads and testers to design and develop appropriate test plans
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

CPE and USS Test Automation Engineer

HPC Cluster Management software takes care of OS provisioning, controlling and m...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S or M.S. degree in a related software engineering field
  • 7+ years prior experience in software QA testing
  • Certifications in software testing such as ISTQB or CMMI are highly desirable
  • Experience in HPC or AI software development testing environments is a plus
  • Excellent communication and team collaboration skills
  • Strong interpersonal skills
  • Ability to collaborate effectively across a geographically distributed cross-functional team
  • Attention to detail and accuracy
  • Ability to use Jira, Confluence, and related software
  • Skills in Python, AI Testing, CI/CD Pipeline, Kubernetes
Job Responsibility
Job Responsibility
  • Create and document detailed test plans
  • Test software components according to written test plans
  • Track software defects and effectively communicate failures to software engineers
  • Review engineering requirements, test plans, and test cases for completeness, accuracy, and consistency
  • Conduct QA audits to identify improvements and apply corrective measures
  • Ensure that all software delivered meets quality expectations
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Fulltime
Read More
Arrow Right

Test Automation Engineer

High Performance Computing, AI and Labs at Hewlett Packard Enterprise focuses on...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S or M.S. degree in a related software engineering field is required
  • 3+ years prior experience in test automation
  • prior experience with test automation in a continuous integration/continuous delivery ecosystem is required
  • experience in HPC or AI software development testing environments is a plus
  • excellent communication and team collaboration skills
  • strong interpersonal skills
  • ability to collaborate effectively across a geographically distributed cross-functional team
  • attention to detail and accuracy
  • ability to use Jira, Confluence, and related software
Job Responsibility
Job Responsibility
  • Design, implement, and maintain automated test frameworks
  • create, evolve, and maintain CI/CD/CT frameworks
  • develop associated scripts and software within a Linux environment
  • review engineering requirements, test plans, and test cases to evaluate automation suitability and evolve the automation to meet ongoing and future demands
  • document automation and communicate roadmap changes effectively to stakeholders
  • ensure that all automation meets the needs of the team in terms of availability, usability, and applicability
What we offer
What we offer
  • comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • specific programs catered to career goals
  • inclusive work environment celebrating individual uniqueness
  • Fulltime
Read More
Arrow Right

CPE and USS Test Automation Engineer

HPC Cluster Management software takes care of OS provisioning, controlling and m...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S or M.S. degree in a related software engineering field
  • 7+ years prior experience in software QA testing
  • Certifications in software testing such as ISTQB or CMMI are highly desirable
  • Experience in HPC or AI software development testing environments is a plus
  • Excellent communication and team collaboration skills
  • Strong interpersonal skills
  • Ability to collaborate effectively across a geographically distributed cross-functional team
  • Attention to detail and accuracy
  • Ability to use Jira, Confluence, and related software
  • Skills needed are Python, AI Testing, CI/CD Pipeline, Kubernetes
Job Responsibility
Job Responsibility
  • Create and document detailed test plans
  • Test software components according to written test plans
  • Track software defects and effectively communicate failures to software engineers
  • Review engineering requirements, test plans, and test cases for completeness, accuracy, and consistency
  • Conduct QA audits to identify improvements and apply corrective measures
  • Ensure that all software delivered meets quality expectations
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Fulltime
Read More
Arrow Right

AI-First Automation Engineer

Instawork is on a mission to create meaningful economic opportunities for skille...
Location
Location
United States , San Francisco
Salary
Salary:
120000.00 - 150000.00 USD / Year
instawork.com Logo
Instawork
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 1+ years of experience in AI model development and proficient in testing, evaluating and setting model quality standards
  • 2+ years of experience in QA automation
  • BS or MS in Computer Science or related field
  • Programming experience in Python + Javascript or similar language
  • Thorough knowledge of automation testing frameworks, tools and release processes
  • Self-motivated, especially in learning new software tools and best practices in software quality assurance
  • Startup mentality: self-starter, multi-tasker, proactive and flexible
  • Good communication and interpersonal skills
  • You straddle a fine line between QA, software and DevOps engineering
Job Responsibility
Job Responsibility
  • Develop customized AI models for QA data and conduct prompt engineering analysis
  • Implement and evolve QA processes to get effective test signals and scale testing efforts across multiple products
  • Build advanced automation architecture and integrate AI tools, thereby reducing manual intensive repetitive tasks
  • Transform our automation by integrating cutting-edge AI tools and methodologies, creating smarter, faster, and more resilient frameworks that elevate our efficiency and coverage standards
  • Help solve cross-platform testing challenges and contribute impactful ideas to improve quality
  • Build a self-optimizing QA system that scales with the growth of our products
  • Partner with engineering and infrastructure teams to leverage automation for scalable solutions to prevent regressions and ensure reliability of products
What we offer
What we offer
  • Variety of medical, dental, and vision plans with coverage beginning on the date of hire
  • Flexible paid time off
  • At least 8 paid company holidays annually
  • Phone stipend
  • Commuter stipend
  • Supplemental pay on qualified leaves
  • Employee health savings accounts (HSA) contribution
  • Flexible spending plans
  • 401K plan
  • Perkspot - discount program through Lumity
  • Fulltime
Read More
Arrow Right

AI Automation Engineer Internship

TapNation is a French company founded in 2019, specializing in mobile game publi...
Location
Location
France , Paris
Salary
Salary:
Not provided
tap-nation.io Logo
TapNation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Looking for an internship
  • Passion for AI
  • Comfortable speaking English (required)
  • Team player and adaptable
  • Proactive and full of ideas
  • Good analytical skills and know how to prioritize
  • Organized and patient
Job Responsibility
Job Responsibility
  • Deconstruct key company workflows across all departments (Product, User Acquisition, Monetization, Creatives, Data, Tech, etc.)
  • Identify where and how AI can boost efficiency, creativity, and decision-making by mapping current processes, identifying bottlenecks, repetitive tasks, or decision flows
  • Prototype and test AI-powered tools using platforms like ChatGPT, Claude, Notion AI, Make, etc
  • Implement pilot automations by working closely with department leads to move from manual to AI-augmented workflows
  • Analyze and document workflows across all departments
  • Create clear documentation, tutorials, and best practices for internal use
What we offer
What we offer
  • Remote policy: up to 1 to 2 days remote per week
  • Morning Pereire offices in Paris 17e (including fitness room)
  • Meal tickets: 15 tickets per month at 10.00€ per ticket with the Swile Card
  • Transport: 50% covered by us
  • 1 paid rest day per month
  • Fulltime
Read More
Arrow Right

Automation Test Engineer

We are looking for a skilled and proactive Automation Test Engineer to join our ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
January 26, 2026
Flip Icon
Requirements
Requirements
  • 4+ years of experience in test automation using Selenium
  • Hands-on experience or working knowledge of Playwright or Mabl (JavaScript/TypeScript)
  • Exposure to JavaScript for scripting and automation
  • Experience working with or integrating AI tools in the testing process
  • Understanding on ERP applications
Job Responsibility
Job Responsibility
  • Develop, maintain, and execute automated test scripts using MABL and Playwright
  • Understand business workflows of ERP applications to design effective test scenarios
Read More
Arrow Right

Principal QA Automation Engineer w/ AI experience

We seek a Principal QA Automation Engineer with a strong background in Cypress, ...
Location
Location
Argentina , Gran Buenos Aires; Capital Federal; Mar del Plata
Salary
Salary:
Not provided
basicagency.com Logo
BASIC/DEPT®
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands-on experience with Cypress for UI and end-to-end automation testing
  • Expert-level proficiency in TypeScript, JavaScript and Python
  • Proven experience testing AI-powered or machine learning applications, including AI model validation techniques
  • Strong understanding of AWS services (e.g., Lambda, S3, SQS, CloudWatch, ECS/EKS) and how to validate applications deployed in cloud environments
  • Experience with threaded/multi-agent AI tools and how they impact test design and validation
  • Familiarity with version control (Git), containerization (Docker), and CI/CD pipelines (e.g., GitHub Actions, Jenkins, or CircleCI)
  • Strong communication, leadership, and mentoring skills
Job Responsibility
Job Responsibility
  • Lead the design and implementation of end-to-end test automation frameworks using Cypress with TypeScript
  • Define quality strategies for applications with AI/ML components, including deterministic and non-deterministic testing approaches
  • Collaborate with engineering, DevOps, and AI/ML teams to ensure quality across AI-infused features in production environments
  • Build and scale testing strategies for threaded AI applications running in AWS cloud infrastructure
  • Integrate automated tests into CI/CD pipelines to support frequent, reliable deployments
  • Mentor and guide mid- and senior-level QA engineers, setting best practices and driving a culture of quality-first development
  • Evaluate and introduce new tools, libraries, and frameworks to improve test coverage, performance, and developer experience
  • Participate in architectural discussions to ensure testability and reliability are baked into software designs from the start
  • Analyze test results, track quality metrics, and communicate risk and coverage to stakeholders
What we offer
What we offer
  • Premium healthcare through OSDE for the employee and their immediate family members
  • Mendel prepaid card with a monthly allowance for grocery purchases
  • Monthly reimbursements for Wi-Fi/electricity expenses
  • Monthly reimbursements for training/English classes
  • 100% covered “Plan Total” membership at Sportclub
  • Access to a our benefits platform through Bonda
  • A flexible vacation policy
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy