CrawlJobs Logo

AI Test Engineer

nttdata.com Logo

NTT DATA

Location Icon

Location:
India , Bangalore

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

We are looking for an experienced AI Test Engineer with 4–8 years of industry experience to support testing and validation of AI-driven applications. The ideal candidate should have strong expertise in test automation, AI model validation, and prompt engineering, along with experience working on cloud-based AI solutions within the banking domain.

Job Responsibility:

  • Design and execute test strategies for AI/ML and Generative AI applications
  • Validate LLM outputs, prompts, and AI model behavior for accuracy, reliability, and performance
  • Develop and maintain automation test frameworks using Python or Java
  • Perform prompt testing and prompt engineering validation to ensure optimal AI responses
  • Work with AI model testing tools and automation tools such as Selenium, GitHub Copilot, or similar tools
  • Execute functional, regression, integration, and performance testing for AI-enabled applications
  • Deploy and test applications on public cloud platforms (GCP preferred)
  • Collaborate with developers, data scientists, and product teams to ensure quality and reliability of AI solutions

Requirements:

  • 4–8 years of experience in software testing or QA automation
  • Strong programming skills in Python and/or Java
  • Good understanding of AI/ML concepts and Generative AI fundamentals
  • Hands-on experience with prompt engineering and LLM testing approaches
  • Experience with automation testing tools such as Selenium and model testing tools
  • Experience working with public cloud platforms (GCP preferred, AWS/Azure acceptable)
  • Strong knowledge of test automation frameworks and QA best practices
  • Prior experience working in the Banking / Financial Services domain
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field

Nice to have:

  • Exposure to AI model evaluation techniques and responsible AI testing
  • Experience with CI/CD pipelines and DevOps tools
  • Familiarity with API testing and performance testing tools

Additional Information:

Job Posted:
March 23, 2026

Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for AI Test Engineer

HPC & AI System Test Engineering Manager

The HPC Integrated Systems Test (IST) team is seeking a Systems Engineering Mana...
Location
Location
Puerto Rico , Aguadilla
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • First level university degree or equivalent experience required
  • May have advanced university degree
  • Typically, 5 or more years of related work experience, including 0 -2 years of people management experience
  • Strong leadership skills, including coaching, team building, and conflict resolution
  • Advanced project management skills including time and risk management, resource prioritization, and project structuring
  • Strong analytical and problem-solving skills
  • Ability to manage human capital across geographies to drive workforce development and achieve desired results
  • Strong verbal and written communication skills, including negotiation, presentation, and influence skills
  • Advanced business acumen, technical knowledge, and extensive knowledge in applications and technologies
  • Strong multi-tasking and prioritization skills
Job Responsibility
Job Responsibility
  • Provides direct and ongoing leadership for a team of individual contributors testing and validating new products, enhancements and updates
  • Coordinates projects for systems software, including operating systems, networking, utilities, and Internet-related tools
  • Manages headcount, deliverables, schedules, and costs for multiple ongoing projects
  • Communicates project status and escalates issues to direct managers, program managers, and internal and external development partners
  • Manages relationships with outsourced partners and suppliers
  • Proactively identifies opportunities for process improvement and cost reductions opportunities
  • Provides people-care management for assigned team members, including hiring, setting and monitoring of annual performance plans, coaching, and career development
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

HPC & AI System Test Engineering Manager

HPC & AI System Test Engineering Manager role at Hewlett Packard Enterprise. Man...
Location
Location
United States , Aguadilla
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • First level university degree or equivalent experience required
  • May have advanced university degree
  • Typically 10 or more years of related work experience
  • People management experience
  • Strong leadership skills including coaching, team building, and conflict resolution
  • Advanced project management skills including time and risk management, resource prioritization, and project structuring
  • Ability to manage human capital across geographies
  • Strong analytical and problem-solving skills
  • Excellent understanding of testing methodologies
  • Great understanding of hardware and software interactions
Job Responsibility
Job Responsibility
  • Provides direct and ongoing leadership for a team of individual contributors designing and developing new products, enhancements and updates
  • Manages headcount, deliverables, schedules, and costs for multiple ongoing projects
  • Communicates project status and escalates issues to direct managers, program managers, and development partners
  • Manages relationships with outsourced partners and suppliers
  • Proactively identifies opportunities for process improvement and cost reductions
  • Provides people-care management for assigned team members including hiring, performance plans, coaching, and career development
  • Writes and executes complete testing plans, protocols, and documentation
  • Works with systems engineers and development partners to develop reliable, cost effective and high-quality solutions
  • Collaborates and communicates with management regarding systems design status, project progress, and issue resolution
  • Represents the systems engineering team for all phases of larger development projects
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

HPC & AI System Test Engineering Manager

Manages a team of systems engineers for high-performance computing (HPC) server ...
Location
Location
United States , Chippewa Falls
Salary
Salary:
137000.00 - 315000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • First level university degree or equivalent experience required
  • May have advanced university degree
  • Typically 5 or more years of related work experience, including 0-2 years of people management experience
  • Strong leadership skills, including coaching, team building, and conflict resolution
  • Advanced project management skills including time and risk management, resource prioritization, and project structuring
  • Strong analytical and problem-solving skills
  • Ability to manage human capital across geographies to drive workforce development and achieve desired results
  • Strong verbal and written communication skills, including negotiation, presentation, and influence skills
  • Advanced business acumen, technical knowledge, and extensive knowledge in applications and technologies
  • Strong multi-tasking and prioritization skills
Job Responsibility
Job Responsibility
  • Provides direct and ongoing leadership for a team of individual contributors testing and validating new products, enhancements and updates
  • Manages headcount, deliverables, schedules, and costs for multiple ongoing projects
  • Communicates project status and escalates issues to direct managers, program managers, and internal and external development partners
  • Manages relationships with outsourced partners and suppliers
  • Proactively identifies opportunities for process improvement and cost reductions opportunities
  • Provides people-care management for assigned team members, including hiring, setting and monitoring of annual performance plans, coaching, and career development
  • Coordinates with third-party product vendors and engineering managers to track development issues and implement solutions
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Fulltime
Read More
Arrow Right

HPC & AI System Test Engineer

Our organization includes high-performance computing (HPC) server platforms, net...
Location
Location
Puerto Rico , Aguadilla
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Systems Engineering, or equivalent
  • Typically 4-6 years experience
  • Possess experience with XD, Apollo, Industry Standard Server, Storage, and Networking products
  • Have experience with Linux Operating Systems (OS) such as Ubuntu, RHEL and SUSE
  • Excellent understanding of testing methodologies
  • Excellent understanding of hardware and software interactions
  • Excellent analytical and problem-solving skills
  • Experience in the overall architecture of software and hardware for products and solutions
  • Strong analytical and problem solving skills
  • Knowledge of a programming or scripting language (Python, Perl, Linux Shell)
Job Responsibility
Job Responsibility
  • Work with Program & Product Management teams to understand test requirements
  • Debug and troubleshoot issues with various teams
  • Work with cross-functional teams to deliver quality HPC systems
  • Work with 3rd party product vendors and engineering teams to track development issues and solutions
  • Demonstrate the ability to effectively manage diverse test tasks and priorities in a fast-paced fluid environment
  • Effectively respond to changing program requirements, changes to product test plans and compressed schedules while meeting program development requirements
  • Work with product development teams to understand new product features required for test programs/projects, work with technical leads and testers to design and develop appropriate test plans
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

HPC & AI Systems Engineer for Integrated Systems Test

HPC & AI Systems Engineer for Integrated Systems Test role at Hewlett Packard En...
Location
Location
Puerto Rico , Aguadilla
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in Computer Engineering, Computer Science, Electrical Engineering, Information Systems, or equivalent
  • Minimum 4 years of experience
  • Experience with certification & submission to OS vendors of Linux (RedHat, SLES, Ubuntu, etc.), Windows Server operating systems, Windows Client operating systems, and VMWare (ESXi)
  • Experience installing and working with Linux, Windows and VMWare OSes
  • Experience in programming or scripting languages, Python, PowerShell, Perl, Linux Shell, Java, MySQL, MS SQL Server
  • Understanding of Redfish commands, RESTful API, and JSON format
  • Knowledge of creating and using Docker containers and VMs
  • Experience in configuring Storage (internal/external storage, file systems, and raid/non-raid settings) and Networking devices (iSCSI, FCoE, IPs, VLANs, Bonding, Jumbo Frames, LAGs)
  • Knowledge of networking concepts such as NIC teaming, VLANs, IPv4, IPv6
  • Excellent written and verbal communication skills in English
Job Responsibility
Job Responsibility
  • Work with Program & Product Management, technical leads, and product development teams to obtain product feature requirements
  • Design and implement new test features in existing and new test cases
  • Analyze, debug and provide feedback/resolution on issues uncovered by test team prior to submission of results to OS vendors for approval
  • Implement software solutions for multiple test programs/projects with internal and outsourced development partners
  • Review and evaluate the implementation and use of test automation and test tools
  • Planning, development, and implementation of software tools for the testing and evaluation of current and next-generation HPE HPC products
  • Debug and analyze issues to a successful resolution
  • Perform testing in local and remote labs
  • Drive appropriate automated test execution to test engineers at various global locations
  • Provide training and guidance to test teams both onshore and offshore
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits that supports physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

HPC & AI System Test Engineer

The HPC Integrated Systems Test (IST) team is seeking early career and new gradu...
Location
Location
Puerto Rico , Aguadilla
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent
  • 0-4 years experience
  • Experience with Industry Standard Server, Storage, and Networking products
  • Experience with Linux Operating Systems (OS) such as Ubuntu, RHEL and SUSE
  • Understanding of testing methodologies
  • Understanding of hardware and software interactions
  • Analytical and problem-solving skills
  • Ability to perform testing in local and remote labs
  • Experience in the overall architecture of software and hardware for products and solutions
  • Knowledge of a programming or scripting language (Python, Perl, Linux Shell)
Job Responsibility
Job Responsibility
  • Work with IST technical leads and program managers to understand test requirements, design and develop appropriate test plans, execute test plans, debug and troubleshoot issues
  • Work with various cross-functional teams and the product development teams to understand new product features required for test programs/projects to deliver quality HPC systems
  • Work with 3rd party product vendors and engineering teams to track development issues and solutions
  • Demonstrate the ability to effectively manage diverse test tasks and priorities in a fast-paced fluid environment
  • Effectively respond to changing program requirements, changes to product test plans and compressed schedules while meeting program development requirements
  • Analyze, debug and provide feedback/resolution on issues uncovered by test team prior to submission of results to OS vendors for approval
  • Review and evaluate the implementation and use of test automation and test tools
  • Ensure development issues are resolved in a cost-effective, efficient, and timely manner.
What we offer
What we offer
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Specific programs for career development
  • Unconditional inclusiveness aligned with individual uniqueness.
  • Fulltime
Read More
Arrow Right

HPC & AI System Test Engineer

Hewlett Packard Enterprise is seeking early career professionals with a backgrou...
Location
Location
Puerto Rico , Aguadilla
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent
  • Typically 0-4 years experience
  • Possess experience with Industry Standard Server, Storage, and Networking products
  • Have experience with Linux Operating Systems (OS) such as Ubuntu, RHEL and SUSE
  • Have an understanding of testing methodologies
  • Have an understanding of hardware and software interactions
  • Have an analytical and problem-solving skills
  • Perform testing in local and remote labs
  • Experience in the overall architecture of software and hardware for products and solutions
  • Strong analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Work with IST technical leads and program managers to understand test requirements, design and develop appropriate test plans, execute test plans, debug and troubleshoot issues
  • Work with various cross-functional teams and the product development teams to understand new product features required for test programs/projects to deliver quality HPC systems
  • Work with 3rd party product vendors and engineering teams to track development issues and solutions
  • Demonstrate the ability to effectively manage diverse test tasks and priorities in a fast-paced fluid environment
  • Effectively respond to changing program requirements, changes to product test plans and compressed schedules while meeting program development requirements
  • Analyze, debug and provide feedback/resolution on issues uncovered by test team prior to submission of results to OS vendors for approval
  • Review and evaluate the implementation and use of test automation and test tools
  • Ensure development issues are resolved in a cost-effective, efficient, and timely manner
  • Debug and analyze issues to a successful resolution
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Applied AI Engineer - AI Solutions

As an Applied AI Engineer, you’ll research and utilize state-of-the-art Gen AI a...
Location
Location
United States , Redwood City; San Francisco
Salary
Salary:
172000.00 - 300000.00 USD / Year
snorkel.ai Logo
Snorkel AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S. degree in a quantitative field such as Computer Science, Engineering, Mathematics, Statistics, or comparable degree/experience
  • 3+ years of customer-facing experience in the design and implementation of AI/ML solutions
  • Proficiency in Python, including strong grounding in software engineering fundamentals (e.g., modular design, testing, profiling, packaging) and experience with modern Python constructs and libraries for type validation and typed data modeling (e.g., pydantic), building type-safe systems (e.g., mypy), testing (e.g., pytest), packaging and environment configuration (e.g., poetry), API and service frameworks (e.g., FastAPI), serialization and structured data handling (e.g., msgspec), and orchestration tooling relevant to ML deployment (e.g., Ray, Airflow)
  • Expertise across the Applied AI stack, spanning classical ML libraries (e.g., scikit-learn), deep learning frameworks (e.g., PyTorch), foundation-model ecosystems (e.g., Hugging Face Transformers), vector/embedding tooling (e.g., FAISS), data processing frameworks (e.g., pandas, Spark), retrieval/RAG tooling (e.g., Chroma, Weaviate), synthetic dataset curation, evaluation workflows, and LLM orchestration, workflow, agent authoring tools (e.g., LlamaIndex, LangGraph, CrewAI)
  • Experience leading strategic, customer-facing initiatives and collaborating with business stakeholders to ensure ML solutions drive successful business outcomes, with a strong focus on teaching and enablement
  • Outstanding presentation skills to technical and executive audiences, whether impromptu on a whiteboard or using presentations and demos
  • Ability to work in a fast-paced environment and balance priorities across multiple projects at once
Job Responsibility
Job Responsibility
  • Partner with customers to build and deploy impactful Gen AI and machine learning solutions, from use case scoping and data exploration to model development and deployment. This may involve leveraging Snorkel Flow or designing custom approaches using state-of-the-art tools, with the goal of delivering real business value and informing the evolution of the Snorkel platform
  • Develop and implement state of the art AI systems such as retrieval-augmented generation (RAG), fine-tuning pipelines, prompt engineering recipes and agentic workflows
  • Create augmented real-world datasets and comprehensive evaluation workflows to ensure model reliability, transparency, and stakeholder trust. A data- and evaluation-first mindset is essential for success in this role
  • Forge and manage relationships with our customers’ leadership and stakeholders to ensure successful development and deployment of AI projects with Snorkel Flow
  • Collaborate closely with pre-sales Solutions and Product teams to map customer needs to existing capabilities, prioritize roadmap gaps, and guide successful project setup
  • Work with other Applied AI Engineers to standardize solutions and contribute to internal tooling and best practices
  • Lead stakeholder education on quantitative capabilities, helping them to understand the strengths and weaknesses of different approaches and what problems are best-suited for Snorkel AI
  • Serve as the voice of our customers for new AI paradigms, data science workflows, and share customer feedback to product teams
  • Conduct one-to-few and one-to-many enablement workshops to transfer knowledge to customers considering or already using Snorkel AI
  • Annual travel up to 25%
What we offer
What we offer
  • equity in the form of employee stock options
  • Fulltime
Read More
Arrow Right