AI Test Engineer Job at NTT DATA (Bangalore)

Data & AI Test Engineer

We are looking for an experienced Data & AI Test Engineer with 4–8 years of indu...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

4-8 years of experience in software testing or QA automation
Experienced in writing complex SQL queries
Strong programming skills in Python and/or Java
Good understanding of ETL, Data Pipelines, AI/ML concepts and Generative AI fundamentals
Hands-on experience with prompt engineering and LLM testing approaches
Experience with automation testing tools such as Selenium and model testing tools
Experience working with public cloud platforms (GCP preferred, AWS/Azure acceptable)
Strong knowledge of test automation frameworks and QA best practices
Prior experience working in the Banking / Financial Services domain
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field

Job Responsibility

Design and execute test strategies for ETL pipelines, AI/ML and Generative AI applications
Validate dashboard output, LLM outputs, prompts, and AI model behavior for accuracy, reliability, and performance
Develop and maintain automation test frameworks using Python or Java
Perform prompt testing and prompt engineering validation to ensure optimal AI responses
Work with AI model testing tools and automation tools such as Selenium, GitHub Copilot, or similar tools
Execute functional, regression, integration, and performance testing for Data & AI-enabled applications
Deploy and test applications on public cloud platforms (GCP preferred)
Collaborate with developers, data scientists, and product teams to ensure quality and reliability of AI solutions

Fulltime

Senior Staff Software AI Test Engineer- Prisma SASE

We are seeking Test Engineers with a strong Automation First Mindset as we scale...

Location

United States , Santa Clara

Salary:

126000.00 - 204500.00 USD / Year

Palo Alto Networks

Expiration Date

Until further notice

Requirements

Automation skills - Python, Playwright
Experience with building automation frameworks and leading the automation effort for the team
Working Knowledge of CI/CD pipelines
Experience with Cloud Technologies such Aws/Azure/GCP
Knowledge of common security related protocols and their design (i.e. SSH, IPsec,TCP/IP, DNS, TLS, SSL etc.)
Demonstrated ability to learn quickly and to work in a fast paced, innovative environment learning new technologies and multi-tasking
8+ years of experience
Bachelor’s Degree OR Master in Computer Science/Engineering/Networking or equivalent military experience required

Job Responsibility

Develop and execute sophisticated software tests and frameworks to validate Prisma SASE Functionality and Scale, working closely with Development, Product Management, SRE and Technical Marketing teams
Provide Thorough Technical Leadership in the areas of Cloud Based Orchestration, Cloud delivered Security, Cloud Networking and Automation Design
Participate in system design so that Quality Assurance is considered throughout the entire lifecycle of the Prisma Access Feature Development
Develop and/or Enhance Automated test Infrastructure to enable building Scalable & Flexible tests that reflect real world network deployment scenarios
Enhance Test strategies, Automation & Build infrastructure with feedback and analysis from real-world Customer deployments

Fulltime

Senior Test Engineer- AI Testing

Location

Morocco , Rabat

Salary:

Not provided

Cyclad Sp. z o.o.

Expiration Date

Until further notice

Requirements

Experience: 6 - 8 years
Strong experience in software testing (manual + automation) with focus on AI systems
Hands-on expertise in Python for test automation, data validation, and AI testing scripts
Knowledge of Gen AI frameworks (Langchain, Langgraph, CrewAI)
Familiarity with CI/CD pipelines (Jenkins, GitHub Actions, GitLab CI)
Strong understanding of data validation, model evaluation metrics, and drift detection
API testing experience (REST, GraphQL) with tools like Postman or REST Assured
Solid knowledge of cloud platforms (AWS, Azure, GCP) for AI deployments
Exposure to AI ethics and compliance testing
Knowledge of containerization & orchestration (Docker, Kubernetes)

Job Responsibility

Design and execute test strategies for machine learning models (classification, regression, NLP, CV, etc.)
Validate model accuracy, fairness, bias detection, explainability, and robustness under varying datasets
Perform adversarial testing and edge-case validation for AI systems
Test autonomous agents, multi-step reasoning paths, and state transitions
Validate correctness, grounding, consistency, and safety of LLM outputs
Evaluate prompt robustness and behavioral variations across scenarios
Validate retrieval accuracy, grounding quality, and hallucination reduction
Test vector store behavior, document chunking logic, and retriever configurations
Validate fallback behaviors when tools or external services fail
Execute adversarial, prompt-injection, and red team style testing

Software Engineer in Test (AI focus)

Roku is changing how the world watches TV. Roku is the #1 TV streaming platform ...

Location

United Kingdom , Cambridge

Salary:

Not provided

Roku

Expiration Date

Until further notice

Requirements

3+ years of hands-on experience with automation systems
3+ years of Python programming experience
2+ years of experience developing test plans and test cases
Ability to write simple Python scripts to preprocess data or interact with ML APIs
Bachelor's degree in Computer Science or related
Excellent verbal and written communication skills
Experience working with remote teams
Some knowledge of continuous integration tools (Jenkins/Hudson, TeamCity, Maven, Gradle)
Hands on experience and proficiency in Linux/Unix systems
Ability to learn new technologies quickly

Job Responsibility

Contribute to tools and technology
Design, develop, and maintain AI-driven automation systems
Collaborate with data scientists, software engineers, and product teams to understand and deliver AI-based solutions
Build new tools and technology
Debug failing tests to improve the quality of automated test tools and frameworks
Conduct code reviews for improve code quality and optimization
Promote coding conventions and standards for code re-usability and cleanliness
Assist in monitoring and maintenance of critical systems

What we offer

Global access to mental health and financial wellness support and resources
healthcare (medical, dental, and vision)
life
accident
disability
commuter
retirement options (401(k)/pension)

Fulltime

Optical Assembly, Integration, And Test (AI&T) Engineer

An Optical Assembly, Integration, and Test (AI&T) Engineer is sought to support ...

Location

United States , Lexington

Salary:

75.00 - 100.00 USD / Hour

Connexion Systems & Engineering, Inc

Expiration Date

Until further notice

Requirements

3–5 years of optical AI&T experience
Experience assembling, aligning, and testing refractive and reflective optical systems and components
Familiarity with optical alignment instrumentation including interferometers, autocollimators, alignment telescopes, theodolites, profilometers, and wavefront sensors
Broad understanding of optical fabrication techniques and experience evaluating vendors for custom optical manufacturing
Experience performing incoming inspection of procured optical components and familiarity with optical fabrication specifications
Ability to work effectively within small multidisciplinary engineering teams
Bachelor's Degree
3+ years of experience with: Laser characterization equipment, Free-space optics, Handling, cleaning, and inspection of optical components in laboratory environments, Optical technology and optical hardware, Optical systems integration and testing, Hardware and software integration, Environmental testing (TVAC, vibration, shock, thermal cycling, etc.)
1+ year of optical design experience

Job Responsibility

Plan and prepare for extensive optical assembly, integration, and testing activities conducted in laboratory clean rooms
Develop optical system assembly and alignment approaches, derive requirements, define process flows, and identify or develop required ground support equipment (GSE)
Collaborate with mechanical and opto-mechanical engineers to design mounts and assemblies with appropriate adjustment resolution and degrees of freedom
Execute assembly and alignment of free-space and fiber-optic optical assemblies, including sensor integration and performance characterization
Specify custom optical components such as mirrors, lenses, and filters
assess supplier capabilities
and inspect/test procured optics
Utilize free-space optical tooling including interferometers, polarimeters, laser beam profilers, alignment telescopes, and autocollimators
Work with fiber optic cables and components, including associated testing methods
Write AI&T procedures, document build activities, and participate in troubleshooting and issue resolution

What we offer

medical insurance
10 days of Paid Time Off
11 paid holidays
401(k) match

Fulltime

AI Software Test Engineer

Arcfield is seeking an AI Software Test Engineer to support in Dahlgren, VA in a...

Location

United States , Dahlgren

Salary:

Not provided

Arcfield

Expiration Date

Until further notice

Requirements

Must have an active Secret clearance and the ability to obtain and maintain a TS/SCI Clearance
Three (3) years direct experience in designing and implementing quality control standards for tactical software testing of Navy or Joint Programs
Experience testing application capabilities that leverage AI
Specifically, testing in a manner that is not hard coded to the same inputs yielding the same outputs
Experience with non-deterministic testing such as: Mutation testing, Performance testing, Acceptance testing, Range, threshold, and objective testing
Experience with Python programming language is a plus
Experience with system testing metrics, best practices, and methodologies
Experience working with software development teams
Experience participating in requirements and design reviews, developing test plans, writing and executing test cases in a fast-paced software development environment
Experience conducting data analysis, data verification and problem-solving

Job Responsibility

Support in Dahlgren, VA in a hybrid capacity
Provide support in the areas of cyber analysis and cyber development capabilities in response to Navy's and DoD's needs for Cyber Situational Awareness (SA), Cyber Command and Control (C2), Mission Assurance, and Homeland Defense
Identify cyber key terrain by analyzing operational requirements, conducting cyber analyses and assessments, and developing and performing modeling and simulation in support of different cyber threat scenarios
Conduct cyber analyses and assessments to identify potential vulnerabilities and risks, determine mission and operational impacts, and make appropriate mitigation recommendations
Develop methodology and framework in support of cyber risk assessment life cycle
Provide capabilities to support the customer with rapid design, development, test, deployment, maintenance and operation of specific software and hardware capabilities to meet current Cyber Defensive needs

Fulltime

Agentic AI Test Environment Engineer

The Test Environment Engineer will support the test environment workstream for a...

Location

Romania , Cluj

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Proven experience (5+ years) in managing test environments
1-2 years of experience using Agentic AI tools
Hands-on experience with cloud platforms
Hands-on experience with release management platforms like Plutora
Understanding in scripting languages and automation tools
Strong understanding of CI/CD pipelines and tools
Familiarity with monitoring and logging tools
Excellent problem-solving and troubleshooting abilities
Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams
Ability to manage multiple priorities in a fast-paced environment

Job Responsibility

Contribute and support to the Development and implementation of a comprehensive test environment strategy aligned with the goals of Agentic AI tool
Collaborate with architects, developers, and squads to ensure the test environment meets the needs
Support the setup, configuration, and maintenance of test environments
Ensure environments are properly provisioned, maintained, and decommissioned as needed
Manage and document environment configurations, dependencies, and integration points
Support the planning and scheduling of test environments for project work
Integrate test environments with CI/CD pipelines to facilitate automated testing and continuous delivery
Using AI tool, monitor environment performance and usage, ensuring optimal operation and resource utilization
Using AI tool, develop and maintain metrics and dashboards to track environment health, usage, and issues
Work closely with developers, QA, and operations teams to understand environment requirements and constraints

What we offer

Smooth integration and a supportive mentor
Choose from Remote, Hybrid or Office work opportunities
Projects have different working hours to suit your needs
Sponsored certifications, trainings and top e-learning platforms
Private Health Insurance
Individual coaching sessions or joining our accredited Coaching School
Epic parties or themed events

AI Governance & Test Engineer

The AI Governance and Test Engineer plays a critical role in ensuring the respon...

Location

United Kingdom , Belfast

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Proven experience in AI/Machine Learning model development, operations, or testing
Strong understanding of AI/ML lifecycle, concepts, and deployment challenges
Familiarity with risk management, governance, and compliance frameworks, preferably within a regulated industry
Proficiency in data analysis tools and techniques, with the ability to interpret complex datasets
Experience with performance testing methodologies and tools
Excellent analytical, problem-solving, and critical thinking skills
Strong communication, collaboration, and stakeholder management abilities
Ability to work independently and as part of a cross-functional team in a fast-paced environment

Job Responsibility

Proactively track and manage critical dates related to AI model lifecycles, including limitation expirations, policy decisions (PDs), and scheduled model updates
Prepare, review, and submit all necessary risk artifacts, ensuring strict adherence to internal policies and external regulatory requirements
Coordinate and facilitate review sessions with Model Risk Management (MRM) and other pertinent stakeholders to ensure AI models consistently meet established governance, risk, and compliance standards
Conduct in-depth data analysis of AI model usage patterns, performance metrics, and operational data to identify trends, anomalies, and areas for continuous improvement
Perform detailed manual Subject Matter Expert (SME) reviews of AI object outputs to rigorously assess and confirm their accuracy, relevance, and alignment with defined business objectives
Oversee and coordinate the implementation of updates to AI objects, aiming to minimize disruption while maximizing effectiveness and efficiency
Execute fine-tuning processes for AI objects to optimize their performance, accuracy, and responsiveness based on ongoing monitoring results, feedback loops, and evolving requirements
Design, develop, and execute comprehensive performance tests for AI objects to evaluate their scalability, responsiveness, stability, and resource utilization under various load or hyper-parameter conditions
Analyze detailed test results to pinpoint performance bottlenecks, potential failure points, and areas for optimization within AI systems
Collaborate closely with AI development teams to implement performance improvements, conduct re-testing, and ensure solutions meet or exceed established performance benchmarks and non-functional requirements

What we offer

27 days annual leave (plus bank holidays)
A discretional annual performance related bonus
Private Medical Care & Life Insurance
Employee Assistance Program
Pension Plan
Paid Parental Leave
Special discounts for employees, family, and friends
Access to an array of learning and development resources

Fulltime

Select Country

AI Test Engineer

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?

AI Test Engineer

Data & AI Test Engineer

Senior Staff Software AI Test Engineer- Prisma SASE

Senior Test Engineer- AI Testing

Software Engineer in Test (AI focus)

Optical Assembly, Integration, And Test (AI&T) Engineer

AI Software Test Engineer

Agentic AI Test Environment Engineer

AI Governance & Test Engineer

Our AI answers in your language