CrawlJobs Logo

Qa Engineer – Agents & Ai Platform

India, Chennai · Job Posted March 21, 2026
Apply Position
Job Link Share

Job Description

QA Engineer – Agents & AI Platform. We are looking for a QA Engineer – Agents & AI Platform to ensure the quality, reliability, and performance of our agent-building platform and domain-specific AI agents. This role combines deep exploratory testing with practical automation, including building sample workflows and demo scenarios to validate real-world use cases. The ideal candidate will be passionate about quality engineering and excited to work on modern AI-driven platforms and intelligent automation systems. Driving meaningful impact through smart, AI-powered product solutions.

Job Responsibility

  • Agent Platform Testing & System Validation Understand product requirements and workflows across vertical agents and design end-to end test scenarios for agents, platform components, observability systems, and prompt management
  • Create and maintain comprehensive test plans, test cases, and test data for agent orchestration, prompts, and integrations
  • Build sample agents, mock tools, and demo workflows to simulate real-world scenarios and identify edge cases
  • Execute manual and automated tests including API, regression, and smoke testing for web UI, APIs, and background workflows
  • Perform basic security testing such as access control validation, data privacy checks, input validation, and misuse scenarios
  • Use logs, metrics, and traces to investigate defects and validate system behavior
  • Ensure platform reliability, performance, and quality across the testing lifecycle
  • Collaboration, Automation & Release Support Collaborate with engineers and product managers to triage issues and improve product test ability
  • Build light automation scripts for API and regression testing where applicable
  • Participate in release validation and quality sign-offs before deployments
  • Contribute to improving QA processes, testing strategies, and automation coverage
  • Maintain clear documentation of test cases, defects, and validation results

Requirements

  • QA experience testing complex web platforms, workflow systems, or enterprise applications
  • Strong knowledge of QA methodologies, test case design, and defect lifecycle management
  • Hands-on experience with API testing tools such as Postman and exploratory testing techniques
  • Ability to build light automation scripts using Python, JavaScript, or testing frameworks for regression and API testing
  • Understanding of workflow-driven platforms or enterprise process systems
  • Awareness of security and privacy considerations, including RBAC, PHI/PII protection, and audit logging
  • Strong communication skills and a proactive mindset toward owning product quality

Nice to have

  • Exposure to testing LLM-based or Agentic systems, including prompts, tool integrations, RAG workflows, and safety guardrails
  • Experience using observability tools (logs, metrics, traces) for debugging and validating system behavior
  • Familiarity with AI testing strategies, including prompt regression testing, golden datasets, and evaluating hallucinations or safety issues
  • Experience in Healthcare or Life Sciences domains is an added advantage

What we offer

  • Opportunity to work on next-generation AI agent platforms and intelligent automation systems
  • Hands-on experience testing LLM-driven products and AI-powered workflows
  • A collaborative engineering culture focused on innovation, experimentation, and continuous learning
  • Competitive compensation and strong opportunities for career growth in AI and platform engineering

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Qa Engineer – Agents & Ai Platform

8 matching positions

QA Engineer - Agents & AI Platform

We are looking for a skilled and innovative AI / Machine Learning Engineer to de...
Location
Location
India , Chennai
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong understanding of Machine Learning and Deep Learning fundamentals
  • Knowledge of Transformer architectures and language models
  • Experience working with Small Language Models (SLMs) or fine-tuned models
  • Hands-on experience with LangChain, LangGraph, CrewAI, AutoGen, OpenAI Agent SDK, or similar frameworks
  • Strong Python programming skills
  • Experience with FastAPI or similar backend frameworks
  • Knowledge of Relational and NoSQL databases
  • Familiarity with Git, Docker, and CI/CD pipelines
  • Experience with testing frameworks such as pytest or unittest
Job Responsibility
Job Responsibility
  • Design, develop, and deploy AI applications powered by Small Language Models (SLMs) and fine-tuned language models
  • Build and manage agent orchestration workflows using frameworks such as LangGraph,CrewAI, AutoGen, or OpenAI Agent SDK
  • Develop multi-agent systems that coordinate tasks through planning, reasoning, and tool interaction
  • Build Retrieval-Augmented Generation (RAG) pipelines integrating vector databases, APIs and enterprise data sources
  • Apply strong Python programming and data structure knowledge to build scalable AI systems
  • Develop backend services and APIs using Python frameworks such as FastAPI
  • Integrate AI solutions with relational or NoSQL databases and external services
  • Write clean, maintainable, and testable code following software engineering best practices
What we offer
What we offer
  • Supportive and professional work environment
  • Competitive salary as per market standards
  • Opportunity to work on advanced AI and multi-agent technologies
  • Career growth and learning opportunities in AI engineering
  • Fulltime
Read More
Arrow Right

Senior QA Engineer – AI & Conversational Products

We're looking for a Senior QA Engineer who's passionate about quality, thrives i...
Location
Location
Israel
Salary
Salary:
Not provided
radancy.com Logo
Radancy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of QA engineering experience, with at least 2 years in a senior or lead capacity
  • Hands-on experience testing AI/ML features, LLM-based products, or conversational systems (a plus)
  • Strong proficiency with test automation frameworks (e.g., Playwright, Selenium, Cypress, Pytest)
  • Solid understanding of API testing (REST/GraphQL) and tools like Postman or similar
  • Experience with CI/CD pipelines (GitHub Actions, Jenkins, or equivalent)
  • Ability to think like a user and an engineer — identifying failure modes others miss
  • Excellent communication skills and a collaborative approach to cross-functional teamwork
Job Responsibility
Job Responsibility
  • Own the end-to-end quality assurance process for features across web, API, and backend services within Radancy's talent platform
  • Design and implement test strategies for LLM-based features and AI agents — ensuring accuracy, consistency, and robustness at scale
  • Build and maintain automated test frameworks covering UI, API, performance, and regression testing
  • Develop comprehensive test plans and test cases that address both functional requirements and edge scenarios unique to AI-driven hiring experiences
  • Partner closely with Product, Engineering, and Data teams to surface quality gaps early in the development cycle
  • Analyze and report bugs with precision, advocating for high-impact fixes that protect candidate and employer experience
  • Participate in release processes, CI/CD pipeline validation, and production monitoring
Read More
Arrow Right

AI Engineer (Agentic AI/Multi-Agent Systems)

We are building a next-generation AI-powered software testing platform and are l...
Location
Location
Vietnam , Ho Chi Minh City
Salary
Salary:
Not provided
amaris.com Logo
Amaris Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Artificial Intelligence, Data Science, Software Engineering, Information Systems, or a related field
  • Minimum 3 years of experience in AI Engineering, Machine Learning Engineering, Data Science, or related disciplines
  • Hands-on experience building and deploying Generative AI or LLM-powered applications
  • Strong proficiency in Python and experience building APIs using FastAPI, Flask, or similar frameworks
  • Hands-on experience developing Generative AI or LLM-powered applications using platforms such as OpenAI, Vertex AI, or open-source models
  • Familiarity with Agentic AI frameworks such as LangChain/LangGraph, CrewAI, AutoGen, or LlamaIndex
  • Understanding of Prompt Engineering, RAG, Tool Calling, and AI workflow orchestration
  • Strong analytical and problem-solving skills, with good English communication abilities
Job Responsibility
Job Responsibility
  • Design and develop Agentic AI and Multi-Agent Systems for software testing automation
  • Build and integrate LLM-powered workflows using modern AI frameworks and APIs
  • Develop backend services and APIs to support agent interactions and orchestration
  • Conduct experiments and evaluate AI model performance, accuracy, and reliability
  • Collaborate with Product, QA, and Engineering teams to define and implement AI-driven solutions
  • Deploy, monitor, and maintain AI services in development and testing environments
  • Research emerging AI technologies and recommend improvements to existing solutions
What we offer
What we offer
  • Competitive salary and 13th-month salary
  • 14+ annual leaves per year
  • Premium healthcare insurance, starting from your probation period
  • Project reviews and yearly performance appraisals
  • Annual company trip
  • Teambuilding activities: Team lunch/dinner, events, and celebrations, sports clubs (football, basketball, badminton, pickleball)
  • International team with flexible working time
  • Tailor-made career path
  • Technical workshops and training courses
  • Mobility: Opportunities to be on-site abroad in our offices in over 60+ countries
  • Fulltime
Read More
Arrow Right

AI Engineer

Reporting to the AI & Technology Oversight Manager, the AI Engineer is responsib...
Location
Location
India , Mumbai
Salary
Salary:
Not provided
waystone.com Logo
Waystone Governance Ltd.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep understanding of the distinction between Generative AI and Agentic AI, including their foundations, capabilities, and appropriate use cases
  • Strong understanding of AI, ML and LLM concepts, including prompt engineering, prompt grounding, iterative loop techniques, context windows, embeddings, RAG, agentic workflows
  • Proven ability to integrate AI capabilities both into low-code automation flows and high-code stacks, including, applications, APIs, microservices, distributed systems, and development or testing tools
  • Solid software development background with hands-on coding experience in one or more engineering ecosystem such as .NET (C#), Python, or TypeScript
  • Excellent communication skills, with the ability to translate complex AI concepts for non‑experts and to effectively influence and collaborate with stakeholders at all levels, both technical and non‑technical
  • Strong writing skills, with the ability to contribute to AI literacy and AI fluency documentation
  • Strong understanding of responsible AI principles, including governance, bias mitigation, compliance, and risk-based decision-making
  • Analytical thinking with excellent problem‑solving ability and keen attention to details
  • Ability to mentor developers and testers, and to drive innovation across engineering, QA, and architecture
  • Ability to assess AI‑enabled capabilities in third‑party SaaS platforms (e.g., Appian, Salesforce,etc) and provide guidance on responsible, effective adoption
Job Responsibility
Job Responsibility
  • Hands-on contributor to the design and development of AI-enabled solutions, capable of writing both production-quality code and rapid experimental prototypes
  • Develop and implement AI‑enabled microservices, APIs, applications, and internal tools
  • Integrate AI capabilities following secure, scalable engineering best practices
  • Design, build and validate AI‑driven solutions leveraging providers such as OpenAI and Anthropic
  • Enhance low‑code/no‑code automation platforms (e.g., Power Automate, n8n, Workato) by embedding intelligent processing and applying agentic patterns where relevant
  • Implement Model Context Protocol (MCP) servers for secure AI‑to‑system connectivity
  • Lead AI‑based document parsing and intelligent data extraction initiatives
  • Contribute to educating and enabling Enterprise Capabilities areas, including Integration and Automation, by providing guidance, training, and best practices, e.g., on effective use of n8n agents
  • Engage with business stakeholders to understand requirements, constraints, and key drivers, identifying and implementing high‑value AI opportunities across Waystone
  • Prototype AI features and iterate towards production‑ready capabilities
  • Fulltime
Read More
Arrow Right

AI Engineer

Reporting to the AI & Technology Oversight Manager, the AI Engineer is responsib...
Location
Location
United Kingdom , Leeds
Salary
Salary:
Not provided
waystone.com Logo
Waystone Governance Ltd.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep understanding of the distinction between Generative AI and Agentic AI, including their foundations, capabilities, and appropriate use cases
  • Strong understanding of AI, ML and LLM concepts, including prompt engineering, prompt grounding, iterative loop techniques, context windows, embeddings, RAG, agentic workflows
  • Proven ability to integrate AI capabilities both into low-code automation flows and high-code stacks, including, applications, APIs, microservices, distributed systems, and development or testing tools
  • Solid software development background with hands-on coding experience in one or more engineering ecosystem such as .NET (C#), Python, or TypeScript
  • Excellent communication skills, with the ability to translate complex AI concepts for non‑experts and to effectively influence and collaborate with stakeholders at all levels, both technical and non‑technical
  • Strong writing skills, with the ability to contribute to AI literacy and AI fluency documentation
  • Strong understanding of responsible AI principles, including governance, bias mitigation, compliance, and risk-based decision-making
  • Analytical thinking with excellent problem‑solving ability and keen attention to details
  • Ability to mentor developers and testers, and to drive innovation across engineering, QA, and architecture
  • Ability to assess AI‑enabled capabilities in third‑party SaaS platforms (e.g., Appian, Salesforce,etc) and provide guidance on responsible, effective adoption
Job Responsibility
Job Responsibility
  • Hands-on contributor to the design and development of AI-enabled solutions, capable of writing both production-quality code and rapid experimental prototypes
  • Develop and implement AI‑enabled microservices, APIs, applications, and internal tools
  • Integrate AI capabilities following secure, scalable engineering best practices
  • Design, build and validate AI‑driven solutions leveraging providers such as OpenAI and Anthropic
  • Enhance low‑code/no‑code automation platforms (e.g., Power Automate, n8n, Workato) by embedding intelligent processing and applying agentic patterns where relevant
  • Implement Model Context Protocol (MCP) servers for secure AI‑to‑system connectivity
  • Lead AI‑based document parsing and intelligent data extraction initiatives
  • Contribute to educating and enabling Enterprise Capabilities areas, including Integration and Automation, by providing guidance, training, and best practices, e.g., on effective use of n8n agents
  • Engage with business stakeholders to understand requirements, constraints, and key drivers, identifying and implementing high‑value AI opportunities across Waystone
  • Prototype AI features and iterate towards production‑ready capabilities
  • Fulltime
Read More
Arrow Right

Senior Java Engineer – Agentic AI Driven Development - Senior Vice President

The Applications Development Technology Senior Lead Analyst is a senior-level po...
Location
Location
Canada , Mississauga
Salary
Salary:
145100.00 - 217700.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Core Java - Strong understanding of Java (JDK 8+, preferably Java 11/17), including multithreading, collections, garbage collection, and JVM internals
  • Frameworks - Extensive experience with Spring Framework (Spring Boot, Spring MVC, Spring Data JPA, Spring Security)
  • Middleware - Proven experience in designing and developing RESTful APIs and microservices
  • Relational Databases - Strong proficiency in SQL and experience with Oracle databases, including schema design, query optimization, and stored procedures
  • NoSQL Databases - Experience with MongoDB, including data modeling, querying, and performance tuning
  • CI/CD & DevOps - Hands-on experience with CI/CD tools and practices (e.g., Jenkins, GitLab CI, GitHub Actions, Maven/Gradle, Docker, Kubernetes)
  • Version Control - Proficiency with Git and standard branching strategies (e.g., Gitflow)
  • Testing - Experience with unit testing frameworks (JUnit, Mockito) and integration testing
  • Web Technologies (Beneficial) - Familiarity with web services (SOAP/REST), XML, JSON
  • AI Tools & Methodologies - Demonstrable exposure and practical experience with AI development tools such as Devin, GitHub Copilot, Claude, Anti Gravity, and Codex
Job Responsibility
Job Responsibility
  • Lead the design, development, and implementation of complex middleware applications using Java and Spring Boot
  • Architect and optimize database interactions with Oracle, SQL, and MongoDB, ensuring high performance and data integrity
  • Drive the adoption and continuous improvement of CI/CD pipelines to facilitate rapid and reliable software delivery
  • Collaborate with cross-functional teams, including product management, QA, and operations, to define requirements, design solutions, and deliver high-quality software
  • Mentor and provide technical guidance to junior and mid-level software engineers, fostering a culture of technical excellence and continuous learning
  • Actively research and experiment with AI technologies to identify opportunities for enhancing developer productivity, automating tasks, and improving software quality
  • Participate in code reviews, ensuring adherence to coding standards, best practices, and architectural guidelines
  • Troubleshoot and resolve complex technical issues, ensuring the stability and performance of production systems
  • Contribute to the strategic planning and technical roadmap for our middleware platforms
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, and model development
What we offer
What we offer
  • Discover the top benefits offered to our global workforce, designed to support your well-being, growth and work-life balance. Explore a few of the highlights that make working with us rewarding.
  • Fulltime
Read More
Arrow Right

Senior Java Engineer – Agentic AI Driven Development - Vice President

Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Core Java: Strong understanding of Java (JDK 8+, preferably Java 11/17), including multithreading, collections, garbage collection, and JVM internals
  • Frameworks: Extensive experience with Spring Framework (Spring Boot, Spring MVC, Spring Data JPA, Spring Security)
  • Middleware: Proven experience in designing and developing RESTful APIs and microservices
  • Relational Databases: Strong proficiency in SQL and experience with Oracle databases, including schema design, query optimization, and stored procedures
  • NoSQL Databases: Experience with MongoDB, including data modeling, querying, and performance tuning
  • CI/CD & DevOps: Hands-on experience with CI/CD tools and practices (e.g., Jenkins, GitLab CI, GitHub Actions, Maven/Gradle, Docker, Kubernetes)
  • Version Control: Proficiency with Git and standard branching strategies (e.g., Gitflow)
  • Testing: Experience with unit testing frameworks (JUnit, Mockito) and integration testing
  • Demonstrable exposure and practical experience with AI development tools such as Devin, GitHub Copilot, Claude, Anti Gravity, and Codex
  • Strong understanding of AI/ML concepts, prompt engineering, and integrating AI into software development workflows (e.g., for code generation, testing, debugging, and documentation)
Job Responsibility
Job Responsibility
  • Lead the design, development, and implementation of complex middleware applications using Java and Spring Boot:Utilize AI-powered code generation tools (e.g., Devin, Copilot, Codex) to accelerate development, automate boilerplate code, suggest optimal implementations, and enforce architectural patterns. Leverage AI for design pattern identification and complex system architecture validation
  • Architect and optimize database interactions with Oracle, SQL, and MongoDB, ensuring high performance and data integrity: Employ AI to analyze database query performance, suggest advanced indexing strategies, optimize schema designs, and generate efficient SQL/NoSQL queries. AI-driven tools can also assist in predicting database load and recommending scaling solutions
  • Drive the adoption and continuous improvement of CI/CD pipelines to facilitate rapid and reliable software delivery: Integrate AI into CI/CD processes for intelligent test case generation, predictive failure analysis, automated code vulnerability scanning, and optimization of pipeline execution times based on historical data
  • Collaborate with cross-functional teams, including product management, QA, and operations, to define requirements, design solutions, and deliver high-quality software:Use AI-powered communication and summarization tools (e.g., Claude) to streamline requirement gathering, document analysis, and stakeholder communication. AI can also assist in translating technical designs into accessible formats for various audiences
  • Mentor and provide technical guidance to junior and mid-level software engineers, fostering a culture of technical excellence and continuous learning: Leverage AI platforms for personalized learning paths, automated code feedback, and explanations of complex technical concepts. Encourage junior engineers to adopt AI-driven development practices
  • Actively research and experiment with AI technologies to identify opportunities for enhancing developer productivity, automating tasks, and improving software quality. Continuously explore emerging AI tools and techniques (such as Anti Gravity for complex problem-solving) and assess their applicability to our development ecosystem
  • Participate in code reviews, ensuring adherence to coding standards, best practices, and architectural guidelines: Utilize AI-powered code analysis tools to pre-scan code for potential bugs, security vulnerabilities, performance bottlenecks, and style deviations, allowing human reviewers to focus on higher-level logic and design
  • Troubleshoot and resolve complex technical issues, ensuring the stability and performance of production systems. Implement AI-driven anomaly detection in monitoring systems, leverage AI for rapid log analysis and root cause identification, and automate incident response workflows
  • Contribute to the strategic planning and technical roadmap for our middleware platforms: Employ AI to analyze industry trends, forecast technology evolution, assess the impact of new features, and prioritize roadmap initiatives based on data-driven insights
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, and model development: Utilize AI for data synthesis, predictive modeling for estimations, identification of potential IT risks, and accelerated model prototyping and validation
  • Fulltime
Read More
Arrow Right

Platform Innovation Engineer

The Platform Innovation Engineer (Early Career) is a hands-on engineering role f...
Location
Location
United States , Rockville
Salary
Salary:
53500.00 - 70000.00 USD / Year
aramark.com Logo
Aramark
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Data, Information Systems, or a related field
  • Exposure to SQL, Python, or cloud, data, or automation tools
  • Demonstrated curiosity and interest in AI-enabled systems or modern platforms
  • Willingness to experiment, learn quickly, and iterate within defined boundaries
  • Strong communication skills and comfort engaging with technical peers, leadership, and business stakeholders
Job Responsibility
Job Responsibility
  • Build and test prototypes that explore how AI and automation can enhance data access, analysis, and platform workflows
  • Experiment with AI-assisted analytics, intelligent automation, or agent-style solutions under the guidance of the AI Architect
  • Validate ideas through hands-on implementation in development and QA environments
  • Help transform promising experiments into stable, reusable platform components that can be safely adopted by others
  • Assist in building tools, utilities, or services that improve how the platform is used, extended, and understood
  • Support the integration of AI capabilities into existing data and reporting workflows
  • Work across multiple technologies and layers rather than within a single tool or silo
  • Document what you build so solutions are transparent, repeatable, and supportable
  • Design and build solutions with awareness of data sensitivity, access controls, and platform boundaries
  • Work within role‑based access models, environments (development, QA, production), and approval flows that protect data and platform integrity
What we offer
What we offer
  • medical
  • dental
  • vision
  • work/life resources
  • retirement savings plans like 401(k)
  • paid days off such as parental leave and disability coverage
  • Fulltime
Read More
Arrow Right