This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We’re opening the position of a Middle Test Automation Engineer (Python) to a new team in the project of our Customers. They provide SaaS solutions that help companies to optimize their businesses. These solutions include business planning & execution, processes automation & optimization. The Customer’s platform leverages industry-leading artificial intelligence (AI agents). In this position, you will be responsible for the AI Agents testing through UI and API layers.
Job Responsibility:
Design, develop, and maintain automated test scripts and frameworks using Python and Pytest
Create test strategies for validating AI agent workflows, APIs, and Agent integrations
Implement end-to-end, integration, and regression testing for AI agent solutions
Integrate test automation into CI/CD pipelines (GitHub Actions)
Perform manual exploratory testing where automation is not yet feasible
Build and execute test plans for validating: Conversational logic and accuracy of AI agents
API interactions, data pipelines, and back-end services
Performance, reliability, and scalability of AI-driven services
Requirements:
3+ years of experience in test automation, with strong hands-on skills in Python and Pytest
Experience testing APIs (REST, GraphQL) with tools like Postman/Newman
Knowledge of CI/CD pipelines and automation integration
Strong debugging, troubleshooting, and problem-solving skills
Familiarity with GenAI, FastAPI, FastMCP, LangChain/LangGraph, and Langfuse
Familiarity with performance/load testing tools (BlazeMeter, JMeter)
English level – Upper-Intermediate or higher (both written and spoken)
Nice to have:
Knowledge of GitHub Actions
Familiarity with AI/ML testing approaches (e.g., NLP testing, model response validation, fuzz testing)