CrawlJobs Logo

Middle AI QA Engineer

· Job Posted February 16, 2026
Apply Position
Job Link Share

Job Description

We are looking for an AI QA Engineer to ruthlessly test our digital employees ability to listen, think, and speak in real-time. Any delay or logical glitch breaks the magic; your mission is to ensure it stays seamless.

Job Responsibility

  • Voice UX Testing: Measure and optimize Latency (P95/P99). Verify Barge-In functionality: ensure the agent stops speaking immediately when interrupted, even in noisy environments
  • Logic & Flow Validation: Read and understand NSL (Jinja2) scripts to identify potential logical loops or dead ends. Verify that the agent handles state transitions correctly (e.g., booking created -> confirmation sent)
  • Hallucination Control: Detect when the AI drifts from its instructions or invents facts. Help build "Golden Datasets" of correct conversations for regression testing
  • Integration Testing: Verify that the agent correctly triggers external tools (e.g., CRM updates) during a call. What happens if the API fails? Does the agent handle it gracefully?

Requirements

  • 2+ years of hands-on experience in manual testing
  • Ability to read code (Python, Jinja2) and work confidently with JSON data payloads to better understand test scenarios
  • Understanding of STT (Speech-to-Text), TTS (Text-to-Speech), and VAD (Voice Activity Detection) concepts, including the importance of silence detection
  • Strong exploratory testing mindset with the ability to intentionally stress and challenge AI agents (e.g., interruptions, rapid speech, topic switching, unclear pronunciation)
  • Russian - Native or Fluent
  • English - Upper-Intermediate (B2+)

Nice to have

  • Experience with LLM prompting
  • Experience testing voice assistants (Alexa, Google Assistant)

What we offer

  • Flexible working hours
  • Remote-first culture
  • Long-term projects
  • Salary in dollars
  • Professional communities
  • Onsite business trips
  • Training budget
  • Paid conferences

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Middle AI QA Engineer

8 matching positions

Middle QA Automation Engineer

We are seeking a motivated QA Automation Engineer to join our team and contribut...
Location
Location
Salary
Salary:
Not provided
maddevs.io Logo
Mad Devs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of hands-on manual testing experience
  • 2+ years of proven experience as a QA engineer with strong skills in Python-based test automation
  • Proficient in testing web applications and AI-powered platforms on both real devices and emulators
  • Familiar with CI/CD workflows, monitoring tools, and version control systems such as Git
  • Comfortable working in fast-paced, distributed startup environments, demonstrating the ability to work independently without micromanagement
  • Clear and effective communicator, capable of collaborating across teams and time zones while maintaining thorough documentation
  • Language skills: English proficiency at B2-C1 level and Russian at B2 level
Job Responsibility
Job Responsibility
  • Test AI/LLM-based client-server applications, focusing on functionality, performance, and reliability
  • Develop and maintain automated test scripts in Python
  • perform manual testing when necessary
  • Utilize QA tools such as Playwright, Selenium, Postman, and TestRail to ensure thorough testing coverage
  • Guarantee quality across infrastructure components, CI/CD pipelines, and integrations
  • Prepare and update detailed test documentation, test scenarios, and defect reports
  • Collaborate closely with developers, DevOps engineers, and product managers to align priorities and deliver high-quality software releases
What we offer
What we offer
  • Flexible working hours
  • Remote-first culture
  • Long-term projects
  • Salary in dollars
  • Professional communities
  • Onsite business trips
  • Training budget
  • Paid conferences
Read More
Arrow Right

Strong Middle / Senior Automation Test Engineer (Python)

Our client is a US-based leading national services and online solutions provider...
Location
Location
Ukraine , Ternopil; Ivano-Frankivsk; Lviv; Kyiv; Uzhhorod; Chernivtsi; Zhytomyr; Rivne; Lutsk
Salary
Salary:
Not provided
eleks.com Logo
ELEKS
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of software quality assurance experience
  • Strong coding skills in Python, with the judgment to recognize test code that needs work and the skill to improve it
  • Experience designing automated test frameworks, not just writing tests inside someone else's framework
  • Proven experience testing RESTful web services and web applications in a cloud environment (Azure preferred)
  • Comfort working across the test pyramid — unit, integration, and end-to-end — and a clear opinion on where each layer earns its keep
  • Comfort reasoning about numerical correctness — tolerances, golden masters, and regression of calculated outputs, not just HTTP 200s
  • Working knowledge of CI/CD pipelines (Azure DevOps or similar) and a point of view on what belongs in pre-merge vs. nightly vs. release gates
  • Awareness of security and compliance considerations in financial software — authorization testing, dependency scanning, and careful handling of sensitive data in test environments
  • A habit of measuring quality — escape rate, flake rate, coverage trends — and using those numbers to drive decisions
  • Familiarity with Selenium WebDriver, Postman, or equivalent tools (BDD/Gherkin/Cucumber is a plus)
Job Responsibility
Job Responsibility
  • Strengthen and extend our automated regression framework so the team can trust the results on every nightly run — assess the current state, propose a path forward, and execute
  • Push testing left: when a nightly regression catches a defect, drive a unit or integration test to catch the same class of problem on the next build
  • Build and maintain unit, integration, and end-to-end tests across our stack — Python test framework, C# APIs running in Azure, SQL and MongoDB
  • Own the quality of the numbers, not just the code — build golden-master and tolerance-based tests for the financial calculations at the heart of BASIS and AtlasOne, where a basis point of drift in a projection is a defect that needs to be caught
  • Own the CI/CD quality gates — decide what blocks a merge, what blocks a release, and how flaky tests get quarantined rather than ignored
  • Treat performance as a quality attribute — stand up performance regression coverage for calc-heavy paths so we catch slowdowns the same week they're introduced, not the quarter a client notices
  • Close the loop with production — work alongside the team to monitor Azure alerts, logs, and traces
  • investigate escaped defects from production support tickets
  • and feed what you find back into the right test layer
  • Develop, document, and execute functional and regression tests across both the established BASIS desktop client and the growing web-based experience that is replacing it
What we offer
What we offer
  • Close cooperation with a customer
  • Challenging tasks
  • Competence development
  • Ability to influence project technologies
  • Team of professionals
  • Dynamic environment with low level of bureaucracy
  • Fulltime
Read More
Arrow Right

Technical Recruiter

As a Technical Recruiter you will be a part of the Talent Acquisition team and d...
Location
Location
Qatar , Doha
Salary
Salary:
Not provided
qic.digital Logo
QIC digital hub
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years in tech recruitment
  • Proven track record of closing Middle and Senior level engineers
  • Experience hiring across multicultural environments, preferably within MENA region
  • Strong sourcing skills across LinkedIn Recruiter, GitHub, and Boolean search
  • Basic tech literacy — you can speak the language of engineers and read a CV correctly
  • Hands-on experience with modern ATS (Huntflow, Teamtailor, or similar)
  • Metrics-driven mindset and high autonomy in managing your pipeline
  • Spoken English at B2 or above
Job Responsibility
Job Responsibility
  • Run full-cycle hiring for technical roles (Backend, Frontend, Mobile, DevOps, Security, QA, Data, and AI)
  • Source actively through LinkedIn Recruiter, GitHub, Boolean and X-Ray search, and niche tech communities
  • Lead intake meetings with hiring managers, screen candidates, coordinate interviews, and manage offers
  • Manage 5–10 parallel requisitions while keeping quality and speed in balance
  • Sustain and improve candidate experience across every stage of the funnel
  • Maintain ATS hygiene and own funnel analytics to drive data-informed decisions
  • Build talent pools for future hiring needs and contribute to our employer brand
What we offer
What we offer
  • Extra paid leave
  • Language classes
  • Meeting with experts
  • Professional development ($600/year for additional courses plus internal workshops)
  • QIC running club
  • Relocation support
  • Remote health insurance (up to $1,500 dental coverage)
  • Tax consultations
  • Travel discounts (Qatar Airways, Turkish Airlines, Doha hotel partners)
  • USD, EUR, or AED salary payouts
  • Fulltime
Read More
Arrow Right

Architectural Technician

Cundall’s Doha Office prides itself on its exemplary track record of delivering ...
Location
Location
Qatar , Doha
Salary
Salary:
Not provided
cundall.com Logo
Cundall
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Diploma or Bachelor’s degree in Architecture, Engineering, Construction Technology, or a related discipline (architectural qualification not mandatory)
  • Minimum 5 years of professional experience as a BIM Technician or BIM Specialist, with strong exposure to large-scale projects in the Middle East (Qatar, KSA, UAE preferred)
  • Expert-level proficiency in Autodesk Revit for architectural BIM (a practical BIM/Revit test will be conducted after the interview)
  • Proven experience delivering coordinated BIM models and documentation across multiple project stages
  • Strong understanding of BIM execution plans (BEP), BIM standards, and model coordination processes
  • Experience working with multidisciplinary teams and managing model coordination issues
  • Familiarity with Qatar Construction Standards (QCS), applicable codes and standards and local authority requirements is highly desirable
  • Proficiency in related tools such as AutoCAD, Navisworks, BIM 360 / ACC, Dynamo knowledge is a strong plus
  • Highly organized, detail-oriented, and able to work efficiently under pressure and tight deadlines
  • Strong communication skills and a collaborative, solution-focused approach
Job Responsibility
Job Responsibility
  • Develop, manage, and coordinate architectural BIM models using Autodesk Revit across all project stages, from concept to IFC and construction
  • Act as the Revit and BIM technical authority within the project team, ensuring accuracy, consistency, and compliance with project BIM standards
  • Coordinate BIM models with multidisciplinary teams (MEP, structural, landscape, interiors, sustainability) to resolve clashes and ensure fully integrated designs
  • Prepare and maintain high-quality construction documentation, drawings, schedules, and families in line with project requirements
  • Support architects and engineers by translating design intent into coordinated and technically robust BIM outputs
  • Implement and help improve BIM workflows, BEP, templates, standards, and quality control procedures within the office
  • Manage model performance, file health, worksharing, and model organization for large and complex projects
  • Assist with clash detection, model audits, and coordination reviews using appropriate BIM tools
  • Support project teams during submissions, authority approvals, and construction stages
  • Explore and apply AI tools, automation scripts, or parametric workflows (where applicable) to improve efficiency, accuracy, and productivity
Read More
Arrow Right
New

Branch Manager

Come and join us as a results driven Branch Manager to deliver sales and exceed ...
Location
Location
United Kingdom , Lymington
Salary
Salary:
Not provided
cityplumbing.co.uk Logo
City Plumbing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A great positive attitude
  • Enjoy customer interaction
  • Management Experience
  • Safe Practices
  • Forward Thinking
  • Tenacity and resilience
  • A pro-active approach to sales, with a strong desire and ability to win and grow new business
  • Experience of customer relationship management and developing a true partnership approach
  • Excellent communication skills
  • Self confident and self motivated, with the ability to work on own initiative or as part of a wider team
Job Responsibility
Job Responsibility
  • Effective management of the team and resource
  • Setting the standard of a sales orientated culture
  • Delivering against sales and customer demands while maximising profitability
  • Maximising margin and net profit
  • Keeping everyone safe
  • Build and maintain relationships with new and existing trade and retail customers
  • Ability to interpret and analyse financial and statistical information
What we offer
What we offer
  • Bonus
  • Discounts, savings and cash back at numerous retailers
  • Life assurance
  • Extended family policy including maternity, paternity, additional annual leave and more
  • Mental Health First Aiders and Employee Assistance Programme, we look out for each other
  • Complete induction and a company that lets you grow and encourages development
  • Financial education and loans
  • Flexible working options
  • A business striving to create an environment of inclusion so everyone can be their true self
  • Fulltime
Read More
Arrow Right
New

Guest Environment Expert

Our jobs aren’t just about giving guests a clean room and a freshly made bed. In...
Location
Location
United States , Poughkeepsie
Salary
Salary:
18.00 USD / Hour
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ensuring a safe work place
  • following company policies and procedures
  • maintaining confidentiality
  • upholding quality standards
  • ensuring professional uniform, personal appearance, and communications
  • ability to stand, sit, or walk for an extended time
  • ability to move, lift, carry, push, pull, and place objects weighing less than or equal to 50 pounds without assistance
Job Responsibility
Job Responsibility
  • Delivering guest requests
  • stocking carts
  • cleaning rooms and public spaces
  • maintaining the appearance and cleanliness of the whole hotel
  • Parttime
Read More
Arrow Right
New

Project Engineer

Our client is seeking a motivated and experienced Project Engineer to join their...
Location
Location
United Kingdom , Dartford
Salary
Salary:
30000.00 GBP / Year
https://www.office-angels.com Logo
Office Angels
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven construction based industry experience, (ideally within Smoke Ventilation/Fire Alarm Systems but not essential)
  • Computer literate with strong reporting and organisational skills
  • Excellent interpersonal and communication skills
  • Ability to multitask and manage cross-disciplinary projects
  • Strong time management and decision-making abilities
  • Professional, presentable, and self-motivated
  • Team-oriented with a commitment to exceeding client and colleague expectations
  • Full UK Driving License required, ideally with your own transport
Job Responsibility
Job Responsibility
  • Assist in the development and delivery of Risk and Method Statements
  • Compile detailed project reports covering quality, progress, and issues
  • Measuring up for install jobs and conducting Coordinate on-site deliveries to ensure smooth logistics
  • Support the accounts team with project-related financials and debt collection
  • Monitor project costs and provide financial updates, including profit/loss analysis
  • Communicate effectively with subcontractors and ensure alignment with project goals
  • Manage resources according to the client's program and track project progress
  • Ensure all documentation and certification is accurate, complete, and submitted on time
What we offer
What we offer
  • 23 days annual leave plus bank holidays, rising to 25 days annual leave at 2 years service
  • Company mobile phone
  • uniform and PPE
  • Life Insurance
  • Private Health Care
  • Pension Scheme
  • Fulltime
Read More
Arrow Right
New

Sales Assistant

Come and join us as a results driven Sales Assistant on a flexible hours basis t...
Location
Location
United Kingdom , Woking
Salary
Salary:
12.71 - 13.93 GBP / Hour
cityplumbing.co.uk Logo
City Plumbing
Expiration Date
September 07, 2026
Flip Icon
Requirements
Requirements
  • A great positive attitude
  • Teamwork
  • Enjoy customer interaction
  • Flexibility
  • Ideally you’ll have previous experience of selling or assisting customers with purchases, ideally with knowledge of the products associated with our industry - although enthusiasm and a can-do attitude is just as important
  • Flexible with working hours
  • Full, clean driving licence may be required
Job Responsibility
Job Responsibility
  • Supporting the Branch Manager and Assistant Branch Manager with achieving and exceeding sales targets at optimum margins
  • Ensuring we maintain high standards, creating and maintaining a loyal customer base and providing a first class service
  • Assisting with the general duties within the branch such as serving customers on the trade counter, telesales and ensuring the housekeeping standards are maintained both on the trade counter and warehousing
  • You may be required to take on general driving duties when required
What we offer
What we offer
  • Bonus
  • Discounts, savings and cash back at numerous retailers
  • Life assurance
  • Extended family policy including maternity, paternity, additional annual leave and more
  • Mental Health First Aiders and Employee Assistance Programme
  • Complete induction and a company that lets you grow and encourages development
  • Financial education and loans
  • Flexible working options
  • Parttime
Read More
Arrow Right