CrawlJobs Logo

Middle AI QA Engineer

maddevs.io Logo

Mad Devs

Location Icon

Location:

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are looking for an AI QA Engineer to ruthlessly test our digital employees ability to listen, think, and speak in real-time. Any delay or logical glitch breaks the magic; your mission is to ensure it stays seamless.

Job Responsibility:

  • Voice UX Testing: Measure and optimize Latency (P95/P99). Verify Barge-In functionality: ensure the agent stops speaking immediately when interrupted, even in noisy environments
  • Logic & Flow Validation: Read and understand NSL (Jinja2) scripts to identify potential logical loops or dead ends. Verify that the agent handles state transitions correctly (e.g., booking created -> confirmation sent)
  • Hallucination Control: Detect when the AI drifts from its instructions or invents facts. Help build "Golden Datasets" of correct conversations for regression testing
  • Integration Testing: Verify that the agent correctly triggers external tools (e.g., CRM updates) during a call. What happens if the API fails? Does the agent handle it gracefully?

Requirements:

  • 2+ years of hands-on experience in manual testing
  • Ability to read code (Python, Jinja2) and work confidently with JSON data payloads to better understand test scenarios
  • Understanding of STT (Speech-to-Text), TTS (Text-to-Speech), and VAD (Voice Activity Detection) concepts, including the importance of silence detection
  • Strong exploratory testing mindset with the ability to intentionally stress and challenge AI agents (e.g., interruptions, rapid speech, topic switching, unclear pronunciation)
  • Russian - Native or Fluent
  • English - Upper-Intermediate (B2+)

Nice to have:

  • Experience with LLM prompting
  • Experience testing voice assistants (Alexa, Google Assistant)
What we offer:
  • Flexible working hours
  • Remote-first culture
  • Long-term projects
  • Salary in dollars
  • Professional communities
  • Onsite business trips
  • Training budget
  • Paid conferences

Additional Information:

Job Posted:
February 16, 2026

Work Type:
Remote work
Icon
Mad Devs - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon
PREMIUM
More languages and countries
+ Unlock 31694 hidden job offers
Languages
English Čeština Deutsch Ελληνικά Español Français +15
Countries
United States United Kingdom India Canada Australia +
See plans
Plans from $2.99 / month

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Middle AI QA Engineer

Middle QA Automation Engineer

We are seeking a motivated QA Automation Engineer to join our team and contribut...
Location
Location
Salary
Salary:
Not provided
maddevs.io Logo
Mad Devs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of hands-on manual testing experience
  • 2+ years of proven experience as a QA engineer with strong skills in Python-based test automation
  • Proficient in testing web applications and AI-powered platforms on both real devices and emulators
  • Familiar with CI/CD workflows, monitoring tools, and version control systems such as Git
  • Comfortable working in fast-paced, distributed startup environments, demonstrating the ability to work independently without micromanagement
  • Clear and effective communicator, capable of collaborating across teams and time zones while maintaining thorough documentation
  • Language skills: English proficiency at B2-C1 level and Russian at B2 level
Job Responsibility
Job Responsibility
  • Test AI/LLM-based client-server applications, focusing on functionality, performance, and reliability
  • Develop and maintain automated test scripts in Python
  • perform manual testing when necessary
  • Utilize QA tools such as Playwright, Selenium, Postman, and TestRail to ensure thorough testing coverage
  • Guarantee quality across infrastructure components, CI/CD pipelines, and integrations
  • Prepare and update detailed test documentation, test scenarios, and defect reports
  • Collaborate closely with developers, DevOps engineers, and product managers to align priorities and deliver high-quality software releases
What we offer
What we offer
  • Flexible working hours
  • Remote-first culture
  • Long-term projects
  • Salary in dollars
  • Professional communities
  • Onsite business trips
  • Training budget
  • Paid conferences
Read More
Arrow Right

Architectural Technician

Cundall’s Doha Office prides itself on its exemplary track record of delivering ...
Location
Location
Qatar , Doha
Salary
Salary:
Not provided
cundall.com Logo
Cundall
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Diploma or Bachelor’s degree in Architecture, Engineering, Construction Technology, or a related discipline (architectural qualification not mandatory)
  • Minimum 5 years of professional experience as a BIM Technician or BIM Specialist, with strong exposure to large-scale projects in the Middle East (Qatar, KSA, UAE preferred)
  • Expert-level proficiency in Autodesk Revit for architectural BIM (a practical BIM/Revit test will be conducted after the interview)
  • Proven experience delivering coordinated BIM models and documentation across multiple project stages
  • Strong understanding of BIM execution plans (BEP), BIM standards, and model coordination processes
  • Experience working with multidisciplinary teams and managing model coordination issues
  • Familiarity with Qatar Construction Standards (QCS), applicable codes and standards and local authority requirements is highly desirable
  • Proficiency in related tools such as AutoCAD, Navisworks, BIM 360 / ACC, Dynamo knowledge is a strong plus
  • Highly organized, detail-oriented, and able to work efficiently under pressure and tight deadlines
  • Strong communication skills and a collaborative, solution-focused approach
Job Responsibility
Job Responsibility
  • Develop, manage, and coordinate architectural BIM models using Autodesk Revit across all project stages, from concept to IFC and construction
  • Act as the Revit and BIM technical authority within the project team, ensuring accuracy, consistency, and compliance with project BIM standards
  • Coordinate BIM models with multidisciplinary teams (MEP, structural, landscape, interiors, sustainability) to resolve clashes and ensure fully integrated designs
  • Prepare and maintain high-quality construction documentation, drawings, schedules, and families in line with project requirements
  • Support architects and engineers by translating design intent into coordinated and technically robust BIM outputs
  • Implement and help improve BIM workflows, BEP, templates, standards, and quality control procedures within the office
  • Manage model performance, file health, worksharing, and model organization for large and complex projects
  • Assist with clash detection, model audits, and coordination reviews using appropriate BIM tools
  • Support project teams during submissions, authority approvals, and construction stages
  • Explore and apply AI tools, automation scripts, or parametric workflows (where applicable) to improve efficiency, accuracy, and productivity
Read More
Arrow Right

Middle Business Analyst

We are seeking a proactive Business Analyst with 3+ years of experience, eager t...
Location
Location
Salary
Salary:
Not provided
inoxoft.com Logo
Inoxoft
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid understanding of business analysis practices, SDLC, and Agile delivery
  • Hands-on experience working with the requirements development and management throughout the project lifecycle
  • Experience creating and maintaining requirements documentation (user stories, use cases, process diagrams, etc.)
  • Ability to clearly communicate business and user needs, explain trade-offs, and support informed decision-making
  • Comfort working with AI- and data-driven requirements, including defining inputs/outputs, understanding data dependencies, limitations, and expected behaviour of AI-powered features
  • Strong analytical thinking, attention to detail, and structured problem-solving approach
  • Confident use of documentation and collaboration tools (Jira, Confluence, FigJam, Google Docs, etc.)
Job Responsibility
Job Responsibility
  • Work closely with business stakeholders to clarify needs, align expectations, and navigate evolving requirements throughout the project lifecycle
  • Analyse inputs from multiple sources, resolve ambiguities or conflicts, and keep requirements focused on real business and user needs
  • Own requirements end-to-end from initial elicitation and documentation to validation, change handling, and ongoing updates
  • Elicit, structure, and document business, user, and solution requirements in a clear and practical way
  • Translate requirements into consistent and easy-to-understand artefacts used by the client, and design, development, and QA teams
  • Ensure requirements remain complete, consistent, and aligned across documentation, backlog, and delivered functionality
  • Collaborate closely with the Project Manager, UX/UI Designers, Developers, QAs, and AI/ML engineers to ensure a shared understanding of scope and expectations
  • Lead backlog creation, refinement, prioritisation, and ongoing maintenance in close collaboration with the PM and delivery team
  • Drive change management by analysing the impact of requirement changes and coordinating scope and backlog updates
What we offer
What we offer
  • Flexible working hours
  • 25 paid days off and 10 sick/medical leaves
  • Additional paid days off for personal events like marriage and childbirth
  • Medical insurance
  • Discount program
  • Self-development budget per year
  • Referral bonuses
  • Corporate events and gifts
  • Learning events and mentorship opportunities
  • Speaking Clubs
Read More
Arrow Right
New

Senior Lecturer/Associate Professor in Literacy

As a Senior Lecturer / Associate Professor in Literacy, you will play a key role...
Location
Location
Australia , Albury-Wodonga, Bathurst, Port Macquarie, Wagga Wagga
Salary
Salary:
Not provided
csu.edu.au Logo
Charles Sturt University
Expiration Date
June 08, 2026
Flip Icon
Requirements
Requirements
  • A doctoral qualification relevant to literacy or education, with a recognised teaching qualification
  • A strong record of high-quality teaching and student-centred learning
  • An established or emerging research profile aligned to literacy, curriculum or pedagogy
  • The ability to build productive partnerships and contribute to academic leadership
Job Responsibility
Job Responsibility
  • Lead impactful literacy teaching and research
  • Teach across online and on-campus environments
  • Shape future teachers and education practice
  • Contribute to curriculum innovation
  • Build strong relationships with students and partners
  • Provide academic leadership in literacy education
  • Contribute to the School's research profile
  • Supervise higher degree research students
  • Actively engage with professional, community and government stakeholders
  • At Associate Professor level: significant academic leadership, research impact, and contribution to the broader discipline at national/international level
What we offer
What we offer
  • 17% superannuation
  • Fulltime
Read More
Arrow Right
New

Program Manager - Controls and Avionics Solutions

This position is based in Endicott, New York. New York and on-site work will be ...
Location
Location
United States , Endicott
Salary
Salary:
120874.00 - 205486.00 USD / Year
baesystems.com Logo
Baesystems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in engineering, engineering or manufacturing management, or other discipline
  • Demonstrated ability for building strong customer/ stakeholder relationships
  • Strong communication, negotiation, and presentation skills
  • Ability to interpret data and make data-driven decisions
  • Highly adaptable with strong initiative
  • Demonstrated ability to lead and motivate cross-functional teams
  • Knowledge of the global aviation market and regulatory requirements and/ or military aviation market
Job Responsibility
Job Responsibility
  • Maintaining strong customer relationships and leading a multidisciplinary team to execute complex development programs within schedule and budget
  • Leadership and management oversight of a project team assuring that project’s financials, schedule, and technical objectives are met and that the highest level of customer satisfaction is achieved while meeting all contractual commitments
  • Work effectively and collaboratively with Engineering, Operations, and all Program Office functional leadership to assure deliveries continue to exceed customer commitments and achievement of financial commitments to the company
  • Manages, coordinates, plans, organizes, controls, integrates, and executes projects within the Military Aircraft Systems portfolio
  • Participates in the support of new business and in the development of proposals
What we offer
What we offer
  • Health insurance
  • Dental insurance
  • Vision insurance
  • Health savings accounts
  • 401(k) savings plan
  • Disability coverage
  • Life and accident insurance
  • Employee assistance program
  • Legal plan
  • Discounts on home, auto, and pet insurance
  • Fulltime
Read More
Arrow Right
New

Finance Business Partner (Research)

Full Time, Fixed Term (12 months). Level 7 - $101,421 to $110,819 p.a. (plus 17%...
Location
Location
Australia , Wagga Wagga
Salary
Salary:
101421.00 - 110819.00 AUD / Year
csu.edu.au Logo
Charles Sturt University
Expiration Date
June 02, 2026
Flip Icon
Requirements
Requirements
  • A degree in Accounting or Finance (professional accounting body membership is desirable)
  • Experience in project budgeting, forecasting and financial analysis
  • Background in management accounting or business partnering within complex environments
  • exposure to government funding or higher education is advantageous
  • Excellent stakeholder engagement skills, with the ability to work effectively with academics and researchers
  • Familiarity with business intelligence systems and dashboard reporting
Job Responsibility
Job Responsibility
  • Partner with academics to deliver strategic financial insights that enable research success
  • Directly influence world-class projects and decisions shaping the future of education and innovation
  • Lead initiatives that enhance financial governance, deliver accurate and timely reporting, and support key projects such as cost-pricing systems and research budgeting
  • Help build financial capability across the University, fostering collaboration and continuous improvement
What we offer
What we offer
  • Flexibility with a 35-hour work week
  • Access to hybrid work arrangements
  • 17% superannuation
  • Fulltime
Read More
Arrow Right
New

Associate Lecturer/ Lecturer in Oral Health

Make a real impact by educating future oral health professionals to serve the ur...
Location
Location
Australia , Wagga Wagga
Salary
Salary:
80046.00 - 134965.00 AUD / Year
csu.edu.au Logo
Charles Sturt University
Expiration Date
June 16, 2026
Flip Icon
Requirements
Requirements
  • A qualification relevant to the discipline and appropriate to the level being applied for
  • Full registration (for teaching/research) as a Dentist or Oral Health Therapist with the Australian Health Practitioner Regulation Agency (Ahpra)
  • Excellent understanding of the clinical practice of oral health therapy, supported by a record of teaching and subject coordination relevant to the discipline and appropriate to the level being applied for
  • Evidence of the delivery of high quality student-centred learning and teaching in oral health therapy and/or general dentistry
  • A record of research activity or capability relevant to the discipline and appropriate to the level being applied for, as outlined in the position descriptions, may facilitate the progression of research opportunities
Job Responsibility
Job Responsibility
  • deliver high-quality teaching, clinical supervision and learning experiences in Oral Health
  • work with students in both clinical and preclinical settings while contributing to curriculum development, industry engagement and community partnerships
What we offer
What we offer
  • Generous support provided to assist with relocating to Riverina’s beautiful Wagga Wagga or surrounds
  • 17% superannuation
  • Fulltime
Read More
Arrow Right
New

Change Analyst

As Change Analyst you will provide specialist change management expertise to sup...
Location
Location
Australia , Albury-Wodonga, Bathurst, Dubbo, Orange, Wagga Wagga
Salary
Salary:
101421.00 - 110819.00 AUD / Year
csu.edu.au Logo
Charles Sturt University
Expiration Date
June 03, 2026
Flip Icon
Requirements
Requirements
  • Relevant qualifications and/or equivalent experience in organisational change and transformation
  • Experienced in applying change management frameworks and methodologies to large-scale/complex organisational initiatives
  • Skilled in analysing change impacts and shaping clear, targeted responses in policy-driven environments
  • Strong communication and interpersonal skills
Job Responsibility
Job Responsibility
  • Provide specialist change management expertise to support the successful planning and implementation of the Models of Engagement and Assessment initiative
  • Lead change analysis, stakeholder engagement planning and adoption activities to enable a sustainable transition to new models of course delivery and assessment.
What we offer
What we offer
  • Competitive salary and benefits including 17% super
  • Flexible working arrangements that support a healthy work-life balance
  • Fulltime
Read More
Arrow Right