CrawlJobs Logo

AI Senior Test Automation Specialist

devrev.ai Logo

DevRev

Location Icon

Location:
Philippines , Cebu

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

As Senior AI QA Automation Specialist, you will leverage a cutting-edge test automation framework to enhance and expedite testing processes, govern and evolve test frameworks, develop a test reporting system, and develop a comprehensive monitoring and alerting system. Your expertise will ensure the robustness, efficiency, and reliability of the software delivery pipeline.

Job Responsibility:

  • Implement and utilize AI and intelligent agents to accelerate test generation processes
  • Transition from manual test case development to AI-driven automation solutions, enhancing overall testing efficiency
  • Define clear, concise, and comprehensive test cases based on requirements, specifications, and user stories
  • Ensure test cases cover both positive and negative scenarios, edge cases, and system interactions
  • Maintain traceability between test cases and product features
  • Organize and maintain test suites to reflect product changes and evolving test coverage needs
  • Refactor outdated or redundant tests, ensuring relevance and accuracy
  • Maintain a clear structure for manual and automated test suites for ease of access and reusability
  • Design and implement a test automation framework using Playwright for end-to-end web testing that is modular, maintainable, and scalable
  • Create a blueprint and best practices for the QA team to onboard and contribute new automated test cases seamlessly
  • Define coding standards, version control practices, branching strategies, and code review guidelines for the QA automation codebase
  • Integrate test automation into CI/CD pipelines with real-time test reporting
  • Explore and integrate AI-powered tools for test case generation, flakiness detection, and intelligent exploratory testing (e.g., Testim, Mabl, Diffblue, or custom LLM-based test generation tools)
  • Champion shift-left testing practices by collaborating with developers, product managers, and DevOps to catch issues early
  • Oversee the maintenance and continuous improvement of the existing test framework
  • Analyze test failures and test escapes to identify root causes and implement solutions
  • Foster a culture of quality through continuous improvements in testing methodologies and frameworks
  • Design and develop test reports to provide visibility into the test suite's performance and failures
  • Implement an effective test failures alerting system to promptly notify feature owners and responsible developers of SUT issues and failures

Requirements:

  • Minimum Bachelor's degree in Computer Science, Engineering, or a related field
  • 7+ years of experience in Quality Assurance, with 3+ years architecting automation frameworks
  • Deep hands-on experience with Playwright (JavaScript/TypeScript) in a real-world production environment
  • Demonstrated experience building an automation framework from scratch, with organized test categorization, reusability, and CI/CD integration
  • Strong understanding of software testing methodologies, test planning, and test strategy
  • Familiarity with using AI to enhance testing and software development
  • Strong problem-solving skills and attention to detail
  • Experience with test reporting and analytics tools (e.g., Allure, ReportPortal, TestRail)
  • Strong scripting and coding skills (JavaScript/TypeScript)
  • Experience with test management and defect tracking systems
  • Experience with cloud-based test execution and containerization (Docker, Kubernetes)
  • Familiarity with Git, Jenkins/GitHub Actions/Azure DevOps, and cloud services like AWS/GCP is a plus
  • Excellent communication, teamwork, and documentation skills, with a strong ability to advocate for best practices

Nice to have:

  • Contributions to open-source QA frameworks or tools
  • Familiarity with visual regression tools (e.g., Percy, Applitools)
  • Knowledge of performance testing tools and integration with automation pipelines
  • Experience working in Agile/Scrum or DevOps-centric environments

Additional Information:

Job Posted:
February 17, 2026

Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for AI Senior Test Automation Specialist

Senior AI Engineer

Elsewhen, a London-based consultancy, designs and builds technology solutions fo...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
elsewhen.com Logo
Elsewhen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Professional AI engineering experience
  • Background in Software Engineering with Python
  • Solid understanding of the Python standard library and modern Python coding, testing, debugging and automation techniques
  • Hands-on experience building solutions using LLMs and Agentic architectures with ADK, LlamaIndex, or LangGraph
  • Working with vector databases for embedding and indexing
  • Strong experience with cloud platforms
  • Strong experience with API design and frameworks like FastAPI or Flask
  • Solid experience with relational databases and SQL
  • Interest in expanding your knowledge into GenAI and machine learning
  • Excellent communication skills and the ability to work well in a collaborative team environment
Job Responsibility
Job Responsibility
  • Experiment with POCs to find solutions for real-world problems using Large Language Models
  • Collaborate on AI-driven projects, working alongside engineers, product managers and AI specialists while maintaining clear documentation
  • Build and deploy Agentic LLM-based solutions with LangGraph
  • Familiar with different multi agent system patterns
  • Build and deploy LLM-based solutions using RAG
  • Familiar with different types of databases: Relational, Graph etc
  • Design and optimise APIs using Python and FastAPI to serve AI solutions
  • Familiar with GCP ecosystem and Cloudrun
  • Build and optimise data pipelines for vector search and knowledge retrieval using Vector databases and embedding models
What we offer
What we offer
  • Private Health Insurance: Comprehensive coverage for both physical and mental health
  • Flexible and Remote-First Work Environment: Choose how and where you work, with the option for weekly team meet-ups in central London
  • Generous Leave Policy: 27 days of holiday plus bank holidays
  • Family-friendly policies, including enhanced maternity, paternity and shared
  • Learning and Development: Individual annual budget of £2,000 for learning and development, with dedicated learning days
  • Feel Better Fund: £500 to help set up your remote office
  • Social Events: Monthly and quarterly team events, an annual team trip, and half-yearly social events
  • Gym Membership Contribution: Support for maintaining your physical health
  • Pension Contribution: Enhanced employer pension contribution of 6%
  • Bonus Opportunities: Potential to receive a discretionary (non-contractual) bonus based on business and personal achievements
Read More
Arrow Right

Senior Application Engineer (Salesforce Agentforce AI)

We’re looking for creative thinkers with hands-on experience in Agentforce, AI a...
Location
Location
Canada , Mississauga
Salary
Salary:
112000.00 - 125000.00 USD / Year
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building Agentforce AI Agents, AI workflows, custom agent development, and integration of external data sources
  • Experience creating intelligent process automations using tools like Power Automate or others
  • Solid experience creating test automations for Salesforce and other platforms
  • Solid experience writing clean code that performs well at scale using JavaScript, Apex, Python, etc.
  • Solid experience with Salesforce integrations and external system integrations (Conga, Docusign, Adobe, Marketo, Gainsight, Gong, Qualtrics, Kantata, TaskRay, etc.)
  • Proficient in DevOps processes and tools (e.g., Copado, AutoRabit)
  • Proficient in GITHUB and troubleshooting standard versioning and DevOps issues
  • Proficient in Agile methodologies (Scrum/Kanban) to iteratively deliver standard solutions
  • Solid experience with automated testing frameworks (e.g. PMD, Selenium, Copado CRT)
  • In-depth understanding of Salesforce data models, security, and governor limits
Job Responsibility
Job Responsibility
  • Work at the forefront of AI-driven Salesforce solutions and build AI Agents using Agentforce, and other AI platforms like Microsoft Studio for CoPilot Agents
  • Pioneer intelligent automations in enterprise environments using IPA tools like Power Automate, Alteryx, and others
  • Build test automations to improve QA efficiencies in QA for Salesforce and other applications
  • Collaborate with product designers, end-users, and other team members to refine and understand outcomes and AI use cases
  • Collaborate with other team members to brainstorm ideas for prototyping to test and solution for use cases identified and prioritized
  • Execute standard to complex tasks in the application development life cycle using languages like Apex, JavaScript, Python, etc., etc., relevant to the core applications (Salesforce, Billing Platform, etc.) and connected or integrated apps (Conga, Docusign, Adobe, Marketo, Gainsight, Gong, Qualtrics, Kantata, TaskRay, etc.)
  • Perform unit tests for your builds and collaborate with Product Designers and other team members to create accurate and quality test scripts for automated and manual testing
  • Analyze, troubleshoot, and debug systems for standard issues
  • Be an AI change agent in your team to gain team buy-in for adopting use of AI agents to save time, reduce waste and improve efficiency to deliver value to customers faster
  • Create and maintain technical documentation for all builds and AI Agents produced
What we offer
What we offer
  • Benefits starting from Day 1
  • Retirement Plan Matching
  • Flexible Paid Time Off
  • Wellness Support Programs and Resources
  • Parental & Caregiver Leaves
  • Fertility & Adoption Support
  • Continuous Development Support Program
  • Employee Assistance Program
  • Allyship and Inclusion Communities
  • Employee Recognition
  • Fulltime
Read More
Arrow Right

Senior Application Engineer (Salesforce Agentforce AI)

We’re looking for creative thinkers with hands-on experience in Agentforce, AI a...
Location
Location
United States
Salary
Salary:
121000.00 - 135000.00 USD / Year
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience building Agentforce AI Agents, AI workflows, custom agent development, and integration of external data sources
  • Experience creating intelligent process automations using tools like Power Automate or others
  • Solid experience creating test automations for Salesforce and other platforms
  • Solid experience writing clean code that performs well at scale using JavaScript, Apex, Python, etc.
  • Solid experience with Salesforce integrations and external system integrations (Conga, Docusign, Adobe, Marketo, Gainsight, Gong, Qualtrics, Kantata, TaskRay, etc.)
  • Proficient in DevOps processes and tools (e.g., Copado, AutoRabit)
  • Proficient in GITHUB and troubleshooting standard versioning and DevOps issues
  • Proficient in Agile methodologies (Scrum/Kanban) to iteratively deliver standard solutions
  • Solid experience with automated testing frameworks (e.g. PMD, Selenium, Copado CRT)
  • In-depth understanding of Salesforce data models, security, and governor limits
Job Responsibility
Job Responsibility
  • Work at the forefront of AI-driven Salesforce solutions and build AI Agents using Agentforce, and other AI platforms like Microsoft Studio for CoPilot Agents
  • Pioneer intelligent automations in enterprise environments using IPA tools like Power Automate, Alteryx, and others
  • Build test automations to improve QA efficiencies in QA for Salesforce and other applications
  • Collaborate with product designers, end-users, and other team members to refine and understand outcomes and AI use cases
  • Collaborate with other team members to brainstorm ideas for prototyping to test and solution for use cases identified and prioritized
  • Execute standard to complex tasks in the application development life cycle using languages like Apex, JavaScript, Python, etc., etc., relevant to the core applications (Salesforce, Billing Platform, etc.) and connected or integrated apps (Conga, Docusign, Adobe, Marketo, Gainsight, Gong, Qualtrics, Kantata, TaskRay, etc.)
  • Perform unit tests for your builds and collaborate with Product Designers and other team members to create accurate and quality test scripts for automated and manual testing
  • Analyze, troubleshoot, and debug systems for standard issues
  • Be an AI change agent in your team to gain team buy-in for adopting use of AI agents to save time, reduce waste and improve efficiency to deliver value to customers faster
  • Create and maintain technical documentation for all builds and AI Agents produced
What we offer
What we offer
  • Benefits starting from Day 1
  • Retirement Plan Matching
  • Flexible Paid Time Off
  • Wellness Support Programs and Resources
  • Parental & Caregiver Leaves
  • Fertility & Adoption Support
  • Continuous Development Support Program
  • Employee Assistance Program
  • Allyship and Inclusion Communities
  • Employee Recognition
  • Fulltime
Read More
Arrow Right

Director, Customer Care Product Operations

We are seeking an experienced leader to execute the strategic direction of our C...
Location
Location
United States , Mountain View
Salary
Salary:
216000.00 - 264000.00 USD / Year
earnin.com Logo
EarnIn
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep passion for customers and a strong belief in the power of care as a product differentiator
  • 7+ years proven leadership experience, including managing cross-functional embedded teams and developing systems for scale and autonomy
  • Strong product and/or technical background preferred—ideally with a degree in Engineering, Computer Science, or related field and hands-on product development or technical experience
  • Experience with AI strategy, including tool selection, automation mapping, and agent-assist systems
  • Demonstrated ability to build and scale user research and feedback loops into product pipelines
  • Outstanding analytical and problem-solving skills
  • data-driven decision-making is a must
  • Expertise or capability in operations including knowledge of quality assurance, agent readiness, escalations
  • Track record of influencing and aligning with stakeholders across Product, Engineering, Marketing, and CX
  • Excellent communication and collaboration skills—especially in high-ambiguity environments
Job Responsibility
Job Responsibility
  • Own and drive the Care AI strategy to shift from human support to automated and AI-powered resolution
  • Define automation use cases, KPIs, and optimize adoption across all support channels
  • Partner and collaborate closely with Product & Engineering to align automation roadmap with technical feasibility and business goals
  • Lead Customer Care’s product integration strategy to embed CX into every product and operational decision
  • Manage 4–5 senior Care Specialists embedded in key product pods to ensure launch readiness, lifecycle comms, and research support
  • Act as the cross-functional glue between Care, Product, and Eng—aligning roadmaps, surfacing feedback, and driving issue resolution
  • Consolidate customer, agent, and system insights into a single narrative to inform continuous improvement
  • Build a scalable, company-wide user research program with EarnIn-specific guidelines to enable autonomous research
  • Define high-priority UR initiatives aligned to business goals that product operations will take on
  • Select and implement research tooling (e.g., Maze, Dovetail) to support execution at scale
What we offer
What we offer
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Automation Support Specialist

We’re looking for an Automation Specialist who enjoys solving complex problems, ...
Location
Location
Philippines , Manila
Salary
Salary:
Not provided
eucalyptus.health Logo
Eucalyptus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of relevant experience in automation, operations, healthcare/telehealth, customer or tech support, or other problem-solving roles
  • Hands-on experience with automation tools such as Zapier, n8n, Make (Integromat), or similar low-code/no-code platforms
  • Experience with or strong interest in AI, including prompt engineering, NLP, and applying generative AI to real-world workflows
  • Tech-savvy and adaptable, with a strong working knowledge of Google Workspace, Slack, Notion, and other productivity or project management tools
  • Strong analytical and problem-solving skills, using data to identify opportunities, measure impact, and improve processes
  • Clear and confident communicator, with excellent written and spoken English and the ability to explain technical concepts to non-technical stakeholders
  • Experience working cross-functionally with product, engineering, or operations teams
  • High attention to detail and strong organisational skills
  • Trustworthy and professional, able to handle sensitive and confidential information appropriately
  • Proactive self-starter, comfortable working with minimal supervision and owning projects end-to-end
Job Responsibility
Job Responsibility
  • Designs, builds, and maintains automation workflows using internal platforms (e.g. Lorikeet), with a focus on reliability, maintainability, and scalability
  • Deliver scoped automation projects effectively and on-time to support internal teams automate repeatable processes
  • Maintains and enhances workflows by fixing bugs, adding improvements, and applying feedback to boost quality and reduce manual effort
  • Monitors workflow performance to identify, troubleshoot, and resolve errors proactively using logs, alerts, and dashboards
  • Documents workflows thoroughly to support team knowledge sharing and maintenance
  • Performs structured QA and testing, validating logic across edge cases, confirming data inputs/outputs, and ensuring automations are ready for production use
  • Supports metric reporting by tracking automation outcomes, errors, and patient satisfaction with guidance from senior team members
What we offer
What we offer
  • Wellness budgets
  • Social clubs
  • Hybrid work arrangement
  • Initiatives that help you stay balanced and connected
  • Comprehensive health coverage (including up to 2 dependents)
  • Vacation, sick, and parental leaves
  • 13th-month pay
  • Statutory benefits
  • Transport allowance
  • Learning budgets
  • Fulltime
Read More
Arrow Right
New

Systems Integration Senior Specialist Advisor

The Senior Integration Specialist role requires a minimum of 5 years of software...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on software development in diverse set of tech stack, including. C#, .NET Core, .netFramework, Entity Framework, ASP.NET, MVC & WebAPI
  • Experience in databases (SQL Server or similar) – desirable to have knowledge of SSRS
  • Experience in web development using likes of Knockout.js, Razor, Javascript frameworks
  • Familiarity in scripting languages such as PowerShell, Groovy, Python, and Shell
  • Experience with CI/CD tools and technologies (e.g., Jenkins, TeamCity, Git, Nexus)
  • Familiarity with Service communication protocols: WCF, gRPC, Messaging and real-time technologies: SignalR, RabbitMQ
  • Exposure to AI and machine learning technologies is highly desirable
  • Additional programming knowledge in Java is a plus
  • 3+ years in technical roles within investment banking or similar enterprise environments
  • Full software development lifecycle experience: requirements, design, development, testing, deployment, and automation
Read More
Arrow Right

Senior AI Engineer

Elsewhen, a London-based consultancy, designs and builds technology solutions fo...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
elsewhen.com Logo
Elsewhen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Professional AI engineering experience
  • Background in Software Engineering with Python
  • Solid understanding of the Python standard library and modern Python coding, testing, debugging and automation techniques
  • Hands-on experience building solutions using LLMs and Agentic architectures with ADK, LlamaIndex, or LangGraph
  • Working with vector databases for embedding and indexing
  • Strong experience with cloud platforms
  • Strong experience with API design and frameworks like FastAPI or Flask
  • Solid experience with relational databases and SQL
  • Interest in expanding your knowledge into GenAI and machine learning
  • Excellent communication skills and the ability to work well in a collaborative team environment
Job Responsibility
Job Responsibility
  • Experiment with POCs to find solutions for real-world problems using Large Language Models
  • Collaborate on AI-driven projects, working alongside engineers, product managers and AI specialists while maintaining clear documentation
  • Build and deploy Agentic LLM-based solutions with LangGraph
  • Familiar with different multi agent system patterns
  • Build and deploy LLM-based solutions using RAG
  • Familiar with different types of databases: Relational, Graph etc
  • Design and optimise APIs using Python and FastAPI to serve AI solutions
  • Familiar with GCP ecosystem and Cloudrun
  • Build and optimise data pipelines for vector search and knowledge retrieval using Vector databases and embedding models
What we offer
What we offer
  • Private Health Insurance: Comprehensive coverage for both physical and mental health
  • Flexible and Remote-First Work Environment: Choose how and where you work, with the option for weekly team meet-ups in central London
  • Generous Leave Policy: 27 days of holiday plus bank holidays
  • Family-friendly policies, including enhanced maternity, paternity and shared
  • Learning and Development: Individual annual budget of £2,000 for learning and development, with dedicated learning days
  • Feel Better Fund: £500 to help set up your remote office
  • Social Events: Monthly and quarterly team events, an annual team trip, and half-yearly social events
  • Gym Membership Contribution: Support for maintaining your physical health
  • Pension Contribution: Enhanced employer pension contribution of 6%
  • Bonus Opportunities: Potential to receive a discretionary (non-contractual) bonus based on business and personal achievements
  • Fulltime
Read More
Arrow Right
New

Senior GenAI Specialist / AI Engineer - Assistant Vice President

We are seeking a highly skilled and passionate Senior GenAI Specialist to join o...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5 years+ of experience in AI/ML development, with a proven track record of building and deploying sophisticated GenAI applications
  • Deep understanding of GenAI models and architectures, including transformers, LLMs (e.g., Llama, Gemini, GPT-4), GANs, and diffusion models. Familiarity with Agentic AI concepts
  • Extensive experience with prompt engineering, fine-tuning LLMs, and evaluating their performance
  • Expert-level Python programming skills and proficiency with relevant libraries (e.g., Transformers, LangChain, TensorFlow, PyTorch, Pandas, NumPy, Scikit-learn, Flask/Django, LlamaIndex)
  • Experience with vector databases (e.g., Pinecone, Weaviate, Chroma, Faiss, PostgreSQL with vector extensions) and implementing RAG pipelines using tools like LlamaIndex and LangChain
  • Strong software engineering skills, including containerization (Docker, Kubernetes), CI/CD pipelines, and cloud infrastructure management (AWS, Azure, GCP)
  • Strong analytical, problem-solving, and communication skills
  • Experience with MLOps principles and tools
  • Excellent collaboration skills
Job Responsibility
Job Responsibility
  • Design, develop, and implement GenAI solutions for various financial applications, including personalized recommendations, risk assessment, fraud detection, and automated reporting. Explore and experiment with advanced GenAI concepts like Agentic AI
  • Design and implement intelligent chatbots
  • Process and analyze large datasets of structured and unstructured financial data
  • Architect and implement efficient RAG pipelines, leveraging tools like LlamaIndex and LangChain
  • Develop and refine advanced prompting strategies for LLMs
  • Test, evaluate, and analyze the performance of LLM and other GenAI models
  • Collaborate closely with engineering teams to deploy and maintain GenAI models in production environments, including containerization, CI/CD pipelines, and cloud infrastructure management
  • Communicate effectively with business stakeholders
  • Stay up-to-date with the latest advancements in GenAI research and development, including areas like Agentic AI
  • Fulltime
Read More
Arrow Right