CrawlJobs Logo

Sr. Software Development Engineer in Test

Canada, Kitchener Employment contract 135500.00 - 158000.00 CAD / Year · Job Posted May 29, 2026
Apply Position
Job Link Share

Job Description

As a Sr. SDET in Agentic QA, you will own the test automation and quality frameworks that support Dialpad’s AI Voice Agent services. You will develop automated tests for end-to-end product experiences, from frontend UI to backend services to APIs to audio/text interactions. You will test orchestration flows, agent configuration experiences, and guardian safeguards to create robust automated coverage for functionality, performance, reliability, UX, and more. In this role, you will develop substantial amounts of automated test infrastructure and partner deeply with the development team to make our fast-growing AI platform more testable, more stable, and more delightful for customers. This position is based at one of Dialpad’s Canadian offices and reports to a QA Eng Manager in the United States.

Job Responsibility

  • Own end-to-end quality for agentic features and workflows, including strategy, development, execution, and release qualification
  • Design and build automation tooling and frameworks for AI/LLM-driven systems, including prompt flows, agent orchestration, and tool integrations
  • Develop and maintain evaluation frameworks (evals) to measure response quality, accuracy, and hallucination rates
  • Drive automation coverage (80%+ for critical AI workflows) using deterministic + probabilistic validation approaches
  • Integrate AI quality checks into CI/CD pipelines with fast feedback cycles (<15 minutes for PR validation)
  • Build tooling for LLM observability and debugging, including prompt tracing and response analysis
  • Partner with Applied AI teams on prompt engineering, model selection, and evaluation strategies
  • Design and execute performance and load tests for AI services (latency, throughput, cost efficiency)
  • Identify and mitigate risks related to hallucinations, bias, safety, and edge cases
  • Define and track AI quality KPIs (task success rates, precision/recall, latency, etc.)
  • Participate in design and architecture reviews to ensure systems are testable, observable, and resilient
  • Mentor engineers and contribute to raising the bar on AI quality engineering practices

Requirements

  • 5+ years of experience in software engineering or SDET roles with an emphasis on software development
  • Strong programming skills in Python (preferred), Java, or JavaScript
  • Experience testing distributed, cloud-native SaaS systems and APIs
  • Demonstrated proficiency in coding with AI agents to accelerate development and improve code quality
  • Hands-on exposure to LLMs or AI/ML systems (e.g., OpenAI, Claude, Gemini, or similar platforms)
  • Understanding of non-deterministic systems and probabilistic testing approaches
  • Experience building test frameworks and scalable automation systems
  • Familiarity with AI evaluation techniques (benchmarking, golden datasets, human-in-the-loop validation)
  • Experience with CI/CD pipelines (e.g., Jenkins, GitHub Actions)
  • Strong collaboration skills with the ability to work across distributed teams and time zones
  • Bachelor’s degree in Computer Science or equivalent practical experience

What we offer

  • Competitive salary
  • Comprehensive benefits
  • Real opportunities for growth
  • Cutting-edge AI tools
  • Robust training program

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Sr. Software Development Engineer in Test

8 matching positions

Sr. Software Engineer in Test

At Spectro Cloud, we are in search of a talented individual to become an integra...
Location
Location
United States , San Jose
Salary
Salary:
Not provided
spectrocloud.com Logo
Spectro Cloud
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or a related field
  • 8+ years of experience in software testing, quality assurance, or software development with a focus on automation
  • Demonstrated experience writing automated tests for APIs and/or UI applications
  • Proficiency in at least one programming language such as GoLang, Python, or similar
  • Comfortable working in Linux-based operating systems
  • Familiarity with cloud technologies, containers, and Kubernetes
  • Understanding of testing methodologies including Behavior-Driven Development and best practices, with good troubleshooting and debugging skills
  • Ability to learn quickly and adapt to new technologies and testing approaches
  • Strong communication skills and ability to collaborate effectively with cross-functional teams
Job Responsibility
Job Responsibility
  • Develop and maintain automated tests for our distributed platform's core capabilities and features
  • Build test frameworks and testing infrastructure that validate platform functionality across different environments
  • Write and maintain comprehensive test cases for new features and enhancements
  • Create automation tests for both API and UI components using modern testing frameworks
  • Apply Behavior-Driven Development (BDD) principles to create clear, readable test scenarios
  • Collaborate with developers, product managers, and other engineers to integrate testing early in the development process
  • Work with cloud technologies, containers, and Kubernetes to test and validate platform behavior
  • Contribute to improving our testing processes and participate in discussions around testing strategy
  • Troubleshoot and debug issues in Linux-based environments
  • Write clean, maintainable test code that serves as reliable documentation of platform capabilities
Read More
Arrow Right

Sr Software Development Engineer (Full Stack) - Evisort AI

Join the Workday AI organization, where you’ll be building and supporting powerf...
Location
Location
Canada , Vancouver; Toronto
Salary
Salary:
140000.00 - 210000.00 CAD / Year
Workday
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in software engineering
  • 5+ years experience with a web development framework (Python preferred: Flask, Django, or FastAPI)
  • 5+ years with a Relational DB (PostgreSQL preferred)
  • Experience building and operating SaaS products in cloud environments (AWS preferred)
  • Familiarity with the tradeoffs and architecture of modern distributed systems
  • Knowledge of software development standards (DevOps, CI/CD, automated testing, observability)
  • Hands-on experience with containerization technologies (Docker, Kubernetes)
  • Familiarity with Elasticsearch
  • Exposure to additional programming languages like Java (backend) and TypeScript (frontend/fullstack) is a plus
  • Proven success working within fast-paced, agile environments and multi-functional teams
Job Responsibility
Job Responsibility
  • Collaborate with engineering, data science, product, and develop teams to build and evolve our vision, strategy, and roadmap
  • Participate in an encouraging, iterative team culture that values curiosity, learning, and strong engineering practices
  • Contribute to the growth and success of your teammates through knowledge sharing and mentorship
  • Take ownership of multiple functional areas in our platform — from development to production (“you build it, you run it”)
What we offer
What we offer
  • Bonus Plan or role-specific commission/bonus
  • annual refresh stock grants
  • Fulltime
Read More
Arrow Right

Sr. Software Development Engineer

WHAT YOU DO AT AMD CHANGES EVERYTHING. At AMD, our mission is to build great pro...
Location
Location
Serbia , Belgrade
Salary
Salary:
Not provided
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of professional software development experience
  • Excellent C/C++ programming and software design skills, including debugging, performance analysis and test design
  • Experience developing device drivers or other kernel-mode components in a Linux environment (Windows driver experience is a plus)
  • Familiarity with commonly used Linux development and debugging tools (gdb, perf, ftrace, systemtap, etc.)
  • Proven experience leading or owning complex software components or projects from conception to delivery
  • Practical experience in one or more of: GPU virtualization or cloud computing, HPC or AI/ML workloads, GPU architectures (experience with AMD GPU technologies is a plus)
  • Strong expertise in performance tuning and optimization of GPU or system-level software
  • Experience with containerization and orchestration technologies (Docker, Kubernetes, etc.) and their integration with GPU resources
  • Strong communication skills, with the ability to explain complex technical topics clearly to different audiences
  • The candidate must have an undergraduate degree in a related field (Computer Science, Computer or Software Engineering)
Job Responsibility
Job Responsibility
  • Design, implement and maintain kernel-mode and system-level components for AMD’s GPU virtualization stack on Linux and/or Windows
  • Integrate AMD’s GPU software stack with multiple hypervisors (KVM, Hyper‑V, VMware and others)
  • Debug complex issues across layers (driver, firmware, hypervisor, OS, containers, cloud stack)
  • Collaborate with internal component teams and external partners to deliver robust, scalable GPU solutions
  • Use and help refine AI-assisted development and analysis workflows within the team (e.g., for code exploration, test generation, log analysis)
What we offer
What we offer
  • Benefits offered are described at AMD benefits at a glance
  • Fulltime
Read More
Arrow Right

Sr. Software Development Engineer

As a core member of the team, you will play a pivotal role in optimizing and dev...
Location
Location
China , Shanghai
Salary
Salary:
Not provided
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Skilled engineer with strong technical and analytical expertise in C++ development within Linux environments
  • Ability to define goals, manage development efforts, and deliver high-quality solutions
  • Strong problem-solving skills
  • Proactive approach
  • Keen understanding of software engineering best practices
  • Experience in GPU kernel development & optimization for AMD GPUs using HIP, CUDA, and assembly (ASM)
  • Strong knowledge of AMD architectures (GCN, RDNA) and low-level programming
  • Experience leveraging tools like Compute Kernel (CK), CUTLASS, and Triton for multi-GPU and multi-platform performance
  • Experience in integrating optimized GPU performance into machine learning frameworks (e.g., TensorFlow, PyTorch)
  • Skilled in Python and C++
Job Responsibility
Job Responsibility
  • Optimize Deep Learning Frameworks: Enhance and optimize frameworks like TensorFlow and PyTorch for AMD GPUs in open-source repositories
  • Develop GPU Kernels: Create and optimize GPU kernels to maximize performance for specific AI operations
  • Develop & Optimize Models: Design and optimize deep learning models specifically for AMD GPU performance
  • Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improve training and inference performance on AMD GPUs
  • Collaborate with Open-Source Maintainers: Engage with framework maintainers to ensure code changes are aligned with requirements and integrated upstream
  • Work in Distributed Computing Environments: Optimize deep learning performance on both scale-up (multi-GPU) and scale-out (multi-node) systems
  • Utilize Cutting-Edge Compiler Tech: Leverage advanced compiler technologies to improve deep learning performance
  • Optimize Deep Learning Pipeline: Enhance the full pipeline, including integrating graph compilers
  • Software Engineering Best Practices: Apply sound engineering principles to ensure robust, maintainable solutions
Read More
Arrow Right

Sr. Software Development Engineer, AWS Proactive Security

Amazon Web Services (AWS) is one of Amazon's fastest growing businesses. We are ...
Location
Location
United States
Salary
Salary:
168100.00 - 227400.00 USD / Year
mygwork.com Logo
myGwork - LGBTQ+ Business Community
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language experience
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • Experience as a mentor, tech lead or leading an engineering team
Job Responsibility
Job Responsibility
  • Design and build scalable a data platform that enables the evolution of how software builders ship security
  • Develop systems that enable security teams to investigate and contextualize vulnerability risks across all AWS products and services
  • Create API and MCP integrations that connect security workflows to high quality context data
  • Develop intelligent systems that deliver high quality contextual data at scale
  • Design, build and test Software Solutions that deliver industry leading secure-by-default components to AWS builders that meets the bar for durability, performance, scalability
  • Provide software development expertise in support of AWS Security
  • Directly represent the team to business leader and technical staff at all levels of the company
  • Demonstrate "exceptional" judgment, integrity, business acumen, and communication skills
  • Prepare and present detailed, written technical information for internal and external audiences
What we offer
What we offer
  • health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
  • 401(k) matching
  • paid time off
  • parental leave
  • sign-on payments
  • restricted stock units (RSUs)
  • flexible work hours and arrangements
Read More
Arrow Right
New

Sr Software Engineer

We are seeking a highly skilled and experienced Sr Software Engineer to join our...
Location
Location
United States , Austin
Salary
Salary:
Not provided
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Software Engineering, or a related field
  • 5+ years of professional software engineering experience, with a strong focus on backend systems and service development
  • Proven experience working independently on complex projects with minimal guidance, delivering high-impact results
  • Proficiency in Java, Python for building production-grade services
  • Hands-on experience with Azure cloud services, such as Event Hubs, Azure Functions, AKS/Kubernetes, Azure API Management, PostgreSQL DB
  • Experience designing and building REST APIs and event-driven architectures using Kafka or Azure Event Hubs
  • Strong expertise in data architecture design and scalable system design
  • Solid understanding of CI/CD pipelines, containerization (Docker, Kubernetes/OCP), and cloud-native development practices
  • Hands-on experience with automation frameworks, DevOps practices, and modern engineering toolchains
  • Experience with or strong understanding of AI/ML concepts, AI integrations, or AI-enabled systems
Job Responsibility
Job Responsibility
  • Lead the design and development of complex software systems, working independently with minimal guidance
  • Drive automation strategy and implementation across development, testing, and deployment pipelines to improve engineering efficiency and system reliability
  • Enable and integrate AI-driven capabilities into applications and platforms, identifying opportunities to enhance business processes and customer experiences
  • Define and implement scalable data architecture solutions that support analytics, AI use cases, and enterprise needs
  • Lead modernization initiatives, including transforming legacy systems into cloud-native, microservices-based architectures
  • Solve complex, non-standard technical problems using advanced analytical and debugging skills
  • Influence and collaborate across teams to align technical solutions with broader organizational goals
  • Actively participate in and contribute to all phases of the Scaled Agile Framework (SAFe), driving outcomes across teams
  • Write high-quality, maintainable, and efficient code following best practices and engineering standards
  • Own and drive the full software development lifecycle, from requirements through deployment and production support
What we offer
What we offer
  • Relocation benefits
  • Fulltime
Read More
Arrow Right

Sr. Software Engineer

At Applied Network Solutions (ANS), we bring together some of the most curious m...
Location
Location
United States , Annapolis Junction
Salary
Salary:
100000.00 - 200000.00 USD / Year
go-ans.com Logo
Applied Network Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Twenty (20) years of experience as a SWE in programs and contracts of similar scope, type, and complexity is required
  • Bachelor’s degree in computer science or related discipline from an accredited college or university is required. Four (4) years of additional SWE experience on projects with similar software processes may be substituted for a bachelor’s degree
  • Required certification: CompTIA Security+ CE, CCNA-Security, CySA+, GICSP, GSEC, CND, or SSCP
  • Hands-on experience operating or platform engineering production-grade Kubernetes clusters
  • Understanding of containerization concepts and operations, i.e. pod security standards
  • Working knowledge of PKI certificates and PKI management
  • Experience with GitOps development and CI/CD pipelines
  • Basic Linux administration
  • Experience with Python and Bash scripting
  • Experience with Jira/Confluence for project, tasks and documentation management
Job Responsibility
Job Responsibility
  • Design, code, and modify software to add features, implement high-performance algorithms, and integrate applications into diverse operating environments
  • Design and implement complex data interfaces and execute queries for existing or proposed repositories to ensure data accessibility and system functionality
  • Analyze work processes and system performance to develop technical solutions and provide recommendations for improving development standards
  • Write and review technical documentation while assisting in the development and execution of comprehensive software test procedures
  • Regularly collaborate with team members, management, and customers through clear and effective communication, including delivering professional presentations and ensuring the accurate exchange of critical information
What we offer
What we offer
  • Family Medical, Dental (w/ adult orthodontia) and Vision coverage
  • Pet Discount Program
  • PTO (Paid Time Off)
  • Maternity/ Paternity Leave
  • Supplemental Military Leave Pay
  • 11 Paid Holidays
  • 401(k) plan with 6% Company Contribution
  • Generous Professional Development Program
  • 100% Employer paid Short- and Long-Term Disability
  • 100% Employer paid Life Insurance
  • Fulltime
Read More
Arrow Right

Sr. Software Engineer

A software engineering and AI company located in Oklahoma City is looking for ta...
Location
Location
United States , Oklahoma City
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in multiple programming languages and technology stacks
  • proven track record of leading software development teams using Agile methodologies
  • Extensive full-stack development experience across enterprise systems, including Web UI, Mobile, HTTP Web Services, and Database layers
  • Solid hands-on experience with modern CI/CD, automated testing, and deployment practices
  • Strong technical consulting skills, including direct communication with clients
  • Collaborative team player with excellent problem-solving abilities, skilled at evaluating various technical solutions and balancing complexity, effort, and business value
  • Demonstrated interest and initiative in the AI engineering space
  • .NET, C#, ASP.NET (MVC, Web API), JavaScript, Angular, iOS (Swift), Android (Kotlin)
  • Git, Chromium, HTTP, REST
Job Responsibility
Job Responsibility
  • Lead feature development and maintenance for our high-visibility, consumer-facing enterprise platform, working within an Agile framework
  • Design, implement, and maintain automated testing processes, as well as conduct manual acceptance/regression testing to ensure feature reliability
  • Conduct code reviews and provide constructive feedback on pull requests to maintain best coding standards and practices
  • Estimate level of effort and break down tasks for backlog items and client requests to support accurate project planning
  • Accelerate delivery by developing and maintaining automated builds and container orchestration for distributed systems
  • Mentor less-experienced team members throughout the feature lifecycle—from conception and implementation to testing
  • Proactively identify opportunities for team and technology improvement, driving innovation and efficiency
  • Analyze application performance in a variety of environments and implement optimizations for enhanced user experience
  • Manage and monitor platform dependencies (.NET, iOS, Android) to ensure timely feature implementation and support
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • enrollment in company 401(k) plan
  • Fulltime
Read More
Arrow Right