CrawlJobs Logo
C
Codvo AI · IT - Software Development

Principal Engineer - Test

United Kingdom, Cambridge · Job Posted June 03, 2026
Apply Position
Job Link Share

Job Description

We are looking for detail-oriented and forward-thinking Test Engineer to ensure the quality, performance, and security of our Core AI Services. You will help validate distributed, cloud-native services and public APIs that form the foundation for enterprise AI capabilities. This role demands deep technical skill and a passion for delivering robust, secure, and ethical AI services at scale. You’ll be a part of a Scrum team and work closely with developers and architects to design effective validation strategies, automated testing frameworks, and AI-specific evaluation tools - with a builder mindset - rapid prototyping and continuous improvement with agility of a start-up

Job Responsibility

  • Perform functional, performance, and security testing on cloud-native services deployed on Microsoft Azure
  • Design and implement automated test suites for APIs, service components, and AI pipelines
  • Automate the evaluation of AI system outputs to ensure accuracy, consistency, and safety of responses
  • Collaborate with developers and data scientists to establish service-level quality metrics and observability hooks
  • Validate services against AI regulatory frameworks and ensure traceability, fairness, and robustness in outcomes
  • Participate in threat modelling and security validation of exposed APIs and AI services
  • Provide feedback early in the lifecycle to reduce defects and improve design
  • Mentor junior testers, encourage continuous learning, and contribute to a culture of innovation

Requirements

  • 12+ years of experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and .NET technologies
  • Proficient in designing automated testing frameworks
  • Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized test environments
  • Strong understanding of API testing, performance profiling, and security testing (including OWASP top 10)
  • Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions
  • Experience working in Agile teams and collaborating across global R&D locations
  • Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation

Nice to have

  • Familiarity with LLM evaluation techniques, output scoring, and validation frameworks
  • Understanding of key concepts such as prompt engineering, RAG, model orchestration, and hallucination detection
  • Experience in testing for accuracy, relevance, and consistency of AI model predictions/generations
  • Defining Performance Metrics for AI services and testing for the same
  • Awareness of AI safety, bias detection, and explainability techniques
  • Experience ensuring compliance with AI regulations and standards (e.g., NIST AI RMF, EU AI Act)
  • Strong belief in ethical AI practices, transparency, and end-user trust
Codvo AI - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal Engineer - Test

8 matching positions

Principal Engineer - Test

We are looking for detail-oriented and forward-thinking Test Engineer to ensure ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in software testing, QA, or validation roles for cloud-native applications using Microsoft and .NET technologies
  • Proficient in designing automated testing frameworks
  • Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized test environments
  • Strong understanding of API testing, performance profiling, and security testing (including OWASP top 10)
  • Excellent problem-solving skills, with the ability to analyse complex technical challenges and propose scalable solutions
  • Experience working in Agile teams and collaborating across global R&D locations
  • Demonstrated ability to mentor junior team members fostering a culture of continuous learning and innovation
Job Responsibility
Job Responsibility
  • Perform functional, performance, and security testing on cloud-native services deployed on Microsoft Azure
  • Design and implement automated test suites for APIs, service components, and AI pipelines
  • Automate the evaluation of AI system outputs to ensure accuracy, consistency, and safety of responses
  • Collaborate with developers and data scientists to establish service-level quality metrics and observability hooks
  • Validate services against AI regulatory frameworks and ensure traceability, fairness, and robustness in outcomes
  • Participate in threat modelling and security validation of exposed APIs and AI services
  • Provide feedback early in the lifecycle to reduce defects and improve design
  • Mentor junior testers, encourage continuous learning, and contribute to a culture of innovation
  • Fulltime
Read More
Arrow Right

Principal Engineer, Test

The Principal Engineer, Performance Test is responsible for planning, designing,...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, Engineering
  • 12+ years of experience in performance testing role
  • Proven experience with performance testing tools such as JMeter, Loadrunner and Gatling
  • Experience in testing microservices and distributed systems
  • Strong knowledge of system architectures, microservices, and APIs (REST/gRPC)
  • Proficiency in scripting languages such as Python, Java, or JavaScript
  • Strong experience with monitoring tools (e.g., Prometheus, Grafana)
  • Hands-on experience with CI/CD tools and processes
  • Understanding of cloud platforms (e.g., AWS, Azure, Google Cloud) and containerization tools (e.g., Docker, Kubernetes)
Job Responsibility
Job Responsibility
  • Develop and implement performance testing strategies and frameworks for applications and systems, including microservices
  • Define performance test objectives, metrics, and key performance indicators (KPIs)
  • Design, create, and execute performance test cases, scenarios, and scripts using performance testing tools (e.g., JMeter, LoadRunner, Gatling)
  • Simulate user loads to analyze the platform behavior under peak conditions
  • Conduct performance testing for microservices, focusing on API latency, throughput, and reliability under different loads
  • Evaluate the scalability of individual microservices and their interactions under various conditions
  • Analyze and test the performance of microservices in distributed architectures
  • Ensure proper functioning of service discovery, load balancing, and communication protocols (e.g., REST, gRPC, WebSocket)
  • Evaluate the impact of dependencies and latency across microservices
  • Optimize resource usage, including CPU, memory, and I/O for microservices
What we offer
What we offer
  • Support for Parents
  • Continuing Education/ Professional Development
  • Employee Heath & Well-Being Benefits
  • Paid Time Off
  • 2 Days a Year to Volunteer
Read More
Arrow Right

Principal Test Engineer

Riverstone Enterprise Solutions, an Envision Innovative Solutions Company, deliv...
Location
Location
United States , Columbia
Salary
Salary:
145000.00 - 169000.00 USD / Year
rivsol.com Logo
Riverstone Enterprise Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Eight (8) years' experience as a Test Engineer in programs and contracts of similar scope type and complexity
  • Bachelor's degree in Math, Science, Engineering, Statistics, Engineering Management or related discipline from an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor's degree
  • Current/Active TS/SCI with Full Scope Polygraph
Job Responsibility
Job Responsibility
  • Analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results
  • Supports the development of Government test and evaluation documentation e.g., Test & Evaluation (T&E) Strategy, Test & Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and T&E Reports
  • Works with other test organizations to support T&E program integration
  • Review planned acquisition approaches to support T&E schedule alignment with decision maker needs for T&E support
  • Plan program and event level testing for collection of data required for analysis and to synch T&E events with supported decision points
  • Establish and employ Data & Configuration Management capabilities
  • Support Data Authentication group functions and comply with program Discrepancy Reporting criteria and processes
  • Assess operational and system performance requirements for testability and criticality to frame and prioritize T&E objectives and enable evaluation planning
  • Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions parameter selection and dependencies, Modeling and Simulation, and initial performance assessments
  • Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions· levels of T&E include inspection, demonstration paper analysis, survey simulation, and physical test
  • Fulltime
Read More
Arrow Right

Principal Engineer, Test

Principal Engineer – Test with 12+ year experience, will serve as a technical an...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ year experience
  • technical and project lead within Interoperability team in healthcare domain
  • driving test strategy, test planning, execution excellence, quality outcomes across complex software applications and integrated medical devices
  • lead and mentor test teams
  • collaborate cross‑functionally
  • remain hands‑on in testing
  • working knowledge of automation frameworks and emerging AI‑assisted testing tools
Job Responsibility
Job Responsibility
  • Own and drive manual test strategy for application‑device interoperability solutions in regulated healthcare environment
  • ensure end‑to‑end test coverage across workflows involving applications, medical devices, and third‑party integrations
  • lead test design, execution, defect triage, and release readiness activities
  • ensure adherence to quality standards, regulatory expectations, and audit requirements
  • lead and mentor a team of manual and hybrid test engineers
  • assign work effectively, manage priorities, and ensure on‑time delivery
  • partner closely with Systems Engineering, Product Management, Development, DevOps, and Clinical/Domain teams
  • participate actively in design reviews, requirements discussions, and risk assessments
  • remain hands‑on with manual testing of complex workflows
  • review and contribute to test cases, test plans, and test evidence
What we offer
What we offer
  • Support for Parents
  • Continuing Education/Professional Development
  • Employee Health & Well-Being Benefits
  • Paid Time Off
  • 2 Days a Year to Volunteer
  • Fulltime
Read More
Arrow Right

Principal Test Engineer

Riverstone Enterprise Solutions, an Envision Innovative Solutions Company, deliv...
Location
Location
United States , Annapolis Junction
Salary
Salary:
145000.00 - 169000.00 USD / Year
rivsol.com Logo
Riverstone Enterprise Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Eight (8) years' experience as a Test Engineer in programs and contracts of similar scope type and complexity
  • Bachelor's degree in Math, Science, Engineering, Statistics, Engineering Management or related discipline from an accredited college or university is required. Four (4) years of additional TE experience may be substituted for a bachelor's degree
  • Current/Active TS/SCI with Full Scope Polygraph
Job Responsibility
Job Responsibility
  • Analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results
  • Supports the development of Government test and evaluation documentation e.g., Test & Evaluation (T&E) Strategy, Test & Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and T&E Reports. Works with other test organizations to support T&E program integration
  • Review planned acquisition approaches to support T&E schedule alignment with decision maker needs for T&E support
  • Plan program and event level testing for collection of data required for analysis and to synch T&E events with supported decision points
  • Establish and employ Data & Configuration Management capabilities
  • Support Data Authentication group functions and comply with program Discrepancy Reporting criteria and processes
  • Assess operational and system performance requirements for testability and criticality to frame and prioritize T&E objectives and enable evaluation planning
  • Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions parameter selection and dependencies, Modeling and Simulation, and initial performance assessments
  • Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions· levels of T&E include inspection, demonstration paper analysis, survey simulation, and physical test
  • Design surveys for evaluation of Subject Matter Expert (SE input and user as estimates of performance)
  • Fulltime
Read More
Arrow Right

Principal Engineer - Test Platform Services

Within our Tools and Automation organization, the Test Platform Services (TPS) t...
Location
Location
United States , Boston
Salary
Salary:
168000.00 - 247000.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional software engineering experience building and scaling distributed, cloud-native systems, with end-to-end ownership across the software lifecycle
  • Deep expertise in scalability, reliability, observability, and production-grade system architecture
  • Strong hands-on engineering capability and experience operating infrastructure in AWS (Kubernetes/EKS preferred)
  • Experience building and operating internal platforms or shared engineering systems used across multiple teams
  • Proven experience leading and developing engineers in a player/coach or technical leadership capacity
Job Responsibility
Job Responsibility
  • Establish and execute the long-term architectural vision for scalable validation platforms, including automation, performance, and resilience testing capabilities
  • Partner cross-functionally with Infrastructure, Backend, Firmware, Monitoring, and Product teams to align validation systems with product architecture, roadmaps, and business goals
  • Ensure virtual devices and simulation systems accurately reflect real-world hardware behavior, eliminating drift between physical and virtual environments
  • Build and operate validation platforms that are reliable, observable, cost-efficient, and trusted, with clear metrics to monitor platform health and validation effectiveness
  • Drive continuous performance, scalability, and resilience analysis, proactively identifying system bottlenecks and leveraging data-driven and AI-assisted approaches to improve validation and code quality
  • Grow and lead a high-performing TPS team, establishing engineering standards, embedding shift-left validation practices, and fostering a culture of ownership, accountability, and continuous improvement
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Fulltime
Read More
Arrow Right

Principal Engineer, Performance Test

At Baxter, we believe every person—regardless of who they are or where they are ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, Engineering
  • 12+ years of experience in performance testing role
  • Proven experience with performance testing tools such as JMeter, Loadrunner and Gatling
  • Experience in testing microservices and distributed systems
  • Strong knowledge of system architectures, microservices, and APIs (REST/gRPC)
  • Proficiency in scripting languages such as Python, Java, or JavaScript
  • Strong experience with monitoring tools (e.g., Prometheus, Grafana)
  • Hands-on experience with CI/CD tools and processes
  • Understanding of cloud platforms (e.g., AWS, Azure, Google Cloud) and containerization tools (e.g., Docker, Kubernetes)
Job Responsibility
Job Responsibility
  • Develop and implement performance testing strategies and frameworks for applications and systems, including microservices
  • Define performance test objectives, metrics, and key performance indicators (KPIs)
  • Design, create, and execute performance test cases, scenarios, and scripts using performance testing tools (e.g., JMeter, LoadRunner, Gatling)
  • Simulate user loads to analyze the platform behavior under peak conditions
  • Conduct performance testing for microservices, focusing on API latency, throughput, and reliability under different loads
  • Evaluate the scalability of individual microservices and their interactions under various conditions
  • Analyze and test the performance of microservices in distributed architectures
  • Ensure proper functioning of service discovery, load balancing, and communication protocols (e.g., REST, gRPC, WebSocket)
  • Evaluate the impact of dependencies and latency across microservices
  • Optimize resource usage, including CPU, memory, and I/O for microservices
What we offer
What we offer
  • Support for Parents
  • Continuing Education/Professional Development
  • Employee Heath & Well-Being Benefits
  • Paid Time Off
  • 2 Days a Year to Volunteer
  • Fulltime
Read More
Arrow Right

Principal Test Automation Engineer

Principal Test Automation Engineer. This role has been designed as ‘Hybrid’ with...
Location
Location
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent
  • Typically 10+ years experience in networking
  • Experience with internet protocols: TCP, UDP, IPv4/IPv6
  • Internet Protocols: TCP, UDP, IPv4/IPv6
  • Domain Knowledge: Cloud Provider/ Enterprise and Data Centre Technologies and AI/ML Data Center Network Technologies
  • Networking Protocols: BGP, OSPF/ISIS, ARP, VLANS, MPLS, L3VPN, MC-LAG, LACP, L2VPN, VPLS, Multicast, NGMVPN, EVPN-VXLAN, GRE, IPSec, NAT, HTTP, NetConf, etc.
  • Layer 2 technologies, Spanning Tree, LAG, MC-LAG, Virtual Chassis
  • CLOS Architecture, HA Design Concepts, EVPN
  • Test Knowledge: Prepare Test Plans, Test Execution, Understanding of Complex Customer Networks
  • Automation: Experience in automated test execution, ability to debug automation failures, and narrow down software issues from test results and logs. Knowledge in Python/Pytest/Go or any other scripting language
Job Responsibility
Job Responsibility
  • Responsible for driving Data Center and Enterprise Campus coverage, design and testing strategy
  • Design, develop, and implement Test topologies and test cases based on the Business needs of customers and reporting of end to end testing
  • Work closely with AI Infrastructure Test engineers to enhance solutions coverage and reduce Customer found defects in the field
  • Review of python automation for efficient test scenarios and future regression tests
  • The candidate must possess outstanding problem-solving skills in the diagnosis and resolution of customer issues
  • Work closely with cross-functional teams to develop and execute Multidimensional deployment scenario to measure SW quality and performance benchmarks
  • Analyze and root cause software issues identified during execution, closely working with respective stakeholders
  • Work with teams across geographical locations. Work collaboratively with cross functional teams, architects, and executives
  • Working closely with HPE Networking product development and architecture teams to understand product/feature requirements and solutions in alignment with customer business/network priorities
  • Build strong relationships with the senior leadership to understand the business objectives and translate into project deliverables
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
Read More
Arrow Right