CrawlJobs Logo

Principal Software Engineer in Test (Automation & AI)

United States, Santa Clara 147000.00 - 237500.00 USD / Year · Job Posted April 24, 2026
Apply Position
Job Link Share

Job Description

We're scaling the Prisma SASE Test team and seeking Test Engineers with an Automation-First Mindset leveraging AI. We are looking for strong technical leaders who take ownership of their areas of focus and who are driven to solve problems at every level, in innovative ways. Collaboration and teamwork are at the foundation of our culture and we need engineers who can communicate and work well with others towards achieving a common goal.

Job Responsibility

  • Great opportunity to work on AI assisted automation initiatives
  • AI-Assisted Automation Initiatives: Design and implement AI-powered test generation using LLMs to create test cases from requirements, API specs, and user stories
  • Build intelligent test selection systems that predict which tests to run based on code changes (ML-based test impact analysis)
  • Develop self-healing test frameworks that use AI to detect and adapt to UI/API changes automatically
  • Create anomaly detection pipelines to identify flaky tests and performance regressions without manual triage
  • Leverage AI agents to automate exploratory testing and generate edge-case scenarios
  • Core Test Engineering: Develop and execute sophisticated software tests and frameworks to validate Prisma SASE Functionality and Scale
  • Provide Thorough Technical Leadership in the areas of Cloud Based Orchestration, Cloud delivered Security, Cloud Networking and Automation Design
  • Participate in system design so that Quality Assurance is considered throughout the entire lifecycle of the Prisma Access Feature Development
  • Develop and/or Enhance Automated test Infrastructure to enable building Scalable & Flexible tests
  • Enhance Test strategies, Automation & Build infrastructure with feedback and analysis from real-world Customer deployments

Requirements

  • 8+ years of experience
  • Understanding of computer networks and protocols
  • Automation skills - Python - Backend , JavaScript, Playwright - Frontend
  • Strong Python
  • for backend validations with experience in building tools, frameworks and reporting
  • Experience with Playwright or similar browser automation
  • Built and led automation frameworks for a team
  • CI/CD pipeline experience (Jenkins, GitLab CI, GitHub Actions)
  • Understanding of Containers, Kubernetes and Orchestration
  • Cloud platforms: AWS, Azure, or GCP
  • Security protocols: SSH, IPsec, TCP/IP, DNS, TLS/SSL
  • Bachelor’s Degree OR Master's Degree in Computer Science/Engineering/Networking or equivalent experience required
  • Experience with LLM APIs (Claude, Gemini) for test generation or code analysis
  • Understanding of prompt engineering for automation workflows
  • Experience building AI agents or agentic workflows

Nice to have

  • Experience with LLM APIs (Claude, Gemini) for test generation or code analysis
  • Understanding of prompt engineering for automation workflows
  • Experience building AI agents or agentic workflows

What we offer

  • Restricted stock units
  • Bonus

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal Software Engineer in Test (Automation & AI)

8 matching positions

Principal Software Automation / Test Engineer

We are seeking an AI-savvy Principal QA Test Engineer to transform how we test a...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • M.S./B.S. degree in Computer Science, Electrical Engineering, or equivalent military experience required.
  • 10+ years of experience in QA/Test Automation Engineering with demonstrated impact on product quality and team practices.
  • 2+ years of hands-on experience with AI/ML technologies, including LLMs, prompt engineering, and AI-assisted development workflows.
  • Proven track record of building autonomous testing systems or AI-powered quality engineering tools.
  • Intermediate to Expert level experience with REST API driven automation using Python or Go.
  • Deep expertise in cybersecurity, cloud networking, or distributed systems test, including expert knowledge of TCP/IP, DNS, and SSL/TLS.
  • Experience with Identity Technologies such as Azure AD, Okta, or Ping Identity.
  • Experience with cloud providers (AWS, Azure, GCP) and cloud networking architectures (VPCs, subnets, security groups, NAT).
  • Experience with Windows/Linux/MAC Networking and Security Features.
  • Expertise in REST API testing, web UI automation (Selenium, Playwright, Puppeteer), and cloud-native application testing.
Job Responsibility
Job Responsibility
  • Design and implement autonomous QA workflows using AI agents and LLM-based frameworks to achieve continuous, intelligent test execution across multiple services.
  • Develop AI-augmented test infrastructure enabling scalable, context-aware testing that reflects real-world deployment scenarios.
  • Build AI-powered test generation systems that automatically create comprehensive test suites from requirements, specifications, and production telemetry.
  • Participate in system design to ensure quality, observability, and testability are built-in throughout the feature development lifecycle.
  • Provide technical leadership in browser security, cloud orchestration, distributed systems, and AI-assisted quality engineering across multi-team quality initiatives.
  • Mentor junior and mid-level engineers on AI/ML testing techniques, prompt engineering, and modern quality practices
  • lead adoption of new testing methodologies and measure impact.
  • Collaborate with Development, SRE, Product Management, and Technical Marketing to align quality strategy with business outcomes and establish quality standards.
  • Enhance test strategies, automation, and build infrastructure with feedback and analysis from real-world customer deployments.
  • Stay current with AI/ML advancements and translate them into practical testing innovations like agentic workflows, multimodal testing, and AI-powered observability.
What we offer
What we offer
  • restricted stock units
  • bonus
  • Fulltime
Read More
Arrow Right

Principal Software Automation Test Engineer

We are seeking an AI-savvy Principal QA Test Engineer to transform how we test a...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • M.S./B.S. degree in Computer Science, Electrical Engineering, or equivalent military experience required
  • 10+ years of experience in QA/Test Automation Engineering with demonstrated impact on product quality and team practices
  • 2+ years of hands-on experience with AI/ML technologies, including LLMs, prompt engineering, and AI-assisted development workflows
  • Proven track record of building autonomous testing systems or AI-powered quality engineering tools
  • Intermediate to Expert level experience with REST API driven automation using Python or Go
  • Deep expertise in cybersecurity, cloud networking, or distributed systems test, including expert knowledge of TCP/IP, DNS, and SSL/TLS
  • Experience with Identity Technologies such as Azure AD, Okta, or Ping Identity
  • Experience with cloud providers (AWS, Azure, GCP) and cloud networking architectures (VPCs, subnets, security groups, NAT)
  • Experience with Windows/Linux/MAC Networking and Security Features
  • Expertise in REST API testing, web UI automation (Selenium, Playwright, Puppeteer), and cloud-native application testing
Job Responsibility
Job Responsibility
  • Design and implement autonomous QA workflows using AI agents and LLM-based frameworks to achieve continuous, intelligent test execution across multiple services
  • Develop AI-augmented test infrastructure enabling scalable, context-aware testing that reflects real-world deployment scenarios
  • Build AI-powered test generation systems that automatically create comprehensive test suites from requirements, specifications, and production telemetry
  • Participate in system design to ensure quality, observability, and testability are built-in throughout the feature development lifecycle
  • Provide technical leadership in browser security, cloud orchestration, distributed systems, and AI-assisted quality engineering across multi-team quality initiatives
  • Mentor junior and mid-level engineers on AI/ML testing techniques, prompt engineering, and modern quality practices
  • lead adoption of new testing methodologies and measure impact
  • Collaborate with Development, SRE, Product Management, and Technical Marketing to align quality strategy with business outcomes and establish quality standards
  • Enhance test strategies, automation, and build infrastructure with feedback and analysis from real-world customer deployments
  • Stay current with AI/ML advancements and translate them into practical testing innovations like agentic workflows, multimodal testing, and AI-powered observability
  • Fulltime
Read More
Arrow Right

Principal Software Development Engineer in Test

Join our Cloud Management Platform group as a Senior Hands-on Development Engine...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in designing and implementing test automation methodologies, tools, and frameworks
  • Expert level experience with REST API driven Automation using Python
  • Hands-on experience with UI automation frameworks (Selenium, Cypress, Playwright etc)
  • Practical experience using AI-based tools to accelerate coding, test generation, debugging, and refactoring
  • A demonstrated passion for researching and applying innovative, AI-based testing methodologies to improve engineering productivity
  • Experience integrating automated tests into CI/CD pipelines (e.g., GitLab CI, Jenkins) and version control systems (Git)
  • Experience with cloud technologies (AWS,GCP) and containerized applications (Docker, Kubernetes)
  • Experience with TCP/IP Networking and Network Security is highly desirable
  • Knowledge of Active Directories, Cloud Identity providers is highly desirable
  • BS or MS in Computer Engineering or a related technical field
Job Responsibility
Job Responsibility
  • Work in a small ,fast paced team to solve important customer problems and deliver most impactful results
  • Be involved in a rigorous approach to testing for specifications, assist the team with testing methods or tools for testing
  • Suggest and implement improvements to the QA process
  • Work with cross functional development and quality assurances groups to achieve the best quality
  • Work with DevOps and the Technical Support teams to troubleshoot customer issues
  • Interview, mentor and coach new team members
  • Fulltime
Read More
Arrow Right

Principal Software Engineer- AI

Project Sophia is a new generation business application, built ground up from ma...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, implement, and ship AI-first product capabilities end-to-end from rapid prototype to production, spanning LLM-powered services, retrieval/grounding pipelines, and intelligent UX experiences
  • Shape and evolve full-stack architecture, integrating front-end experiences, back-end services, and AI orchestration layers
  • Collaborate with design, research, and platform teams to adapt or fine-tune LLMs/SLMs and multimodal models for real-world customer scenarios
  • Build agentic, tool-using, and multimodal workflows that reason across data and services
  • Drive engineering excellence, including secure-by-design principles, accessibility compliance, automated testing, and high-quality code craftsmanship
  • Define and apply evaluation frameworks for AI systems, using telemetry, experimentation, and continuous feedback loops
  • Drive live-site reliability and operational excellence, participating in On-Call rotations
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...
Location
Location
United States , San Francisco
Salary
Salary:
165000.00 - 220000.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 12+ years of professional software engineering/development experience
  • Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
  • Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
  • Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
Job Responsibility
Job Responsibility
  • Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust's AI Governance product
  • Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
  • Build features with RAG, agent workflows, and model orchestration
  • Own technical design for critical systems, ensuring scalability, security, and reliability
  • Maintain strong automated unit/integration test coverage and engineering standards
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team's discussions on system architecture and component design
  • Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
  • Lead architecture discussions and technical planning
  • Drive alignment across teams on platform design and priorities
  • Contribute to sprint planning and delivery
What we offer
What we offer
  • Comprehensive healthcare coverage
  • flexible PTO
  • equity RSUs
  • annual performance bonus opportunities
  • retirement account support
  • 14+ weeks of paid parental leave
  • career development opportunities
  • company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...
Location
Location
United States , Atlanta
Salary
Salary:
165000.00 - 220000.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 12+ years of professional software engineering/development experience
  • Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
  • Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
  • Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
Job Responsibility
Job Responsibility
  • Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust’s AI Governance product
  • Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
  • Build features with RAG, agent workflows, and model orchestration
  • Own technical design for critical systems, ensuring scalability, security, and reliability
  • Maintain strong automated unit/integration test coverage and engineering standards
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team’s discussions on system architecture and component design
  • Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
  • Lead architecture discussions and technical planning
  • Drive alignment across teams on platform design and priorities
  • Contribute to sprint planning and delivery
What we offer
What we offer
  • Comprehensive healthcare coverage
  • Flexible PTO
  • Equity RSUs
  • Annual performance bonus opportunities
  • Retirement account support
  • 14+ weeks of paid parental leave
  • Career development opportunities
  • Company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, AI Developer Tools

At Docker, we make app development easier so developers can focus on what matter...
Location
Location
United States , Seattle
Salary
Salary:
232000.00 - 319000.00 USD / Year
docker.com Logo
Docker
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years software engineering experience with 3+ years in Staff or Principal Engineer roles
  • Deep expertise in AI/ML technologies with hands-on production experience building LLM-powered applications, AI agents, or AI-assisted developer tools
  • Strong understanding of LLM APIs (OpenAI, Anthropic, etc.), prompt engineering, agent orchestration frameworks, and practical applications of AI in software development workflows
  • Proven track record of architecting and building highly scalable distributed systems and developer-facing platforms
  • Production experience with modern cloud-native infrastructure including Kubernetes, GitOps deployment patterns, observability systems, and CI/CD pipelines
  • Proficiency in Go (preferred), Rust, Java, or Python with strong software engineering fundamentals
  • Experience designing developer tools, platform engineering systems, or internal tools that enable other teams
  • Exceptional product and platform mindset considering business outcomes, developer experience, and technical trade-offs
  • Strong communication skills with ability to influence technical and non-technical stakeholders across the organization
  • Track record of technical mentorship and elevating engineering teams' capabilities
Job Responsibility
Job Responsibility
  • Define the long-term technical vision and architecture for AI-powered developer tools and the self-service platform that enables teams to build their own AI agents
  • Establish architectural patterns, technical standards, and best practices for LLM integration, AI agent development, and production AI systems serving developers
  • Lead technical strategy for platform capabilities including deployment frameworks (ArgoCD/GitOps), observability integration (Grafana), security controls, and operational tooling for AI developer tools
  • Design highly available, scalable infrastructure for hosting AI agents and developer tools with predictable performance and intelligent resource management
  • Drive technical decisions on AI technology choices, LLM provider strategies, prompt engineering approaches, and agent orchestration frameworks
  • Partner with Senior Manager and product leadership to align technical architecture with business objectives and productization opportunities
  • Architect and build production-ready AI agents for developer productivity including code review assistants, test generators, deployment diagnostics, and incident response automation
  • Design and implement the self-service platform infrastructure that reduces time-to-production for new AI tools from weeks to days
  • Build systems that accelerate adoption of AI-native development tools (Claude Code, Cursor, Warp) across Docker's engineering organization
  • Establish reliability, security, and performance standards for AI systems including SLOs, monitoring, incident response, and cost management
What we offer
What we offer
  • Freedom & flexibility
  • fit your work around your life
  • Designated quarterly Whaleness Days plus end of year Whaleness break
  • Home office setup
  • we want you comfortable while you work
  • 16 weeks of paid Parental leave
  • Technology stipend equivalent to $100 net/month
  • PTO plan that encourages you to take time to do the things you enjoy
  • Training stipend for conferences, courses and classes
  • Equity
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, AI Tools and Security

Docker’s AI Tools & Security team is building the foundation for the next genera...
Location
Location
United States , Seattle
Salary
Salary:
232000.00 - 319000.00 USD / Year
docker.com Logo
Docker
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of backend engineering experience, including extensive work on production-grade, distributed systems at scale
  • Technical leadership across multiple teams or domains, with a proven ability to drive architectural vision, set technical direction, and influence long-term product strategy
  • Exceptional product and platform mindset—you think beyond implementation details to how technology shapes developer and business outcomes
  • Expertise in designing and evolving large-scale, cloud-native systems, with deep knowledge of distributed computing, service-oriented architecture, and performance optimization
  • Demonstrated experience building secure, resilient, and high-throughput backend services, with a strong grasp of reliability engineering principles (SLOs, observability, incident response)
  • Fluency in Go (preferred) or another modern systems language (Rust, Java, C++, etc.), with the ability to lead technical design reviews and mentor others in language-specific best practices
  • Strong grasp of software engineering fundamentals—CI/CD, testing strategy, source control, and deployment automation—applied in complex, multi-service environments
  • Proven track record of technical mentorship and cross-functional collaboration, enabling teams to deliver high-impact, high-quality software efficiently
  • Deep experience with major cloud platforms (AWS, Azure, GCP) and infrastructure-as-code tooling
  • Ownership mentality with a bias for action and iterative delivery, balancing short-term impact with long-term architectural health
Job Responsibility
Job Responsibility
  • Define the technical solution for a new product
  • Help shape the product with peers in Product and Design
  • Mentor other technical team members
  • Be the technical point of contact for the team
What we offer
What we offer
  • Freedom & flexibility
  • fit your work around your life
  • Designated quarterly Whaleness Days plus end of year Whaleness break
  • Home office setup
  • we want you comfortable while you work
  • 16 weeks of paid Parental leave
  • Technology stipend equivalent to $100 net/month
  • PTO plan that encourages you to take time to do the things you enjoy
  • Training stipend for conferences, courses and classes
  • Equity
  • Fulltime
Read More
Arrow Right