CrawlJobs Logo

Principal Software Engineer in Test (Automation & AI)

paloaltonetworks.com Logo

Palo Alto Networks

Location Icon

Location:
United States , Santa Clara

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

147000.00 - 237500.00 USD / Year

Job Description:

We're scaling the Prisma SASE Test team and seeking Test Engineers with an Automation-First Mindset leveraging AI. We are looking for strong technical leaders who take ownership of their areas of focus and who are driven to solve problems at every level, in innovative ways. Collaboration and teamwork are at the foundation of our culture and we need engineers who can communicate and work well with others towards achieving a common goal.

Job Responsibility:

  • Great opportunity to work on AI assisted automation initiatives
  • AI-Assisted Automation Initiatives: Design and implement AI-powered test generation using LLMs to create test cases from requirements, API specs, and user stories
  • Build intelligent test selection systems that predict which tests to run based on code changes (ML-based test impact analysis)
  • Develop self-healing test frameworks that use AI to detect and adapt to UI/API changes automatically
  • Create anomaly detection pipelines to identify flaky tests and performance regressions without manual triage
  • Leverage AI agents to automate exploratory testing and generate edge-case scenarios
  • Core Test Engineering: Develop and execute sophisticated software tests and frameworks to validate Prisma SASE Functionality and Scale
  • Provide Thorough Technical Leadership in the areas of Cloud Based Orchestration, Cloud delivered Security, Cloud Networking and Automation Design
  • Participate in system design so that Quality Assurance is considered throughout the entire lifecycle of the Prisma Access Feature Development
  • Develop and/or Enhance Automated test Infrastructure to enable building Scalable & Flexible tests
  • Enhance Test strategies, Automation & Build infrastructure with feedback and analysis from real-world Customer deployments

Requirements:

  • 8+ years of experience
  • Understanding of computer networks and protocols
  • Automation skills - Python - Backend , JavaScript, Playwright - Frontend
  • Strong Python
  • for backend validations with experience in building tools, frameworks and reporting
  • Experience with Playwright or similar browser automation
  • Built and led automation frameworks for a team
  • CI/CD pipeline experience (Jenkins, GitLab CI, GitHub Actions)
  • Understanding of Containers, Kubernetes and Orchestration
  • Cloud platforms: AWS, Azure, or GCP
  • Security protocols: SSH, IPsec, TCP/IP, DNS, TLS/SSL
  • Bachelor’s Degree OR Master's Degree in Computer Science/Engineering/Networking or equivalent experience required
  • Experience with LLM APIs (Claude, Gemini) for test generation or code analysis
  • Understanding of prompt engineering for automation workflows
  • Experience building AI agents or agentic workflows

Nice to have:

  • Experience with LLM APIs (Claude, Gemini) for test generation or code analysis
  • Understanding of prompt engineering for automation workflows
  • Experience building AI agents or agentic workflows
What we offer:
  • Restricted stock units
  • Bonus

Additional Information:

Job Posted:
April 24, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:
PREMIUM
More languages and countries
+ Unlock 31633 hidden job offers
Languages
English Čeština Deutsch Ελληνικά Español Français +15
Countries
United States United Kingdom India Canada Australia +
See plans
Plans from $2.99 / month

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal Software Engineer in Test (Automation & AI)

Principal QA Automation Engineer w/ AI experience

We seek a Principal QA Automation Engineer with a strong background in Cypress, ...
Location
Location
Argentina , Gran Buenos Aires; Capital Federal; Mar del Plata
Salary
Salary:
Not provided
basicagency.com Logo
BASIC/DEPT®
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands-on experience with Cypress for UI and end-to-end automation testing
  • Expert-level proficiency in TypeScript, JavaScript and Python
  • Proven experience testing AI-powered or machine learning applications, including AI model validation techniques
  • Strong understanding of AWS services (e.g., Lambda, S3, SQS, CloudWatch, ECS/EKS) and how to validate applications deployed in cloud environments
  • Experience with threaded/multi-agent AI tools and how they impact test design and validation
  • Familiarity with version control (Git), containerization (Docker), and CI/CD pipelines (e.g., GitHub Actions, Jenkins, or CircleCI)
  • Strong communication, leadership, and mentoring skills
Job Responsibility
Job Responsibility
  • Lead the design and implementation of end-to-end test automation frameworks using Cypress with TypeScript
  • Define quality strategies for applications with AI/ML components, including deterministic and non-deterministic testing approaches
  • Collaborate with engineering, DevOps, and AI/ML teams to ensure quality across AI-infused features in production environments
  • Build and scale testing strategies for threaded AI applications running in AWS cloud infrastructure
  • Integrate automated tests into CI/CD pipelines to support frequent, reliable deployments
  • Mentor and guide mid- and senior-level QA engineers, setting best practices and driving a culture of quality-first development
  • Evaluate and introduce new tools, libraries, and frameworks to improve test coverage, performance, and developer experience
  • Participate in architectural discussions to ensure testability and reliability are baked into software designs from the start
  • Analyze test results, track quality metrics, and communicate risk and coverage to stakeholders
What we offer
What we offer
  • Premium healthcare through OSDE for the employee and their immediate family members
  • Mendel prepaid card with a monthly allowance for grocery purchases
  • Monthly reimbursements for Wi-Fi/electricity expenses
  • Monthly reimbursements for training/English classes
  • 100% covered “Plan Total” membership at Sportclub
  • Access to a our benefits platform through Bonda
  • A flexible vacation policy
  • Fulltime
Read More
Arrow Right

Principal Engineer

The Principal AI/ML Operations Engineer leads the architecture, automation, and ...
Location
Location
United States , Pleasanton, California
Salary
Salary:
251000.00 - 314500.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field
  • 10+ years in ML infrastructure, DevOps, and software system architecture
  • 4+ years in leading MLOps or AI Ops platforms
  • Strong programming skills in languages such as Python, Java, or Scala
  • Expertise in ML frameworks (TensorFlow, PyTorch, scikit-learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow)
  • Proven experience operating production pipelines for ML and LLM-based systems across cloud ecosystems (GCP, AWS, Azure)
  • Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management
  • Strong competencies in CI/CD, IaC, and DevSecOps pipelines integrating testing, compliance, and deployment automation
  • Hands-on with observability stacks (Prometheus, Grafana, Newrelic) for model and agent performance tracking
  • Understanding of governance frameworks for Responsible AI, auditability, and cost metering across training and inference workloads
Job Responsibility
Job Responsibility
  • Define enterprise-level standards and reference architectures for ML-Ops and AIOps systems
  • Partner with data science, security, and product teams to set evaluation and governance standards (Guardrails, Bias, Drift, Latency SLAs)
  • Mentor senior engineers and drive design reviews for ML pipelines, model registries, and agentic runtime environments
  • Lead incident response and reliability strategies for ML/AI systems
  • Lead the deployment of AI models and systems in various environments
  • Collaborate with development teams to integrate AI solutions into existing workflows and applications
  • Ensure seamless integration with different platforms and technologies
  • Define and manage MCP Registry for agentic component onboarding, lifecycle versioning, and dependency governance
  • Build CI/CD pipelines automating LLM agent deployment, policy validation, and prompt evaluation of workflows
  • Develop and operationalize experimentation frameworks for agent evaluations, scenario regression, and performance analytics
What we offer
What we offer
  • short-term and long-term incentive programs
  • robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

PointClickCare is searching for a Principal Data Engineer who will contribute to...
Location
Location
United States
Salary
Salary:
183200.00 - 203500.00 USD / Year
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Principal Data Engineer with at least 10 years of professional experience in software or data engineering, including a minimum of 4 years focused on streaming and real-time data systems
  • Proven experience driving technical direction and mentoring engineers while delivering complex, high-scale solutions as a hands-on contributor
  • Deep expertise in streaming and real-time data technologies, including frameworks such as Apache Kafka, Flink, and Spark Streaming
  • Strong understanding of event-driven architectures and distributed systems, with hands-on experience implementing resilient, low-latency pipelines
  • Practical experience with cloud platforms (AWS, Azure, or GCP) and containerized deployments for data workloads
  • Fluency in data quality practices and CI/CD integration, including schema management, automated testing, and validation frameworks (e.g., dbt, Great Expectations)
  • Operational excellence in observability, with experience implementing metrics, logging, tracing, and alerting for data pipelines using modern tools
  • Solid foundation in data governance and performance optimization, ensuring reliability and scalability across batch and streaming environments
  • Experience with Lakehouse architectures and related technologies, including Databricks, Azure ADLS Gen2, and Apache Hudi
  • Strong collaboration and communication skills, with the ability to influence stakeholders and evangelize modern data practices within your team and across the organization
Job Responsibility
Job Responsibility
  • Lead and guide the design and implementation of scalable streaming data pipelines
  • Engineer and optimize real-time data solutions using frameworks like Apache Kafka, Flink, Spark Streaming
  • Collaborate cross-functionally with product, analytics, and AI teams to ensure data is a strategic asset
  • Advance ongoing modernization efforts, deepening adoption of event-driven architectures and cloud-native technologies
  • Drive adoption of best practices in data governance, observability, and performance tuning for streaming workloads
  • Embed data quality in processing pipelines by defining schema contracts, implementing transformation tests and data assertions, enforcing backward-compatible schema evolution, and automating checks for freshness, completeness, and accuracy across batch and streaming paths before production deployment
  • Establish robust observability for data pipelines by implementing metrics, logging, and distributed tracing for streaming jobs, defining SLAs and SLOs for latency and throughput, and integrating alerting and dashboards to enable proactive monitoring and rapid incident response
  • Foster a culture of quality through peer reviews, providing constructive feedback and seeking input on your own work
What we offer
What we offer
  • Benefits starting from Day 1!
  • Retirement Plan Matching
  • Flexible Paid Time Off
  • Wellness Support Programs and Resources
  • Parental & Caregiver Leaves
  • Fertility & Adoption Support
  • Continuous Development Support Program
  • Employee Assistance Program
  • Allyship and Inclusion Communities
  • Employee Recognition … and more!
  • Fulltime
Read More
Arrow Right

Principal Architect – GenAI & Enterprise Automation

Designs, develops, troubleshoots and debugs software programs for software enhan...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent
  • Typically 10+ years' experience
  • Experience designing and developing software systems design tools and languages
  • Experience in overall architecture of software systems for products and solutions
  • Designing and integrating software systems running on multiple platform types into overall architecture
  • Evaluating and selecting forms and processes for software systems testing and methodology
  • History of innovation with multiple patents or deployed solutions in the field of software design
  • Excellent written and verbal communication skills
  • mastery in English and local language
  • Deep expertise in Copilot, Azure OpenAI, Power Platform, and LLMs
Job Responsibility
Job Responsibility
  • Develops organization-wide architectures and methodologies for software systems design and development
  • Identifies and evaluates new technologies, innovations, and outsourced development partner relationships
  • Reviews and evaluates designs and project activities for compliance with development guidelines and standards
  • Provides guidance and mentoring to less-experienced staff members
  • Integrate with organizational data and workflows for Copilot
  • Establish Prompt Engineering Frameworks with Copilot
  • Enable custom Copilots with internal knowledge, fine-tuned LLMs, and responsible usage practices
  • Enable Agentic Automation with Federated Governance model
  • Lead scalable automation through reusable components, design principles, and CoE enablement
  • Create accelerators, secure connectors, and templates to maximize reuse
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

Principal Software Automation Test Engineer

We are seeking an AI-savvy Principal QA Test Engineer to transform how we test a...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • M.S./B.S. degree in Computer Science, Electrical Engineering, or equivalent military experience required
  • 10+ years of experience in QA/Test Automation Engineering with demonstrated impact on product quality and team practices
  • 2+ years of hands-on experience with AI/ML technologies, including LLMs, prompt engineering, and AI-assisted development workflows
  • Proven track record of building autonomous testing systems or AI-powered quality engineering tools
  • Intermediate to Expert level experience with REST API driven automation using Python or Go
  • Deep expertise in cybersecurity, cloud networking, or distributed systems test, including expert knowledge of TCP/IP, DNS, and SSL/TLS
  • Experience with Identity Technologies such as Azure AD, Okta, or Ping Identity
  • Experience with cloud providers (AWS, Azure, GCP) and cloud networking architectures (VPCs, subnets, security groups, NAT)
  • Experience with Windows/Linux/MAC Networking and Security Features
  • Expertise in REST API testing, web UI automation (Selenium, Playwright, Puppeteer), and cloud-native application testing
Job Responsibility
Job Responsibility
  • Design and implement autonomous QA workflows using AI agents and LLM-based frameworks to achieve continuous, intelligent test execution across multiple services
  • Develop AI-augmented test infrastructure enabling scalable, context-aware testing that reflects real-world deployment scenarios
  • Build AI-powered test generation systems that automatically create comprehensive test suites from requirements, specifications, and production telemetry
  • Participate in system design to ensure quality, observability, and testability are built-in throughout the feature development lifecycle
  • Provide technical leadership in browser security, cloud orchestration, distributed systems, and AI-assisted quality engineering across multi-team quality initiatives
  • Mentor junior and mid-level engineers on AI/ML testing techniques, prompt engineering, and modern quality practices
  • lead adoption of new testing methodologies and measure impact
  • Collaborate with Development, SRE, Product Management, and Technical Marketing to align quality strategy with business outcomes and establish quality standards
  • Enhance test strategies, automation, and build infrastructure with feedback and analysis from real-world customer deployments
  • Stay current with AI/ML advancements and translate them into practical testing innovations like agentic workflows, multimodal testing, and AI-powered observability
  • Fulltime
Read More
Arrow Right

Principal Software Automation / Test Engineer

We are seeking an AI-savvy Principal QA Test Engineer to transform how we test a...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • M.S./B.S. degree in Computer Science, Electrical Engineering, or equivalent military experience required.
  • 10+ years of experience in QA/Test Automation Engineering with demonstrated impact on product quality and team practices.
  • 2+ years of hands-on experience with AI/ML technologies, including LLMs, prompt engineering, and AI-assisted development workflows.
  • Proven track record of building autonomous testing systems or AI-powered quality engineering tools.
  • Intermediate to Expert level experience with REST API driven automation using Python or Go.
  • Deep expertise in cybersecurity, cloud networking, or distributed systems test, including expert knowledge of TCP/IP, DNS, and SSL/TLS.
  • Experience with Identity Technologies such as Azure AD, Okta, or Ping Identity.
  • Experience with cloud providers (AWS, Azure, GCP) and cloud networking architectures (VPCs, subnets, security groups, NAT).
  • Experience with Windows/Linux/MAC Networking and Security Features.
  • Expertise in REST API testing, web UI automation (Selenium, Playwright, Puppeteer), and cloud-native application testing.
Job Responsibility
Job Responsibility
  • Design and implement autonomous QA workflows using AI agents and LLM-based frameworks to achieve continuous, intelligent test execution across multiple services.
  • Develop AI-augmented test infrastructure enabling scalable, context-aware testing that reflects real-world deployment scenarios.
  • Build AI-powered test generation systems that automatically create comprehensive test suites from requirements, specifications, and production telemetry.
  • Participate in system design to ensure quality, observability, and testability are built-in throughout the feature development lifecycle.
  • Provide technical leadership in browser security, cloud orchestration, distributed systems, and AI-assisted quality engineering across multi-team quality initiatives.
  • Mentor junior and mid-level engineers on AI/ML testing techniques, prompt engineering, and modern quality practices
  • lead adoption of new testing methodologies and measure impact.
  • Collaborate with Development, SRE, Product Management, and Technical Marketing to align quality strategy with business outcomes and establish quality standards.
  • Enhance test strategies, automation, and build infrastructure with feedback and analysis from real-world customer deployments.
  • Stay current with AI/ML advancements and translate them into practical testing innovations like agentic workflows, multimodal testing, and AI-powered observability.
What we offer
What we offer
  • restricted stock units
  • bonus
  • Fulltime
Read More
Arrow Right
New

Principal Engineer, Test

Principal Engineer – Test with 12+ year experience, will serve as a technical an...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ year experience
  • technical and project lead within Interoperability team in healthcare domain
  • driving test strategy, test planning, execution excellence, quality outcomes across complex software applications and integrated medical devices
  • lead and mentor test teams
  • collaborate cross‑functionally
  • remain hands‑on in testing
  • working knowledge of automation frameworks and emerging AI‑assisted testing tools
Job Responsibility
Job Responsibility
  • Own and drive manual test strategy for application‑device interoperability solutions in regulated healthcare environment
  • ensure end‑to‑end test coverage across workflows involving applications, medical devices, and third‑party integrations
  • lead test design, execution, defect triage, and release readiness activities
  • ensure adherence to quality standards, regulatory expectations, and audit requirements
  • lead and mentor a team of manual and hybrid test engineers
  • assign work effectively, manage priorities, and ensure on‑time delivery
  • partner closely with Systems Engineering, Product Management, Development, DevOps, and Clinical/Domain teams
  • participate actively in design reviews, requirements discussions, and risk assessments
  • remain hands‑on with manual testing of complex workflows
  • review and contribute to test cases, test plans, and test evidence
What we offer
What we offer
  • Support for Parents
  • Continuing Education/Professional Development
  • Employee Health & Well-Being Benefits
  • Paid Time Off
  • 2 Days a Year to Volunteer
  • Fulltime
Read More
Arrow Right

Principal Eng, Test

We are seeking a Principal Automation Engineer / Test Architect with 12+ years o...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.baxter.com/ Logo
Baxter
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in test automation, quality engineering, or test architecture
  • Expert proficiency in C# automation development
  • Strong experience with BDD frameworks (SpecFlow or equivalent)
  • Hands‑on experience with Appium (Android & iOS)
  • Proven expertise in API and backend testing
  • Experience with MongoDB, PostgreSQL, and MySQL
  • Strong experience integrating automation into CI/CD pipelines
  • Solid understanding of Kubernetes and cloud‑native architectures
  • Deep knowledge of automation design patterns and best practices
  • Experience mentoring senior engineers and influencing technical direction
Job Responsibility
Job Responsibility
  • Define and own the end‑to‑end test automation architecture across mobile applications, web platforms, and backend services
  • Design, develop, and evolve native C# automation frameworks with a focus on scalability, reliability, and long‑term maintainability
  • Establish and scale BDD‑based automation frameworks using SpecFlow (or equivalent), ensuring alignment between business requirements and automated validation
  • Apply proven automation and software design patterns to build modular, extensible automation solutions
  • Define automation standards, coding guidelines, and best practices across teams
  • Lead adoption and maturity of Behavior‑Driven Development (BDD) practices
  • Collaborate with product and engineering teams to define clear, testable acceptance criteria
  • Ensure feature files remain readable, meaningful, and aligned with business intent
  • Maintain a strong hands‑on presence across the testing lifecycle: requirements analysis, test strategy, automation development, execution, and reporting
  • Drive automation across UI, API, and integration layers with clear ownership of coverage and quality signals
What we offer
What we offer
  • Support for Parents
  • Continuing Education/ Professional Development
  • Employee Heath & Well-Being Benefits
  • Paid Time Off
  • 2 Days a Year to Volunteer
  • Fulltime
Read More
Arrow Right