CrawlJobs Logo

AI Software Test Engineer

United States, Dahlgren · Job Posted May 03, 2026
Apply Position
Job Link Share

Job Description

Arcfield is seeking an AI Software Test Engineer to support in Dahlgren, VA in a hybrid capacity. The Program: The AI Software Test Engineer will be part of a team of experts charged with providing support in the areas of cyber analysis and cyber development capabilities in response to Navy's and DoD's needs for Cyber Situational Awareness (SA), Cyber Command and Control (C2), Mission Assurance, and Homeland Defense. Program scope includes identifying cyber key terrain by analyzing operational requirements, conducting cyber analyses and assessments, and developing and performing modeling and simulation in support of different cyber threat scenarios. The team will conduct cyber analyses and assessments to identify potential vulnerabilities and risks, determine mission and operational impacts, and make appropriate mitigation recommendations. Additionally, program support includes developing methodology and framework in support of cyber risk assessment life cycle. Our team will provide capabilities to support the customer with rapid design, development, test, deployment, maintenance and operation of specific software and hardware capabilities to meet current Cyber Defensive needs.

Job Responsibility

  • Support in Dahlgren, VA in a hybrid capacity
  • Provide support in the areas of cyber analysis and cyber development capabilities in response to Navy's and DoD's needs for Cyber Situational Awareness (SA), Cyber Command and Control (C2), Mission Assurance, and Homeland Defense
  • Identify cyber key terrain by analyzing operational requirements, conducting cyber analyses and assessments, and developing and performing modeling and simulation in support of different cyber threat scenarios
  • Conduct cyber analyses and assessments to identify potential vulnerabilities and risks, determine mission and operational impacts, and make appropriate mitigation recommendations
  • Develop methodology and framework in support of cyber risk assessment life cycle
  • Provide capabilities to support the customer with rapid design, development, test, deployment, maintenance and operation of specific software and hardware capabilities to meet current Cyber Defensive needs

Requirements

  • Must have an active Secret clearance and the ability to obtain and maintain a TS/SCI Clearance
  • Three (3) years direct experience in designing and implementing quality control standards for tactical software testing of Navy or Joint Programs
  • Experience testing application capabilities that leverage AI
  • Specifically, testing in a manner that is not hard coded to the same inputs yielding the same outputs
  • Experience with non-deterministic testing such as: Mutation testing, Performance testing, Acceptance testing, Range, threshold, and objective testing
  • Experience with Python programming language is a plus
  • Experience with system testing metrics, best practices, and methodologies
  • Experience working with software development teams
  • Experience participating in requirements and design reviews, developing test plans, writing and executing test cases in a fast-paced software development environment
  • Experience conducting data analysis, data verification and problem-solving
  • Experience with statistical reporting and analysis
  • Bachelor's Degree or equivalent years of experience
  • BS 2-4 Years, MS 0-2

Nice to have

  • Experience working on custom development software projects
  • Experience working with DoD customers
  • Experience working on cybersecurity projects

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

AI Software Test Engineer

8 matching positions

Software Engineer II and Sr. Software Engineer - AI Frameworks

The AI Frameworks team at Microsoft develops software that pushes the cutting ed...
Location
Location
United States , Mountain View
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, or related technical discipline AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, implement, and test a function or component for our AI/ML frameworks and tools
  • Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
  • Interacting and collaborating with our partners both internal and external
  • Interacting with and providing tech support for our customers/users
  • Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

Senior Staff Software AI Test Engineer- Prisma SASE

We are seeking Test Engineers with a strong Automation First Mindset as we scale...
Location
Location
United States , Santa Clara
Salary
Salary:
126000.00 - 204500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Automation skills - Python, Playwright
  • Experience with building automation frameworks and leading the automation effort for the team
  • Working Knowledge of CI/CD pipelines
  • Experience with Cloud Technologies such Aws/Azure/GCP
  • Knowledge of common security related protocols and their design (i.e. SSH, IPsec,TCP/IP, DNS, TLS, SSL etc.)
  • Demonstrated ability to learn quickly and to work in a fast paced, innovative environment learning new technologies and multi-tasking
  • 8+ years of experience
  • Bachelor’s Degree OR Master in Computer Science/Engineering/Networking or equivalent military experience required
Job Responsibility
Job Responsibility
  • Develop and execute sophisticated software tests and frameworks to validate Prisma SASE Functionality and Scale, working closely with Development, Product Management, SRE and Technical Marketing teams
  • Provide Thorough Technical Leadership in the areas of Cloud Based Orchestration, Cloud delivered Security, Cloud Networking and Automation Design
  • Participate in system design so that Quality Assurance is considered throughout the entire lifecycle of the Prisma Access Feature Development
  • Develop and/or Enhance Automated test Infrastructure to enable building Scalable & Flexible tests that reflect real world network deployment scenarios
  • Enhance Test strategies, Automation & Build infrastructure with feedback and analysis from real-world Customer deployments
  • Fulltime
Read More
Arrow Right

Software Engineer in Test (AI focus)

Roku is changing how the world watches TV. Roku is the #1 TV streaming platform ...
Location
Location
United Kingdom , Cambridge
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of hands-on experience with automation systems
  • 3+ years of Python programming experience
  • 2+ years of experience developing test plans and test cases
  • Ability to write simple Python scripts to preprocess data or interact with ML APIs
  • Bachelor's degree in Computer Science or related
  • Excellent verbal and written communication skills
  • Experience working with remote teams
  • Some knowledge of continuous integration tools (Jenkins/Hudson, TeamCity, Maven, Gradle)
  • Hands on experience and proficiency in Linux/Unix systems
  • Ability to learn new technologies quickly
Job Responsibility
Job Responsibility
  • Contribute to tools and technology
  • Design, develop, and maintain AI-driven automation systems
  • Collaborate with data scientists, software engineers, and product teams to understand and deliver AI-based solutions
  • Build new tools and technology
  • Debug failing tests to improve the quality of automated test tools and frameworks
  • Conduct code reviews for improve code quality and optimization
  • Promote coding conventions and standards for code re-usability and cleanliness
  • Assist in monitoring and maintenance of critical systems
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • healthcare (medical, dental, and vision)
  • life
  • accident
  • disability
  • commuter
  • retirement options (401(k)/pension)
  • Fulltime
Read More
Arrow Right

Principal Software Engineer in Test (Automation & AI)

We're scaling the Prisma SASE Test team and seeking Test Engineers with an Autom...
Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience
  • Understanding of computer networks and protocols
  • Automation skills - Python - Backend , JavaScript, Playwright - Frontend
  • Strong Python
  • for backend validations with experience in building tools, frameworks and reporting
  • Experience with Playwright or similar browser automation
  • Built and led automation frameworks for a team
  • CI/CD pipeline experience (Jenkins, GitLab CI, GitHub Actions)
  • Understanding of Containers, Kubernetes and Orchestration
  • Cloud platforms: AWS, Azure, or GCP
Job Responsibility
Job Responsibility
  • Great opportunity to work on AI assisted automation initiatives
  • AI-Assisted Automation Initiatives: Design and implement AI-powered test generation using LLMs to create test cases from requirements, API specs, and user stories
  • Build intelligent test selection systems that predict which tests to run based on code changes (ML-based test impact analysis)
  • Develop self-healing test frameworks that use AI to detect and adapt to UI/API changes automatically
  • Create anomaly detection pipelines to identify flaky tests and performance regressions without manual triage
  • Leverage AI agents to automate exploratory testing and generate edge-case scenarios
  • Core Test Engineering: Develop and execute sophisticated software tests and frameworks to validate Prisma SASE Functionality and Scale
  • Provide Thorough Technical Leadership in the areas of Cloud Based Orchestration, Cloud delivered Security, Cloud Networking and Automation Design
  • Participate in system design so that Quality Assurance is considered throughout the entire lifecycle of the Prisma Access Feature Development
  • Develop and/or Enhance Automated test Infrastructure to enable building Scalable & Flexible tests
What we offer
What we offer
  • Restricted stock units
  • Bonus
  • Fulltime
Read More
Arrow Right

Senior Software Development Engineer in Test (SDET) - AI Cluster Networking and Security

In AI infrastructure organization, simplifying large hardware deployments with p...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
cerebras.net Logo
Cerebras Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in engineering in computer science, electrical, AI, data science of related field
  • 10+ years of experience in testing one of areas like enterprise software, distributed systems, datacenter hardware and software
  • Experience working in large enterprise or cloud networking infrastructure, high speed switches, routers, firewalls
  • Experience in qualifying networking vendor platforms like Juniper, Arista or Cisco and network test equipment like Ixia/Spirent
  • Experience in Datacenter technology like BGP, ECN, PFC
  • Experience testing networking security, compliance and firewalls
  • Strong coding skills in one of the programming languages like python, golang or C/C++
  • Strong debugging skills to debug issues in large distributed systems, hardware, and software. Experience with debugging tools like gdb, strace, networking monitors
  • Strong understanding of operating systems internals like memory management, file system working, security basics and performance
  • Strong understanding of datacenter layout, device performance characteristics like PCIe, networking and storage
Job Responsibility
Job Responsibility
  • Innovate and execute tests on cutting edge AI infrastructure
  • Define optimized test strategies and methodologies
  • Be a quick learner, adapt to new technologies
  • Build a strong understanding of how to break these large distributed systems challenge into smaller components that can be unit tested
  • Automate first approach - Aim for 100% automated tests to test all cluster features in areas of high availability, failure scenarios, performance, stress and security
  • Champion cluster security, reliability for uptime of 99.9999% and ease of use with observability
  • Test all components of AI cluster including but not limited to cluster software involving kubernetes, prometheus and grafana. Cluster hardware components like ML wafer scale accelerators, CPU runtime nodes, High speed swarmx interconnect, High speed data transfer of weights through memoryx interconnect
  • Qualify cluster networking solutions which consists of high-speed switches, routers and optics from various vendors
  • Qualify cluster security features including OS security, network security, cloud compliance user access and security certifications
What we offer
What we offer
  • Build a breakthrough AI platform beyond the constraints of the GPU
  • Publish and open source their cutting-edge AI research
  • Work on one of the fastest AI supercomputers in the world
  • Enjoy job stability with startup vitality
  • Our simple, non-corporate work culture that respects individual beliefs
Read More
Arrow Right

Senior Software Development Engineer in Test (SDET) - AI Cluster

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. ...
Location
Location
United States; Canada , Sunnyvale; Toronto
Salary
Salary:
Not provided
cerebras.net Logo
Cerebras Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in engineering in computer science, electrical, AI, data science or related field
  • 5+ years of experience in testing one of areas like enterprise software, distributed systems, datacenter hardware and software
  • Strong coding skills in one of the programming languages like python, golang and C/C++
  • Strong debugging skills to debug issues in large distributed systems, hardware, and software. Experience with debugging tools like pdb, gdb, strace and network monitors
  • Strong understanding of operating systems internals like memory management, file system working, security and performance
  • Strong understanding of datacenter layout, device performance characteristics like Servers, Memory, BIOS, PCIe, networking and storage
  • Experience with cloud technologies like AWS, kubernetes and dockers. Monitoring tools like grafana, prometheus is huge plus
Job Responsibility
Job Responsibility
  • Innovate and execute tests on cutting edge AI infrastructure
  • Define optimized test strategies and methodologies
  • Be a quick learner, adapt to new technologies
  • Build a strong understanding of how to break these large distributed systems challenge into smaller components that can be unit tested
  • Automate first approach - Aim for 100% automated tests to test all cluster features in areas of high availability, failure scenarios, performance, stress and security
  • Champion cluster security, reliability for uptime of 99.9999% and ease of use with observability
  • Test all components of AI cluster including but not limited to cluster software involving kubernetes, prometheus and grafana. Cluster hardware components like ML wafer scale accelerators, CPU runtime nodes, High speed swarmx interconnect, High speed data transfer of weights through memoryx interconnect
What we offer
What we offer
  • Build a breakthrough AI platform beyond the constraints of the GPU
  • Publish and open source their cutting-edge AI research
  • Work on one of the fastest AI supercomputers in the world
  • Enjoy job stability with startup vitality
  • Our simple, non-corporate work culture that respects individual beliefs
Read More
Arrow Right
New

Sr Staff AI Software Engineer (CORA AI)

Idira is looking for a Senior AI Software Engineer to join our Generative AI fou...
Location
Location
Israel , Petah Tikva
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree with 15 years of experience, or Master's degree with 12 years of experience, or PhD with 8 years of experience
  • Extensive experience in software engineering, with a focus on building and deploying production-grade systems
  • Proven experience with cloud platforms, particularly AWS services
  • Strong programming skills in languages such as Python
  • Hands-on experience with machine learning, deep learning, and Large Language Models (LLMs)
  • Experience with the full software development lifecycle (design, development, testing, deployment, maintenance)
Job Responsibility
Job Responsibility
  • Design, develop, and deploy scalable AI agents and shared infrastructure for GenAI capabilities
  • Manage the full software development lifecycle, from prototyping to production-grade, observable systems
  • Collaborate with product managers, researchers, and engineers to translate ideas into robust and scalable services
  • Work hands-on with large language models (LLMs), agentic frameworks, and a broad range of AWS services
  • Implement strong telemetry, evaluation metrics, and feedback loops to continuously improve AI solutions
  • Champion operational excellence through pragmatic experimentation, iteration, and solid design
Read More
Arrow Right

Senior Software Development Engineer, AI Open-Source Software

AMD is looking for a principal software developer to join our growing team. As a...
Location
Location
United States , Santa Clara
Salary
Salary:
204000.00 - 306000.00 USD / Year
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years professional software development experience
  • Demonstrated capacity to technically lead and people manage junior to mid-level developers
  • Proficient in C/C++ & Python programming employing best software design practices
  • GPU software development or validation involving HIP, CUDA, or OpenCL
  • Experience with software libraries and API design
  • Exposure to Matrix/Tensor operations and numerical work
  • Software emulation to support FP numerical formats is a plus
  • Experience in software performance estimations, optimizations and debugging
  • Ability to closely interact with technical leads, developers, and test teams to maintain and release production software
Job Responsibility
Job Responsibility
  • Develop software in C++, Python, HIP, assembly, and SOTA programming technologies to enable key mathematical operations on GPU
  • Design GPU computational software libraries for AI, HPC applications
  • Aid management in planning, and delivering industry-leading software for current and future processors
  • Supervise small development team
  • Carry-out performance optimizations and projections for important use-cases to maximize hardware utilization
  • Support development of programs to sustain seamless performance analysis, and performance/functional test coverage
  • Identify and help resolve quality issues working closely with libraries development teams and other internal engineering teams
What we offer
What we offer
  • Benefits offered are described: AMD benefits at a glance
  • Fulltime
Read More
Arrow Right