CrawlJobs Logo

Lead AI Red Teaming & QA Engineer

https://www.randstad.com Logo

Randstad

Location Icon

Location:
United Kingdom , City of London

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

500.00 - 600.00 GBP / Day

Job Description:

We are seeking a Lead AI Red Teaming & QA Engineer to design and execute automated adversarial testing for our enterprise Agentic AI platforms. You will move beyond traditional software QA to build continuous safety pipelines, ensuring our non-deterministic LLM agents, RAG systems, and tool integrations are secure, resilient, and compliant before production release.

Job Responsibility:

  • Automated Adversarial Testing: Build and integrate automated red teaming suites into CI/CD pipelines using frameworks like Garak, Pyrit, and AgentDojo to enforce strict safety release gates
  • AI Evaluation Frameworks: Develop metrics and continuous testing for core AI risks, including hallucinations, memorisation, algorithmic bias, uncertainty, and model drift
  • Regulatory Compliance Evidence: Map threat models (OWASP LLM Top 10, Agentic threats) to automated test cases. Produce the technical testing evidence required by EU AI Act Article 15, DORA, and FCA Operational Resilience guidelines
  • Centralised AI-BOM Platform: Own the enterprise AI Bill of Materials (AI-BOM), tracking model lineages, dataset versions, and signed artifacts as a centralized evaluation service

Requirements:

  • Regulated Finance: Proven experience testing software within FCA, DORA, or EU AI Act frameworks
  • AWS Bedrock Ecosystem: Hands-on experience configuring, testing, and bypassing Bedrock Guardrails, Agents, and Knowledge Bases (RAG)
  • AI Security & Fundamentals: Solid understanding of Foundation Models, tool use (function calling), OWASP LLM Top 10, and NIST AI RMF
  • Automation Stack: Strong Python development skills, experience with AI eval tools (Garak, Pyrit, Ragas), and building complex CI/CD test pipelines

Additional Information:

Job Posted:
May 20, 2026

Expiration:
June 16, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:
PREMIUM
More languages and countries
+ Unlock 30718 hidden job offers
Languages
English Čeština Deutsch Ελληνικά Español Français +15
Countries
United States United Kingdom India Canada Australia +
See plans
Plans from $2.99 / month

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Lead AI Red Teaming & QA Engineer

Audit Director – AI Technology, Cyber, Data and GenAI Engineering

The Audit Director – AI Technology, Cyber, Data and GenAI Engineering is a senio...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience in a related role
  • Experience in cyber security, technical architecture, cloud services and integration patters related to AI and GenAI applications
  • In-depth understanding of technical architecture, system engineering with AI/GenAI focus
  • Preferably with audit experience, subject matter expert in AI Technology, Cyber, Data and GenAI Engineering
  • Related certifications such as Certified Information Systems (CISA), Certified Internal Auditor (CIA), Certified in Risk and Information Systems (CRISC) or similar
  • AI-related certifications are a plus
  • Executive presence and expert in building and maintaining strong open relationships with executive stakeholders
  • Ability to quickly comprehend the full risk implications of complex global issues
  • Outstanding performer, open minded, resilient, agile, energetic, self-starter, articulate and empathetic whilst being confident to deliver opinions
  • Strong leadership skills including a track record of identifying and developing world class talent
Job Responsibility
Job Responsibility
  • Develop the strategy and direct the execution of a portfolio of concurrent assurance activities relating to AI Technology, Cyber, Data and GenAI Engineering
  • Act as a trusted subject matter experts on AI Technology, Cyber, Data and GenAI Engineering in financial services across the IA team
  • Partner with IA Technology and Business Enablement team to scale AI assurance across IA work programs
  • Lead and support AI audit engagements, ensuring that AI/GenAI systems are assessed against good architectural practices, security and safety design
  • Assessing GenAI platforms and tooling including vector databases, storage, orchestration frameworks, and GenAI-related infrastructure
  • Assessing security and safety controls for AI, GenAI and agentic AI implementation
  • Assessing approaches for red-teaming, safety testing, alerting
  • Assessing suitability of testing, reviews and validation of AI, GenAI and agentic AI from infrastructure, cyber security point of view
  • Assessing internal and external integration, use of AI / GenAI based APIs, gateways from stability, security point of view
  • Assessing GenAI observability and monitoring focusing on telemetry specific to GenAI and agentic systems
What we offer
What we offer
  • Generous holiday allowance starting at 27 days plus bank holidays
  • increasing with tenure
  • A discretional annual performance related bonus
  • Private medical insurance packages to suit your personal circumstances
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Exclusive discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right
New

Customer Service Representative

We are looking for a Customer Service Representative to support members and call...
Location
Location
United States , Indianapolis
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Previous customer service or call center experience in a fast-paced environment
  • Strong verbal and written communication skills with the ability to interact professionally and empathetically
  • Ability to use multiple computer systems and applications efficiently while managing customer conversations
  • Solid data entry skills with close attention to accuracy and detail
  • Working knowledge of Microsoft Word and Microsoft Excel
  • Strong problem-solving skills and sound judgment when handling questions, concerns, and escalations
  • Reliable attendance, consistent punctuality, and flexibility to adjust to changing processes or priorities
Job Responsibility
Job Responsibility
  • Respond to inbound customer inquiries by phone and provide courteous, solution-focused support tailored to each situation
  • Record customer details, updates, and outcomes accurately in company systems to maintain complete and reliable documentation
  • Navigate multiple applications at once to research information, process requests, and deliver timely resolutions
  • Investigate service issues, identify practical next steps, and escalate more complex matters to the appropriate team when necessary
  • Communicate clearly and calmly during challenging interactions, using active listening and de-escalation skills to support positive outcomes
  • Follow established service procedures while adapting to updated tools, workflow changes, and shifting daily priorities
  • Partner with coworkers and leadership to share information, maintain service coverage, and support overall team performance
  • Maintain dependable attendance and punctuality to ensure consistent support during assigned shifts
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • free online training
  • Fulltime
Read More
Arrow Right
New

Sales Operations Analyst – Client Engagement

As a Sales Operations Analyst, you will join the Client Operations & Governance ...
Location
Location
Australia , Sydney
Salary
Salary:
38.99 - 39.99 AUD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
June 13, 2026
Flip Icon
Requirements
Requirements
  • A Tertiary qualification in a relevant field such as Business, Banking, IT, Finance, Commerce, or Accounting
  • savvy business acumen paired with strong analytical and data-mining skills
  • ability to manage multiple priorities and make things happen in a fast-paced, dynamic environment
  • confidence to engage and deal with various levels of leadership within the organisation
  • Proven experience in a similar commercial role, such as Sales Operations or Sales Administration
  • Strong proficiency in Excel and PowerPoint is preferred
  • Excellent verbal and written skills, with the demonstrated ability to communicate complex technical and business issues to a variety of stakeholders
  • Experience in the payments industry or an understanding of the four-party payments ecosystem is a significant plus
Job Responsibility
Job Responsibility
  • Develop accurate and consistent deal proposals and support Finance and Account Executives with incentive modeling and approval processes
  • Assist in the end-to-end contract process, including signing, sealing, and delivering partnership agreements
  • Monitor an assigned portfolio of Merchants and Acquirers to ensure all contractual obligations are met
  • Track and monitor compliance for end-to-end processes and assist with audit responsibilities
  • Act as a key enabler for the sales team by providing the guidance and support necessary to sign high-impact partnerships
  • Fulltime
Read More
Arrow Right
New

Pick Packer Team Member

About the Role: Are you a skilled and reliable Pick Packer looking for a stable,...
Location
Location
Australia , Caboolture
Salary
Salary:
Not provided
metcash.com Logo
Metcash
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Current Forklift Licence – essential
  • Previous experience in picking and packing, ideally within a warehouse, trade, or building supplies environment (highly regarded)
  • Strong attention to detail and ability to work in a fast-paced environment
  • Physically fit and capable of manual handling (including heavy lifting)
  • Confident working in active environments and following site safety requirements
  • A reliable, team-focused attitude with a proactive approach
Job Responsibility
Job Responsibility
  • Deliver exceptional customer service, representing Hardings Mitre 10 in a professional manner
  • Accurately pick, pack, and prepare orders for dispatch, ensuring correct quantities and product quality
  • Safely load and unload trucks, using forklifts and manual handling where required
  • Maintain a clean, safe, and organised warehouse, in line with WHS standards
  • Operate a forklift safely and efficiently
  • Fulltime
Read More
Arrow Right
New

Deals and Promotions Coordinator

This is a full-time permanent role responsible for ensuring the accuracy, consis...
Location
Location
Australia , Macquarie Park
Salary
Salary:
Not provided
metcash.com Logo
Metcash
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong Data Entry Skills
  • Excellent written and verbal communication skills
  • Strong critical thinking and analytical skills
  • Previous experience within a data/admin based role
  • Excellent attention to detail
Job Responsibility
Job Responsibility
  • Cultivate strong relationships with the internal ALM teams, serving as a reliable point of contact
  • Accurately input deal/ promotion information into Metcash core systems within agreed timelines
  • Regularly review and generate reports to assess the accuracy and completeness of pricing data
  • Take proactive steps to rectify any inconsistencies or inaccuracies, ensuring a high level of data integrity across all relevant systems
  • Address inquiries, issues, and concerns promptly and professionally, contributing to overall customer satisfaction
  • Keep relevant parties informed about deal/ promotions progress, potential challenges, and solutions in a proactive manner
What we offer
What we offer
  • 5th week of annual leave
  • 2 well-being days
  • 1 volunteer day annually
  • Endless learning and development opportunities
  • 12 weeks of gender-neutral paid leave for primary carers
  • Bronze Employer for LGBTQ Inclusion
  • Gender pay gap under 5%
  • Gold accreditation by Mental Health Australia
  • Flex Ready and Family Friendly Workplace accredited
  • Fulltime
Read More
Arrow Right
New

State Field Sales Manager

As the Field Sales Manager, you will be responsible for leading, coaching, and d...
Location
Location
Australia , South Fremantle
Salary
Salary:
Not provided
metcash.com Logo
Metcash
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3-5 years experience in sales, field management, or a related commercial role
  • Experience managing teams across a distributed geography
  • Strong leadership and people management skills with the ability to coach, inspire, and develop teams
  • Excellent communication, relationship-building, and negotiation capabilities
  • Competence in using sales and reporting tools (CRM, Power BI, Excel etc.)
  • Intermediate to advanced Excel desirable
  • FMCG, consumer goods, or foodservice industry experience (highly regarded)
Job Responsibility
Job Responsibility
  • Lead, motivate, and mentor a team of Business Development Representatives to achieve sales and execution targets
  • Conduct regular field coaching visits, providing actionable feedback to enhance capability and performance
  • Deliver state territory revenue budgets, new customer acquisition targets, and promotional execution objectives
  • Analyse sales performance, identify opportunities, and implement action plans to improve results
  • Build strong relationships with larger state customer groups, potential new customers, and regional operations teams
  • Act as the primary escalation point for store-level issues impacting service, stock, or execution
  • Manage field team scheduling, route optimisation, and territory coverage to maximise productivity
  • Oversee reporting accuracy, trade marketing execution, and competitor insights
What we offer
What we offer
  • 5th week of annual leave
  • 2 well-being days
  • 1 volunteer day annually
  • Endless learning and development opportunities
  • 12 weeks of gender-neutral paid leave for primary carers
  • Bronze Employer for LGBTQ Inclusion
  • Gender pay gap under 5% (WGEA 2024-2025)
  • Gold accreditation by Mental Health Australia
  • Flex Ready and Family Friendly Workplace accredited
Read More
Arrow Right
New

Crane Operator

Are you a skilled and reliable Crane Operator looking for a rewarding role with ...
Location
Location
Australia , Capalaba
Salary
Salary:
Not provided
metcash.com Logo
Metcash
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Valid driver's licence
  • Current HR Licence and Crane Operator Ticket – essential
  • Forklift Licence – essential
  • Strong communication and interpersonal skills
  • Physically fit and capable of manual handling (some heavy lifting required)
  • Confidence delivering to construction and building sites in surrounding areas
Job Responsibility
Job Responsibility
  • Safely operate our trucks and crane to deliver products to building sites across the surrounding areas
  • Provide exceptional customer service while representing Hardings Mitre 10 in a professional manner
  • Ensure deliveries are completed accurately and on time
  • Communicate effectively with the team to coordinate deliveries and address any issues promptly
  • Follow all safety procedures and operational guidelines
  • Fulltime
Read More
Arrow Right
New

Fresh Specialist - Delicatessen

We have a fantastic opportunity to join Metcash as a Fresh Specialist – Delicate...
Location
Location
Australia , Truganina
Salary
Salary:
Not provided
metcash.com Logo
Metcash
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Management-level experience in fresh departments (Deli, Bakery & Meat)
  • Strong understanding of food safety, compliance, and best practice across fresh categories
  • Ability to analyse data and provide strategic solutions to grow sales and profitability
  • Proven influencing skills and ability to build trust with retailers
  • Demonstrated success in meeting or exceeding sales targets
  • Knowledge of legislation and state regulations
  • Proficiency in Microsoft 365 applications
Job Responsibility
Job Responsibility
  • Provide expert knowledge and support for Deli, Bakery & Meat categories to store and department manager
  • Deliver fresh-specific business insights using sales and industry data to optimise performance
  • Ensure stores meet food safety standards and adopt best-practice methods
  • Partner with operations teams to implement fresh growth strategies
  • Support new store and department relays to maximise fresh sales and enhance customer experience
What we offer
What we offer
  • 5th week of annual leave
  • 2 well-being days
  • 1 volunteer day annually
  • Endless learning and development opportunities
  • 12 weeks of gender-neutral paid leave for primary carers
  • Bronze Employer for LGBTQ Inclusion
  • Gender pay gap under 5% (WGEA 2024–2025)
  • Gold accreditation by Mental Health Australia
  • Flex Ready and Family Friendly Workplace accredited
Read More
Arrow Right