CrawlJobs Logo

AI Governance & Test Engineer

https://www.citi.com/ Logo

Citi

Location Icon

Location:
United Kingdom , Belfast

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

The AI Governance and Test Engineer plays a critical role in ensuring the responsible and effective deployment of AI solutions. This position is central to upholding regulatory compliance, meticulously monitoring the performance and accuracy of AI models, and conducting rigorous performance testing to validate the reliability and efficiency of AI objects throughout their lifecycle. The successful candidate will bridge the gap between AI development, operational excellence, and robust governance frameworks.

Job Responsibility:

  • Proactively track and manage critical dates related to AI model lifecycles, including limitation expirations, policy decisions (PDs), and scheduled model updates
  • Prepare, review, and submit all necessary risk artifacts, ensuring strict adherence to internal policies and external regulatory requirements
  • Coordinate and facilitate review sessions with Model Risk Management (MRM) and other pertinent stakeholders to ensure AI models consistently meet established governance, risk, and compliance standards
  • Conduct in-depth data analysis of AI model usage patterns, performance metrics, and operational data to identify trends, anomalies, and areas for continuous improvement
  • Perform detailed manual Subject Matter Expert (SME) reviews of AI object outputs to rigorously assess and confirm their accuracy, relevance, and alignment with defined business objectives
  • Oversee and coordinate the implementation of updates to AI objects, aiming to minimize disruption while maximizing effectiveness and efficiency
  • Execute fine-tuning processes for AI objects to optimize their performance, accuracy, and responsiveness based on ongoing monitoring results, feedback loops, and evolving requirements
  • Design, develop, and execute comprehensive performance tests for AI objects to evaluate their scalability, responsiveness, stability, and resource utilization under various load or hyper-parameter conditions
  • Analyze detailed test results to pinpoint performance bottlenecks, potential failure points, and areas for optimization within AI systems
  • Collaborate closely with AI development teams to implement performance improvements, conduct re-testing, and ensure solutions meet or exceed established performance benchmarks and non-functional requirements

Requirements:

  • Proven experience in AI/Machine Learning model development, operations, or testing
  • Strong understanding of AI/ML lifecycle, concepts, and deployment challenges
  • Familiarity with risk management, governance, and compliance frameworks, preferably within a regulated industry
  • Proficiency in data analysis tools and techniques, with the ability to interpret complex datasets
  • Experience with performance testing methodologies and tools
  • Excellent analytical, problem-solving, and critical thinking skills
  • Strong communication, collaboration, and stakeholder management abilities
  • Ability to work independently and as part of a cross-functional team in a fast-paced environment
What we offer:
  • 27 days annual leave (plus bank holidays)
  • A discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources

Additional Information:

Job Posted:
January 18, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Citi - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for AI Governance & Test Engineer

Data Governance Engineer

The role focuses on deploying and managing enterprise-scale Data Governance prac...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of Data Governance and Data Engineering experience, with significant exposure to enabling Data availability, data discovery, quality & reliability, with appropriate security & access controls in enterprise-scale ecosystem
  • First level university degree
  • Experience working with Data governance & metadata management tools (Collibra, Databricks Unity Catalog, Atlan, etc.)
  • Subject matter expertise of consent management concepts and tools
  • Demonstrated knowledge of research methodology and the ability to manage complex data requests
  • Excellent analytical thinking, technical analysis, and data manipulation skills
  • Proven track record of development of SQL SSIS packages with ETL flow
  • Experience with AI application deployment governance a plus
  • Technologies such as MS SQL Server, Databricks, Hadoop, SAP S4/HANA
  • Experience with SQL databases and building SSIS packages
Job Responsibility
Job Responsibility
  • Drive the design and development of Data Dictionary, Lineage, Data Quality, Security & Access Control for Business-relevant data subjects & reports across business domains
  • Engage with the business users community to enable ease of Data Discovery and build trust in the data through Data Quality & Reliability monitoring with key metrics & SLAs defined
  • Supports the development and sustaining of Data subjects in the Database layer to enable BI dashboards and AI solutions
  • Drives the engagement and alignment with the HPE IT/CDO team on Governance initiatives, including partnering with functional teams across the business
  • Test, validate and assure the quality of complex AI-powered product features
  • Partner with a highly motivated and talented set of colleagues
  • Be a motivated, self-starter who can operate with minimal handholding
  • Collaborate across teams and time zones, demonstrating flexibility and accountability.
What we offer
What we offer
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Specific programs to help achieve career goals
  • Comprehensive inclusion and flexibility to manage work and personal needs.
  • Fulltime
Read More
Arrow Right

AI Governance Product Manager

Our customers are rapidly adopting AI and have turned to us to help them navigat...
Location
Location
Salary
Salary:
Not provided
modelop.com Logo
ModelOp
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, or related field
  • 3-5 years of software Product Management experience OR 3-5 years of experience from Big4 or large consultancy in designing and/or implementing governance systems
  • Recent experience using Agile/Scrum methodology to build enterprise-grade software
  • Is passionate for AI and using AI responsibly
  • Is an excellent communicator and very comfortable speaking to senior executives
  • Thrives under pressure in a fast-paced environment while juggling multiple “hats”
  • Is a self-starter, taking the initiative to proactively start tasks or address potential roadblocks
  • Is detail-oriented and excellent at project management
  • Has GRC experience, either in running a GRC program or managing a GRC product
  • Has experience working collaboratively with research institutions
Job Responsibility
Job Responsibility
  • Serve as the expert on AI regulations and AI Governance industry standards, both internally and externally
  • Work closely with our Customers to understand current usages and discuss future product needs
  • Define product requirements based on Customer feedback and based on regulations, including writing detailed product epics and stories, and identifying test scenarios for each story
  • As part of the agile process, provide day-to-day functional feedback on new product features to the engineering team
  • Work with the Engineering scrum masters to drive an efficient sprint process, including: product backlog grooming, sprint planning, and removing blockers
  • Work with the QA team to help design test strategy and scenarios for a given release, and assist with functional testing of new features
  • Develop product and delivery content to help our Customers understand the AI regulatory landscape, and how our product enables them to comply quickly and effectively with AI regulations and AI governance best practices
  • Assist with product documentation for new releases, including technical product documentation and product marketing materials (liaising with marketing teams)
  • Work closely with the Customer Success team to help new customers quickly use the product, aligning our capabilities with the Customer’s governance policies and procedures
  • Work with universities and research institutions to understand the latest AI governance frameworks, testing strategies, and other leading methodologies
  • Fulltime
Read More
Arrow Right

Sr. Technical AI Enablement Engineer

ModelOp is seeking a highly skilled Sr Technical AI Enablement Engineer to join ...
Location
Location
United States , Utah, Chicago
Salary
Salary:
Not provided
modelop.com Logo
ModelOp
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Software Engineering, or a related field
  • 10+ years of experience in technology-based consulting, technical enablement, or related roles
  • Experience in custom software delivery and complex system troubleshooting
  • Exceptional presentation skills for all audiences: from senior business executives to data scientists, architects, and governance teams
  • Proven ability to translate loose AI governance requirements into actionable implementation details across multiple workstreams
  • Experience with AI tools, platforms, and model development processes, along with a solid understanding of how governance and compliance mechanisms apply at each stage of the AI model lifecycle
  • Familiarity with AI regulations/guidelines (e.g. EU AI Act, OSFI E-23, NIST AI-RMF), ideally in specific verticals (e.g. SEC/OCC, FDA)
  • Strong experience in working with technical teams to embed governance processes into an existing model lifecycle
Job Responsibility
Job Responsibility
  • Implementation Planning: Lead customers in planning the implementation of ModelOp within the customer’s existing AI program
  • Technical Troubleshooting: When customer issues are raised, take lead on triaging the issue, and work with the customer technical team to obtain information (logs, etc.), conduct initial troubleshooting, and identify the next course of action
  • Process Design: Collaborate with customer teams to translate the customer’s AI governance policies and procedures into actionable and automated workflows within ModelOp, whilst simultaneously advising on best practices from other customers and experience
  • Inventory & Reporting Configuration: lead customers in designing the appropriate customizations for the metadata structure, use case forms, and dashboards within ModelOp to align with their inventory and reporting requirements
  • Testing & Monitoring Enablement: lead customer sessions in identifying and configuring the right set of tests and monitors for their specific AI use cases / models
  • Customer Enablement: Work closely with the customer to drive consumption of ModelOp software, by onboarding new AI use cases in the platform
  • Training & Support: Lead customer workshops, training sessions, and knowledge transfer activities to ensure customer teams understand and can effectively use ModelOp for their daily AI governance work
  • Documentation: Document processes, configurations, and troubleshooting steps for both technical and non-technical audiences
  • Learning: Stay updated on the latest developments in AI governance and related technologies to guide customers and inform product enhancements
What we offer
What we offer
  • ModelOp offers full benefits, including a retirement package and comprehensive health insurance
  • Fulltime
Read More
Arrow Right

AI Engineer for Storage Domain

Experienced AI Engineer role focused on storage domain, working with HPE's Hybri...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Information Systems, or equivalent
  • Typically 6 to 10 years' experience
  • Experience designing and developing software systems design tools and languages in storage/server/networking area
  • Two or more years of experience in applying AI to practical and comprehensive technology solutions
  • Experience with ML, deep learning, TensorFlow, Python, NLP
  • Experience in program leadership, governance, and change enablement
  • Knowledge of basic algorithms, object-oriented and functional design principles, and best-practice patterns
  • Experience in REST API development, NoSQL database design, and RDBMS design and optimizations
  • Experience with innovation accelerators
  • Cloud Architectures
Job Responsibility
Job Responsibility
  • Lead cross-functional teams in identifying and prioritizing key areas where AI solutions can drive significant business benefit
  • Design and develop solutions leveraging patterns in data and metadata stored in Petabytes of Objects and Files
  • Design, develop, and deploy hybrid RAG architectures integrating LLMs with retrieval-based systems
  • Work on functional design, process design, prototyping, testing, training, and defining support procedures
  • Translating technical AI findings into clear, business-oriented language for non-technical stakeholders
  • Implement and manage pipelines that combine retrieval mechanisms with generative capabilities
  • Develop custom plugins, adapters, or APIs to integrate retrieval systems with generative models
  • Fine-tune and optimize large language models
  • Monitor and troubleshoot issues within pipelines
  • Evaluate and benchmark performance of vector databases and solutions
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Fulltime
Read More
Arrow Right

Senior AI Product Engineer

As a one person team to start, you are both a product lead and the technical SME...
Location
Location
Australia , Melbourne
Salary
Salary:
Not provided
frankieone.com Logo
FrankieOne
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Recent experience in building AI applications with end to end ownership
  • 10 plus years experience in engineering teams in an Agile environment using JS based frameworks like React
  • 5 plus years developing & supporting Full Stack TS-based SaaS applications production in AWS/Cloud ecosystem
  • Experience in HTML5, ES6, CSS3/Sass, javascript, typescript, React, React Native for Web (optional), npm and other front-end technologies to deliver enterprise grade frontend applications
  • Experience in depth of back-end oriented technologies such as nodejs, typescript for managing BFF
  • Knowledge and experience in tracking technological developments especially AI with vendor offerings and ability to quickly evaluate their value proposition e.g AWS Bedrock
  • Experience in architecting & building enterprise grade AI applications with Data and AI governance, AI gateways, context management (RAG), inference/prompt management, tools/functions (MCP, A2A), memory & fine-tuning
  • Experience in capturing business requirements from stakeholders to documenting, architect and building AI applications for both internal and external users
  • Experience in designing web applications based on AWS well architectured principles, 12 factor web application principles, cloud based software architecture patterns (pub-sub, saga, circuit breaker etc)
  • Experience in designing reactjs based frontend and backend in nodejs or golang
Job Responsibility
Job Responsibility
  • Inspire others
  • Design with quality
  • Collaborate
  • Be proactive
  • Be an advocate for FrankieOne, for our product, and our values
Read More
Arrow Right

AI Machine Learning Principal Engineer

Our Regulatory Engineering team thrives on the challenge of operating in a compl...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
dell.com Logo
Dell
Expiration Date
March 31, 2026
Flip Icon
Requirements
Requirements
  • Requires 8+ years of related experience in a professional role with a Bachelor’s degree
  • or 6+ years with a Master’s degree
  • or 3+ years with a PhD
  • or equivalent experience
  • Knowledge on product compliance, Safety, EMC, Wireless, Telecom and Environmental (e.g. Energy, Material, ECO Labels, Accessibility, Repairability, Packaging and etc.) legislation programs will be plus
  • Track record of being an enthusiastic and effective team player with experience leading and influencing internal and external stakeholders to ensure successful outcomes
Job Responsibility
Job Responsibility
  • Apply knowledge of AI machine learning, statistics, optimization, software engineering and data engineering to produce code for testing, operationalizing and governing software-integrated machine learning models
  • Works with stakeholders including business owners, software engineers, data scientists and data engineers to align and execute end-to-end solutions which start with data collection and management, extend through machine learning methodologies and efficiencies in software engineering, and end with governance of machine learning model performance
  • Optimizes code for existing data streams, machine learning models and APIs using best practices in software engineering and experimental design
  • Defines best practices for AI ML engineering, code optimization, model and system validation and model governance and educates prospects and customers on analytics and machine learning offerings
  • Leads the design and testing of analytical technologies, or the development/testing of new algorithms/functions to enhance capabilities within key market segments of interest
  • Leads definition of machine learning and data analytics vision, multiple use-case evaluation and selection criteria, as well as project-level scope definition for customers
  • Proactively identifies gaps and collaborates with engineering teams to find solutions, while solidifying commitments to execute these
  • Drives partnerships & relationships with third parties to develop vertical/horizontal analytical solutions and product integrations
What we offer
What we offer
  • Comprehensive Healthcare Programs
  • Award Winning Financial Wellness Tools and Resources
  • Generous Leave of Absence for New Parents and Caregivers
  • Industry Leading Wellness Platform
  • Employee Assistance Program
Read More
Arrow Right

AI Lead Engineer

Lead Engineer role in HPE Hybrid Cloud focusing on AI innovation and technology ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience designing and developing software systems design tools and languages in storage/server/networking area
  • Two or more years of experience in applying AI to practical and comprehensive technology solutions
  • Experience with ML, deep learning, TensorFlow, Python, NLP
  • Experience in program leadership, governance, and change enablement
  • Knowledge of basic algorithms, object-oriented and functional design principles, and best-practice patterns
  • Experience in REST API development, NoSQL database design, and RDBMS design and optimizations
  • Experience with innovation accelerators
  • Cloud Architectures
  • Cross Domain Knowledge
  • Design Thinking
Job Responsibility
Job Responsibility
  • Lead cross-functional teams in identifying and prioritizing key areas of a partner's business where AI solutions can drive significant business benefit
  • Design and develop solutions leveraging patterns in the data and metadata stored in Petabytes of Objects and Files in distributed fashion across enterprise storage platform
  • Design, develop, and deploy hybrid RAG architectures integrating LLMs with retrieval-based systems for improved relevance and contextual responses
  • Work on functional design, process design (including scenario design, flow mapping), prototyping, testing, training, and defining support procedures
  • Translating technical AI findings into clear, business-oriented language for non-technical stakeholders
  • Implement and manage pipelines that effectively combine retrieval mechanisms with generative capabilities
  • Develop custom plugins, adapters, or APIs to integrate retrieval systems with generative models
  • Fine-tune and optimize large language models
  • Monitor and troubleshoot issues within pipelines
  • Evaluate and benchmark the performance of vector databases
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Fulltime
Read More
Arrow Right

Principal Site Reliability Engineer (AI-first SRE)

Groupon is modernizing its global platform — and reliability is at the center of...
Location
Location
Peru
Salary
Salary:
Not provided
groupon.com Logo
Groupon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years in software/systems engineering, including 5+ years in SRE or platform reliability
  • Strong experience with GCP (preferred) or AWS, Kubernetes, and Terraform
  • Proficiency in Python or Go for automation and tooling
  • Deep understanding of observability stacks (Prometheus, Grafana, OpenTelemetry) and service meshes (Istio, Envoy)
  • Hands-on AIOps experience: anomaly detection, predictive analytics, ML-assisted operations
  • Strong communication and influencing skills — data over hierarchy
Job Responsibility
Job Responsibility
  • Architect and maintain self-healing systems with 99.9%+ availability targets
  • Use AI/ML to automate infrastructure governance and detect configuration or IaC anti-patterns
  • Implement adaptive SLIs/SLOs that evolve automatically from real-time data
  • Build AIOps-based observability and auto-remediation pipelines
  • Apply predictive modeling to forecast failures before they impact users
  • Lead chaos, performance, and resilience testing programs
  • Map platform and service behavior to revenue impact and drive improved revenue resilience through better infrastructure performance
  • Mentor engineers and drive reliability standards across teams
  • Partner with platform, data, and product teams to ensure stability aligns with business goals
  • Support major incident response, incident review, and participate in on-call rotations
What we offer
What we offer
  • The opportunity to work with cutting-edge technologies in a transformative environment
  • Professional growth and leadership development pathways tailored to your aspirations
  • A chance to leave a lasting impact by shaping the future of reliable and scalable systems
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy