CrawlJobs Logo

Ai experience policy specialist

United States, Phoenix Employment contract 21.70 USD / Hour · Job Posted April 23, 2026
Apply Position
Job Link Share

Job Description

The GenAI Manual Evaluations team serve as Uber’s human-in-the-loop quality, safety, and risk gate for AI deployments that will engage with our users. The team plays a critical role in ensuring AI meets a human bar and that our products can scale with consistent conformance, as well as prevent downstream impact by surfacing CX, policy, and financial risks before customer impact. The GenAI Manual Evaluations team is responsible for conducting end-to-end reviews of customer and agent interactions with Uber’s AI-powered support tools. We assess the full experience—from product behavior and agent responses to language quality, translations, policy accuracy, and knowledge base alignment. Our goal is to establish a scalable, continuous review process that ensures the quality of AI-driven support solutions and enables the seamless integration of new features. By identifying experience gaps and areas for improvement, we deliver actionable insights that directly inform product, engineering, and operations roadmaps.

Job Responsibility

  • Execute rubric-based evaluations on real interactions between Uber’s users (earners, riders, merchants) and our GenAI support products
  • Assess the accuracy, relevance, and overall customer experience of the responses provided by AI
  • Identify defects, edge cases, and gaps in the support experience and document findings into relevant and actionable insights for cross functional teams to action
  • Support the calibration and continuous improvement of various AI programs as we continue to scale to a larger audience
  • Become an SME of multiple tools & programs to provide comprehensive evaluations of varying interaction types
  • Communicate quickly and effectively to internal Uber members as needed
  • Become an expert on processes and may help with sophisticated problem solving
  • Follow process guides to complete tasks and provide support to various crucial initiatives
  • Work with your Team Lead and the Manual Evals Program team to escalate suggestions and issues for timely resolution
  • Serve as the policy SME for AI support experiences—ensuring automated outputs align with current policies and support standards

Requirements

  • Ability to distill complex technical processes into clear, usable content
  • Strong understanding of support operations, AI tools, and agent workflows
  • Strong expertise in policy operations or support policy frameworks
  • A proactive, solutions-oriented mindset with attention to operational detail
  • Strong technical aptitude and willingness to quickly learn and manage new internal tools

Nice to have

  • Experience with escalation workflows, SOP development, or policy training programs
  • Experience coordinating cross-functional initiatives and working with project management tools like Jira
  • Familiarity with AI-driven tooling or similar automated support environments
  • Proven track record of improving communication flows in tech, support, or automation environments

What we offer

  • Eligible to participate in Uber's bonus program
  • Eligible to participate in a 401(k) plan
  • Various benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Ai experience policy specialist

8 matching positions

AI Enablement Specialist, Digital Employee Experience

The AI Enablement role will be responsible for building, supporting, and enhanci...
Location
Location
Canada , Halifax
Salary
Salary:
Not provided
resmed.com Logo
ResMed
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years progressive IT support, escalation handling, technical support, and incident resolution, with a shift into learning AI tools and adoption
  • Solid foundation in AI tools, workflows, and ability to help navigation of usage
  • Strong expertise in Microsoft Power Automate (flows, connectors, integrations with Outlook, Teams, SharePoint, etc.)
  • Experience with or strong want to enhance knowledge of Copilot Studio, AI Connectors, and OpenAI, deployment, monitoring, permissioning
  • Solid foundation in MS Graph permissions and authorization
  • Understand concept of Entra app registration and RSC permission (Resource Specific Content), as well as application delegation
  • Understanding of Governance and Purview, with the ability to provide access support and visibility to Privacy, Internal Audit, and GRC Risk teams
  • A strong want to help and empower end users in their AI journey
  • High comfort level in working with and supporting all levels of the business and presenting globally
  • High learning agility to dig into new technology and ideas as they are presented to the business
Job Responsibility
Job Responsibility
  • Work with Resmed team members to support design, development, and deployment of custom copilots, chatbots, and GPT-based assistants using Azure OpenAI, Copilot Studio, and Power Platform within the framework of Resmed’s best practices
  • Integrate new requests for Teams Apps and maintain secure, compliant AI integrations with all Microsoft 365 tools (Teams, SharePoint, Outlook, etc.)
  • Identify access permissions via Azure AD as they come in
  • request DWP support if needed
  • Develop and deploy Granular permission with ChatGPT via Groups
  • Help pilot and support any AI-enhanced workflows for business teams and scale successful use cases as needed
  • Fine-tuning prompts and grounding for agents with data stored in Resmed’s ecosystem
  • Continuously test and refine AI solutions to improve performance, accuracy, and user experience
  • Support Entra App Registration and provide least privilege and access
  • Manage and resolve incoming support request through the myITServices queue
  • Fulltime
Read More
Arrow Right

Senior Security AI Specialist

The Senior Security AI specialist is responsible for the Security that protects ...
Location
Location
Netherlands , Veldhoven
Salary
Salary:
Not provided
asml.com Logo
ASML
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in a relevant discipline, e.g., Business Administration, Information technology, Cybersecurity, Internal Auditing, IT management and or Data Science & AI
  • 4 - 9 years professional experience with a focus on security, IT auditing, Information Security Management Systems (ISMS)
  • Relevant certifications such as CISSP, CISM or CRISC
  • Experience with defining and running an security baselines, assessments
  • Proven track record in Security at tactical level
  • You have or held hands-on previous experience in technical roles (e.g., security architecture, engineering, or implementation), enabling you to critically assess control design and implementation
  • Deep Knowledge of current security technologies and architecture, current and future developments for AI security, in-depth working knowledge of IT, Data and Information Risk/security frameworks and best practices, such as NIST Cyber security framework, ISF Standard of Good Practice for Information Security, IEC 62443, NIST SP 800 30 framework, NIS2 , ISO 27001/2 framework
Job Responsibility
Job Responsibility
  • Help ASML to effectively and efficiently deal with AI security risks
  • Manage and coordinate the lifecycle of AI security assessment, effectiveness of security controls and security baselines by means of verification & validation
  • Validate by ensuring that adequate monitoring capabilities are realized
  • Design and implement effective management reporting and dashboarding capabilities
  • Flag deviations, escalate to senior management where needed and own and drive the resolution process to completion
  • Support the manager in preparing an operational plan and executing that plan
  • Ensure the understanding of ASML's AI Security Strategy
  • Contribute to the setting and alignment of team targets and activities
  • Contribute to the execution of the annual plan activities
  • Achieve desired outcomes of Security Road Map and the implementation of policies and standards related to AI & Information Security
  • Fulltime
Read More
Arrow Right

Customer Experience Specialist

We are looking for a Customer Experience Specialist to join a mortgage services ...
Location
Location
United States , Coppell
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Prior experience in a call center or customer service setting, with the ability to manage frequent customer interactions efficiently
  • Strong verbal and written communication skills with a detail-oriented and empathetic approach to customer conversations
  • Comfort working across multiple browser windows, systems, and digital tools in a high-volume environment
  • Ability to adapt quickly, locate information independently, and use available resources to resolve issues effectively
  • Experience handling payment-related conversations or collections activity is preferred
  • Familiarity with mortgage servicing, borrower support, or related financial account inquiries is helpful
  • Proven ability to balance customer care with policy adherence and account resolution expectations
Job Responsibility
Job Responsibility
  • Respond to a high volume of inbound and outbound customer calls related to mortgage accounts, ensuring each interaction is handled with accuracy and care
  • Assist borrowers with questions involving payments, escrow matters, tax details, refinancing information, and other account-related concerns
  • Support early-stage collections activity for accounts up to 60 days past due while maintaining a respectful, service-focused approach
  • Navigate several internal systems and AI-enabled tools to research account information, document conversations, and provide timely resolutions
  • Communicate clearly through both phone and email channels to address customer needs and follow up on outstanding issues when needed
  • Manage changing priorities throughout the workday, including training schedules, post-training shift expectations, and periodic rotational Saturday coverage with compensatory time provided
  • Contribute to a positive customer experience by identifying practical solutions, reducing confusion, and guiding customers through next steps
  • Maintain business-casual workplace standards and represent the organization with care and consistency in all customer interactions
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Software Engineer, AI Specialist - Monetization (Technical Leadership)

Meta is seeking a distinguished Software Engineer with deep AI specialization to...
Location
Location
United States , Sunnyvale
Salary
Salary:
219000.00 - 301000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 12+ years of experience in software engineering with a focus on AI, machine learning systems, or applied deep learning in production environments
  • Experience architecting and delivering large-scale AI or machine learning systems — including training infrastructure, model serving, ranking, recommendation, or foundation model pipelines — that operate at significant scale
  • Experience leading multi-team technical initiatives end-to-end, including defining strategy, driving cross-functional alignment, and delivering measurable outcomes against organization-level goals
  • Experience identifying and resolving systemic engineering issues that span multiple systems or abstraction layers, including developing frameworks that prevent recurring classes of failures
  • Experience communicating complex AI system designs and technical trade-offs in writing and presentations to both technical and non-technical audiences, including engineering leadership
Job Responsibility
Job Responsibility
  • Identify and solve the most complex AI systems engineering challenges across the organization, including architecting large-scale machine learning training and inference infrastructure that operates at Meta's global scale
  • Define extensible technical foundations and cross-organizational standards for AI model development, evaluation, and deployment pipelines that favor consistency and long-term maintainability
  • Drive the technical vision and multi-year roadmap for AI platform capabilities, influencing priorities across multiple engineering teams and cross-functional partners including research, product, and data science
  • Evaluate emerging AI architectures, model paradigms, and industry developments to identify opportunities and risks relevant to Meta's competitive position, and translate findings into actionable engineering strategy
  • Lead the design and implementation of AI systems where correctness, reliability, and performance are rigorously proven, establishing invariants and testing frameworks that prevent entire categories of model and system failures
  • Identify where AI tooling and automation can eliminate entire categories of engineering work, and drive adoption of AI-native workflows across engineering teams to exponentially increase organizational throughput
  • Collaborate with research scientists and applied researchers to translate novel AI techniques from prototype into production systems that deliver measurable improvements to key product metrics
  • Mentor engineers across the organization by providing customized technical coaching, leading engineering programs such as architecture reviews and AI craft initiatives, and establishing a culture of rigor and thoroughness
  • Partner with legal, policy, and compliance teams to ensure AI systems meet privacy, security, and integrity standards, and set the bar for responsible AI development practices across the business domain
  • Define new metrics and data-driven decision-making principles for long-term, cross-team AI initiatives, connecting technical outcomes to organization-level priorities and business impact
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Senior Operations Specialist, AI Enablement

Lead the end-to-end quality program for AI Moderation. Ensure that human and mac...
Location
Location
United Kingdom , London
Salary
Salary:
50000.00 - 60000.00 GBP / Year
bumble.com Logo
Bumble Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in Trust & Safety
  • Hands-on experience in content moderation operations and quality management
  • Familiarity with moderation systems and conversational AI tools
  • Understanding of the interplay between human review and machine learning models
  • Strong analytical skills
  • Experience digesting large data sets and complex policies into clear, actionable insights
  • Experience in data analysis and reporting
  • Deep understanding of CX & Trust operations, moderation frameworks, and policy enforcement principles
  • Comfortable working with moderation, CX, QA tools and platforms
  • Ability to quickly adapt to new software systems and evolving workflows
Job Responsibility
Job Responsibility
  • Operationalise and scale the AI Moderation QA framework across internal teams and BPO partners
  • Ensure consistent application of quality standards
  • Review and evaluate the accuracy and consistency of content moderation decisions made by BPO teams and machine moderation systems
  • Operationalise structured feedback loops between QA, BPO, CX & Trust Operations, Policy, and Product teams
  • Validate model performance and identify opportunities for improvement
  • Develop quality benchmarks and continuously optimise moderation processes, tooling, and workflows
  • Conduct root cause analysis using moderation data to surface trends, systemic gaps, and actionable insights
  • Enhance moderation policy implementation
  • Provide data-driven recommendations for policy updates
  • Ensure moderation practices adhere to regulatory requirements and community guidelines
  • Fulltime
Read More
Arrow Right

Operations Specialist, AI Enablement

At Bumble, our mission is to create a world where relationships are healthy and ...
Location
Location
United Kingdom , London
Salary
Salary:
30000.00 - 35000.00 GBP / Year
bumble.com Logo
Bumble Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in customer service within a fast-paced, service-oriented environment
  • Familiarity with conversational AI systems and chatbots
  • Sharp eye for detail and ability to objectively evaluate conversations against process and policy standards
  • Knowledge of CX operations, quality assurance, moderation frameworks, or policy compliance workflows is beneficial
  • Comfortable working with digital tools and platforms and can quickly adapt to new software systems
  • Understands the importance of calibration and consistency in QA scoring
  • Works collaboratively, demonstrates ownership of impact, and embraces feedback as part of growth
Job Responsibility
Job Responsibility
  • Conduct regular QA reviews of AI agent conversations to assess alignment with Bumble’s processes, quality standards, tone and community policies
  • Report quality issues through established reporting workflows, ensuring accurate categorization, clear documentation, and actionable feedback
  • Collaborate closely with the Quality Manager to maintain consistency in scoring and review approach
  • Partner with the Quality Manager to resolve recurring quality issues and strengthen AI agent reliability and user experience
  • Identify and share learnings that lead to measurable improvements in AI agent accuracy, customer satisfaction, and process efficiency
  • Support ongoing calibration sessions by identifying trends, recurring challenges, and opportunities for process enhancement
  • Operate CX QA tools and systems (such as Zendesk QA and internal Bumble QA assessment tooling) to monitor quality data and track performance improvements
  • Embrace and apply AI tools confidently in daily work, learning to interpret AI behavior, understand model limitations, and engage with AI insights with curiosity and accountability
  • Work collaboratively, take ownership of your deliverables, and adapt your approach with an agile mindset
  • Fulltime
Read More
Arrow Right

Enterprise Architecture Specialist - AI&Data

The Senior Enterprise Architecture for the AI & Data Domain will provide central...
Location
Location
United Kingdom , Newbury
Salary
Salary:
Not provided
vodafone.com Logo
Vodafone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Academic Degree in Information Technology, Information Systems, Business Management, Computer Science, or similar required
  • 3-5 years+ experience within IT programme management, IT Strategy, IT Systems Management, Enterprise Architecture or similar
  • Up-to-date certifications in Agile Way of Working, with working knowledge of SAFe, SCRUM, Spotify model etc. TOGAF certification is preferred
  • Outstanding written communications and presentation skillset with both internal stakeholders and external customers
  • Knowledge of Agile collaboration tools (Jira, Azure DevOps, Confluence, Mural etc)
  • In-depth understanding of enterprise architecture frameworks such as TOGAF and eTOM, with a proven track record in conducting architectural planning for complex modernization and transformation programs
  • Proficiency in technology delivery tooling including the creation of architecture deliverables (e.g., architecture diagrams) and demand flow management (e.g., Jira, Confluence), along with excellent technical authoring skills
  • Strong experience with AI and machine learning algorithms and frameworks (e.g., TensorFlow, PyTorch)
  • Strong experience in architecting Data warehouse, BI & big data platforms on cloud
  • In-depth knowledge of cloud platforms such as AWS, Azure Cloud, or Google Cloud
Job Responsibility
Job Responsibility
  • Developing or Publishing Reference Architectures and Designs (Logical, Functional, and Application Architectures) that address both market-specific and global strategic priorities in accordance with industry and Vodafone standards
  • Continuous Evolution of the architectural landscape, ensuring it remains fit for purpose and responsive to changing business demands
  • Component Definition and Inventory Management: Define V-ODA components in relation to the domain and ensure domain-specific application inventories are accurate and well-maintained
  • Compliance: Maintain architecture decision logs, draft and update relevant policies, and manage compliance with architectural standards and governance frameworks
  • High-quality architecture deliverables including comprehensive and accurate architecture diagrams, white papers, and policy and standard documentation
  • Successful design and implementation of Data & AI architectures
  • Efficient and scalable Data & AI solutions
  • Strategic Alignment achieved between local business objectives and global technology capabilities, as evidenced by the successful implementation of Reference Architectures and Designs
What we offer
What we offer
  • Discretionary yearly bonus: 10%
  • Annual leave: 28 days + bank holidays + the opportunity to buy/sell/carry over 5 days/year
  • Charity days: 5 days/year
  • Maternity/adoption leave: 52 weeks out of which the first 13 weeks are fully paid followed by 26 weeks of half pay and 6 months - working 4 days, getting paid 5
  • Paternity leave: 16 weeks fully paid
  • Private pension: You can contribute up to 5% of your basic pay with 2:1 matching from Vodafone up to 10%
  • Access to: private medical, private dental, free health assessments, share save scheme
  • Additional discounts: Vodafone retail, gym, cinema, cycle to work, season ticket loan
Read More
Arrow Right

AI Specialist, Identity and Access Management (IAM)

Protecting Meta’s data and workforce is an explicit top priority for the company...
Location
Location
United States , New York
Salary
Salary:
219000.00 - 301000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Experience leading a team in solving modeling problems using AI/ML approaches
  • Experience in applying research to production problems
  • Experience communicating research for public audiences of peers
  • 12+ Years Experience in developing and debugging in Python, C/C++, or C#
  • Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment
Job Responsibility
Job Responsibility
  • Help advance the science and technology of intelligent machines
  • Work on research projects, strategies, and problems of moderate to high complexity and scope. Can identify and define both short and medium term objectives
  • Influence progress of relevant research communities by producing publications
  • Establish connections with cross-functional partners and contribute research with the goal of applying to Meta's product development
  • Lead and collaborate on research projects within a team
  • Design policies, processes, procedures, methods, tests, and/or components, from the ground up for end-to-end systems
  • Apply in-depth knowledge of how the machine learning system interacts with the other systems around it
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right