CrawlJobs Logo

Staff Product Manager, Evaluations and Automation

airbnb.com Logo

Airbnb

Location Icon

Location:
United States

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

194000.00 - 239000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

The Staff Product Manager, Evals & Automation, reporting to the Product Lead, Payments Risk, will define the strategy and roadmap for how Airbnb evaluates, learns from, and automates risk decisions—ensuring we protect the marketplace while minimizing friction and insult to good users.

Job Responsibility:

  • Define the product vision, strategy, and execution for critical evaluation workflows for risk detection & mitigation
  • Design principled evaluation frameworks that determine the right size and shape of holdouts, control groups, and manual review samples—without degrading model performance or decision quality
  • Drive automation that meaningfully reduces manual reviews, operational burden, and customer friction, while preserving the labels and signals required to keep models accurate and resilient over time
  • Review how models, holdouts, and manual reviews interact across the decisioning funnel—examining false positives, label coverage, approval lift, and downstream loss impact
  • Work closely with Data Science, Machine Learning, Risk Engineering, and Operations to understand where current evaluation approaches over-sample good users, introduce bias, or create unnecessary friction
  • Define the end-to-end product vision for risk evaluations and learning loops, building a multi-year roadmap that balances statistical rigor, operational efficiency, customer experience, and regulatory expectations
  • Own requirements and execution for systems that: Dynamically size and manage holdouts
  • Optimize when and how manual reviews are invoked
  • Preserve high-quality labels without over-reliance on human review
  • Enable faster, safer iteration on risk models and policies
  • Partner deeply with Fraud & Safety, Trust, Legal, Policy, Customer Support, and Payments Operations to align on decision principles and ensure evaluation strategies are understood, trusted, and actionable across the company
  • Collaborate with Payments Operations and Support to reduce manual effort, handle edge cases better, and unlock high-quality decisioning at scale
  • Partner deeply with other Airbnb platform organizations such as Fraud & Safety, AirCover, Legal, Customer Support, Policy Enforcement & Payments Operations teams to align on the vision and mission and coordinate tactics to deliver mutually aligned outcomes

Requirements:

  • 9+ years of Product Management experience, or 6+ years with a BS/MS with significant work in payments, risk/fraud, chargebacks/, or marketplace integrity
  • Demonstrated experience working with model-driven systems, evaluation frameworks, experimentation, and decisioning under uncertainty
  • Strong intuition for long-tail risk problems, false positives, and the unintended consequences of sampling and labeling strategies
  • Systems thinker who can design learning loops that scale globally and remain robust as adversarial behavior evolves
  • Highly data-literate: comfortable working with loss curves, precision/recall tradeoffs, operational metrics, and model performance diagnostics
  • Systems thinker with the ability to architect modular processes that scale globally
  • Ability to make principled, high-judgment decisions in ambiguous, high-stakes environments
  • Takes ownership of multiple product areas or one with significant impact, establishing clear expectations, driving communication, quality and timely delivery
  • Experience designing end-to-end user experiences that balance risk mitigation with customer empathy
  • Adapts communication style according to the audience across teams, extended stakeholders and leadership
  • Empathetic, clear communicator who can lead cross-functional partners through influence, not authority
  • Autonomously communicates, influences and aligns stakeholders on the products vision/strategy
  • With minimal guidance defines products that sustain the changing needs of business, industry, users and partners with Eng/Design to translate to long term architecture and Ecosystems thinking, with clear understanding of platform capabilities to be built
  • Strong analytical chops—you’re comfortable diving into financial & customer data, operational metrics, and model performance
  • Proven ability to partner deeply with engineering, design, operations, data science, and legal/compliance teams
  • Comfortable working in a fast-paced environment with evolving regulatory requirements and complex trade-offs
  • Authorized to work in the United States
What we offer:
  • bonus
  • equity
  • benefits
  • Employee Travel Credits

Additional Information:

Job Posted:
March 19, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
Airbnb - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Staff Product Manager, Evaluations and Automation

Staff AI Developer Productivity Engineer

This is a staff-level, hands-on role at the intersection of Developer Productivi...
Location
Location
United Kingdom , London OR Chester
Salary
Salary:
Not provided
equalsplc.com Logo
Equals Group PLC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years in software engineering with a track record of building internal developer tooling/DevEx (CLI/IDE plugins, bots, internal services or web apps)
  • Strong proficiency in TypeScript/Node.js, C#/.NET and front-end experience with React/Next.js
  • Hands-on LLM integration: prompting, tool/function calling, retrieval (embeddings/vector stores) and basic evaluation of quality
  • Solid understanding of CI/CD, test strategy and code-quality tooling
  • able to design fast inner loops and reliable pipelines
  • Product mindset: discovery interviews, hypothesis-driven experiments, before/after evaluation and clear business cases
  • Excellent communication and influence skills
  • comfortable enabling teams via docs, workshops and remote office hours
  • A role model for our values: Make it happen
  • Succeed together
Job Responsibility
Job Responsibility
  • AI-first discovery roadmap - Interview engineers, analyse telemetry and prioritise the highest-leverage opportunities across coding, review, testing, releases and knowledge flows. Set baselines and target deltas and maintain a transparent backlog/roadmap grounded in measurable outcomes
  • Ship internal tools - Build and maintain AI-augmented dev tools across IDE/CLI, GitHub, Slack, Notion, Retool and internal web apps that reduce manual effort and cycle time
  • Agentic flows across the SDLC - Design structured, agentic workflows (including MCP and tool-use with human-in-the-loop gates) to improve code authoring/review, test creation/selection and the release, incident response and onboarding processes
  • Frontier scouting & evaluation - Continuously experiment with cutting-edge AI models, frameworks and runtimes
  • run short, hypothesis-driven pilots with clear success criteria and developer-fit assessments
  • productionise successful approaches
  • Automation pipelines - Implement LLM-assisted and AST-based code-mod workflows for migrations, boilerplate generation, test creation and docs updates
  • Enablement & change management - Drive adoption with playbooks, golden prompts, demos, office hours and a champions network across build teams
  • measure usage and satisfaction and iterate
What we offer
What we offer
  • 25 days holiday per year + your birthday off
  • Opportunities for progression, development and learning new skills - £250 towards the cost of learning & development
  • Free onsite Nuffield Health gym & pool (London) and discounted gym membership elsewhere
  • GetActive with Aviva - Health and Wellbeing discounts on services and products
  • Interbank currency rates on travel money and international transfers
  • Bupa Private Healthcare
  • Free Eye Test and £50 up to the cost of glasses
  • EAP Service - Mental Health Services
  • Life Assurance Policy - x3 annual salary
  • Contributory pension scheme
Read More
Arrow Right

Staff AI Innovation Engineer, Employee Experience

Architect the next generation of Airbnb’s internal operating system by designing...
Location
Location
United States
Salary
Salary:
180000.00 - 225000.00 USD / Year
airbnb.com Logo
Airbnb
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 9+ years in product management, AI engineering, and/or platform architecture, with hands-on experience building and launching AI/ML-powered products
  • Proven 0→1 builder with extensive experience developing GenAI prototypes, tools, and platforms from scratch
  • Ability to produce functional prototypes (using Claude Code or similar) within hours and stakeholder-ready demos within days
  • Strong systems-thinking skills with the ability to map complex workflows, diagnose root causes, and design buildable solutions
  • Expertise in prompt engineering, context orchestration, and adapting LLM behavior to different users, workflows, and decision contexts
  • Data-informed decision-maker who can define success criteria, measure ROI, and refine models and workflows
  • Skilled in communicating technical concepts to non-technical audiences
  • Highly collaborative, systems-oriented, and adept at connecting dots across people, tools, and processes
  • Strong visual and narrative communication skills (Figma, Miro, slideware)
  • Portfolio of prototypes or relevant 0→1 work preferred but not required
Job Responsibility
Job Responsibility
  • Translate employee and manager workflows into well-defined AI product opportunities
  • Rapidly prototype and test working solutions (LLM agents, workflow automations, microapps, embedded tools, etc.)
  • Architect systems integrations across our HR tech stack (Workday, Greenhouse, Qualtrics, Airtable, RightAnswers, Asana, and more)
  • Lead discovery sessions with stakeholders to uncover automation and augmentation opportunities
  • Evaluate third-party AI tools and determine build vs. buy options
  • Design and execute fast-cycle pilots across knowledge management, decision support, communications, and resource planning
  • Define success metrics, measure impact, and iterate based on user feedback
  • Translate complex AI architectures into clear narratives that help stakeholders understand value and adoption paths
  • Ensure alignment with Airbnb’s privacy, security, and ethical AI guardrails
  • Continuously evolve EX’s AI strategy as organizational needs and technologies shift
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Employee Travel Credits
  • Fulltime
Read More
Arrow Right

Staff Cloud Security Engineer

We're making the world of digital assets accessible and secure for everyone. Joi...
Location
Location
France , Paris
Salary
Salary:
Not provided
https://www.ledger.com Logo
Ledger
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in DevSecOps & automation, security assessment, and cloud-native environments
  • 8+ years of experience on information security
  • Proficiency working in Unix/Linux environments, Git, Python, Terraform, Kubernetes, AWS cloud solutions and architectures, CI/CD tools, configuration management, etc.
  • Hands-on experience with security tooling deployment, monitoring, and incident response
  • Proven track record of cross-functional work, with the ability to collaborate effectively with various teams and stakeholders
  • Excellent presentation and written communication skills
  • Ability to work autonomously, deal with ambiguity, and handle high-pressure situations.
Job Responsibility
Job Responsibility
  • Collaborate with the Infrastructure, the engineering and the Donjon teams to integrate security into the delivery plans, ensure early detection and mitigation of security vulnerabilities
  • Work closely with the Donjon, the product Security team responsible, to provide automation and tooling for product security evaluation integration in CI/CD pipeline.
  • Engage in proactive security practices, including penetration testing, vulnerability assessments, and Infrastructure Security (IaC) code reviews to ensure Ledger's platforms and applications are secure.
  • Participate in the design and implementation of security architectures, from the design to the risk assessment.
  • Act as the primary point of contact for any security incidents, ensuring rapid response, mitigation, and post-incident analysis.
  • Drive the adoption of DevSecOps culture, best practices, and methodologies across the organization, ensuring continuous security improvement.
What we offer
What we offer
  • Equity
  • Flexibility: A hybrid work policy
  • Social: Annual company outing for Ledgerdary Days, plus frequent social events, snacks and drinks
  • Medical: Comprehensive health insurance policy offering extensive medical, dental and vision care coverage
  • Well-being: Personal development, coaching & fitness with our dedicated partners
  • Vacation: Five weeks of paid leave per year, in addition to national holidays and rest & relaxation (RTT) days
  • High tech: Access to high performance office equipment and gadgets, including Apple products
  • Transport: Ledger reimburses part of your preferred means of transportation
  • Discounts: Employee discount on all our products.
  • Fulltime
Read More
Arrow Right

Production Management Global Support Lead

The Production Management Global Support Lead (C15 Director) is a Senior Manager...
Location
Location
United Kingdom , London; Belfast
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Relevant industry-relevant experience
  • Highly experienced in various Production Management disciplines with a track record of continual improvement
  • Excellent interpersonal and communication skills
  • Ability to influence and garner support from senior stakeholders and partners
  • Comfortable presenting issues, initiatives, and progress in various forums
  • Adept at distilling complex information into succinct messages
  • Demonstrable commitment to quality, attention to detail, critical thinking, and problem-solving skills
  • Highly effective at navigating complex organizations
  • Strong financial planning and cost discipline
  • Exceptional staff engagement and talent development
Job Responsibility
Job Responsibility
  • Maintain high levels of stability, resiliency, and prevention for TWCS services
  • Actively participate in and guide incident recovery
  • Work with senior management across technology, operations, and business teams to develop actionable outcomes for Production
  • Ensure high standards for Production Change Readiness and control adherence
  • Prioritize supportability, sustainability, and resiliency for technical changes
  • Drive the adoption of standard production tools for TWCS applications
  • Focus on monitoring, observability, capacity, resiliency, recoverability, and automation improvements
  • Proactively assess and manage dominant L1, L2, and L3 workload drivers
  • Identify emerging trends and devise plans to improve efficiency and service levels
  • Minimize human intervention by leveraging Generative AI and Automation capabilities
What we offer
What we offer
  • Competitive base salary (annually reviewed)
  • 27 days annual leave (plus bank holidays)
  • Discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Staff Product Manager

We’re hiring a Staff Product Manager, AI Platform & Experiences to help shape ho...
Location
Location
Canada , Toronto
Salary
Salary:
140000.00 - 170000.00 CAD / Year
fullscript.com Logo
Fullscript
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of product management experience, with a track record of leading complex, cross-functional initiatives
  • Strong systems thinking and comfort working at the intersection of product, engineering, and data
  • Experience collaborating deeply with engineering teams on technically complex products, including contributing to discussions around architecture, tradeoffs, and sequencing of technical work
  • Ability to understand and reason about how modern AI-powered systems are built and operated, even if you’re not hands-on with implementation
  • Familiarity with concepts such as APIs, distributed systems, experimentation, observability, and system reliability, and how they impact product quality and user experience
  • Experience using AI both as a product capability and as a tool to improve discovery, delivery, and decision-making across the product development lifecycle
  • Demonstrated curiosity and informed perspectives on emerging AI patterns (e.g., copilots, agents, automation) and how they may shape future product opportunities
  • A track record of elevating teams by sharing practical insights, patterns, or approaches others can learn from
Job Responsibility
Job Responsibility
  • Set direction and strategy for practitioner-facing AI experiences
  • Define the vision, strategy, and roadmap
  • Bring focus and cohesion to AI initiatives across the platform
  • Translate ambiguous problem spaces into clear product opportunities
  • Help establish guardrails for how AI is used at Fullscript
  • Make informed product decisions that account for system-level constraints
  • Help align short-term product delivery with longer-term technical investments
  • Deliver meaningful AI-powered experiences
  • Lead the evolution of assistive and embedded AI experiences
  • Ensure AI features are grounded in accurate platform context
What we offer
What we offer
  • Flexible time off
  • Competitive compensation + equity
  • Retirement support – RRSP match
  • Comprehensive health coverage – Premium, flexible benefits including paramedical services and HSA options
  • Product-driven learning culture – Dedicated learning budget
  • Remote-first with flexibility
  • Fullscript product access – Discounts on practitioner-grade wellness products
  • Fulltime
Read More
Arrow Right

Client Testing Support Analyst

The Apps Support Sr Analyst is a seasoned professional role. Applies in-depth di...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years experience in an Application Support role
  • Experience installing, configuring or supporting business applications
  • Experience with some programming languages and willingness/ability to learn
  • Advanced execution capabilities and ability to adjust quickly to changes and re-prioritization
  • Effective written and verbal communications including ability to explain technical issues in simple terms that non-IT staff can understand
  • Demonstrated analytical skills
  • Issue tracking, monitoring and reporting using tools
  • Knowledge/ experience of problem Management Tools
  • Good all-round technical skills
  • Proactively drives innovation to improve processes and applies automation to reduce manual effort
Job Responsibility
Job Responsibility
  • Provides technical and business support for users of FX Tech Applications
  • Maintains application systems that have completed the development stage and are running in the daily operations of the firm
  • Manages, maintains and supports applications and their operating environments, focusing on stability, quality and functionality against service level expectations
  • Start of day checks, continuous monitoring, and regional handover
  • Perform same day risk reconciliations
  • Develop and maintain technical support documentation
  • Identifies ways to maximize the potential of the applications used
  • Assess risk and impact of testing issues and escalate to business and technology management in a timely manner
  • Ensures that storage and archiving procedures are in place and functioning correctly
  • Formulates and defines scope and objectives for complex application enhancements and problem resolution
  • Fulltime
Read More
Arrow Right
New

Senior Digital Product Manager

Wells Fargo is seeking a Senior Digital Product Manager.
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
March 30, 2026
Flip Icon
Requirements
Requirements
  • 4+ years of digital product management experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • Strong years of digital product management experience or relevant equivalent
  • Strong years of IAM/PAM experience, including privileged account lifecycle management, secrets management, JIT/JEA models, credential injection, break-glass workflows, platform upgrades, and control governance
  • Hands‑on experience with Agile practices (Scrum/Kanban) and tools such as Jira, Confluence, and SharePoint, including managing epics/features/stories for CyberArk and HashiCorp Vault
Job Responsibility
Job Responsibility
  • Lead or participate in variety of complex functions within the digital environment
  • Contribute to large-scale planning related to the execution of the digital strategy
  • Review and analyze complex content strategy/creation, customer experience, analytics/research or product management that require an in-depth evaluation of variable factors
  • Independently resolve complex issues
  • Lead team to meet project deliverables while leveraging solid understanding of digital initiatives, policies, procedures and/or compliance requirements
  • Collaborate and consult with peers, colleagues and mid-level managers to resolve issues and achieve goals
  • Potentially lead projects, teams or provide direction to junior staff on less complex digital initiatives
  • Ability to support IAM/PAM governance routines, maintenance windows, and cross‑regional collaboration.
  • Support Enterprise IAM Strategy through strategic product leadership of Agile delivery teams, across capabilities such as session management, password management, secrets management, just‑in‑time access, and privileged session recording.
  • Lead the development and execution of complex digital business plans and initiatives, incorporating PAM controls including least privilege, segregation of duties, break-glass workflows, and credential lifecycle automation.
  • Fulltime
Read More
Arrow Right

Manager Inpatient Nursing Relief

Coordinates and manages all resources necessary to provide optimal nursing care....
Location
Location
United States
Salary
Salary:
51.05 - 76.60 USD / Hour
advocatehealth.com Logo
Advocate Health Care
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Registered Nurse license issued by the state in which the team member practices
  • certification in specialty within 1 year of eligibility
  • Bachelor's Degree in Nursing or Bachelor’s Degree and Master’s Degree in Nursing
  • Typically requires 5 years of experience in nursing that includes experiences in multiple areas
  • Includes 1 year of supervisory experience in managing a staff and budgets in a nursing environment at the supervisory/management level
  • Advanced knowledge of nursing management concepts, clinical practice, and facilities policies and procedures
  • Excellent interpersonal and communication skills and ability to deal with conflict resolution
  • Strong aptitude in human resource management
  • Ability to handle multiple demands simultaneously
  • Sound decision making and critical thinking skills
Job Responsibility
Job Responsibility
  • Coordinates and manages all resources necessary to provide optimal nursing care, including availability of staff resources, patient care supplies and automated patient care systems
  • Effectively manages resources through systems management and coordinates system issues to assure optimal patient care
  • Maintains an optimal level of productivity, based on the coordination of efficient 24-hour staffing and scheduling patterns and labor management standards
  • Evaluates the quality of patient care provided by department staff by using standards of practice, patient outcomes and other quality indicators to include peer review, incident reports, use of policies and procedures, evaluation of equipment, supplies and products
  • ensures appropriate resources are available for department performance improvement initiatives
  • Develops service strategies and monitors service levels against indicators to demonstrate improvement in customer and patient satisfaction
  • Coordinates and integrates services with other areas
  • Maintains and promotes effective relationships with and between patients, families, department staff, other departments, medical staff and their support staff, other health care facilities and vendors
  • Acts as a liaison between medical and nursing staffs as necessary
  • Facilitates evidence-based nursing by creating an environment that encourages utilization of evidence in practice and decision-making to maintain quality, cost and customer service
What we offer
What we offer
  • Paid Time Off programs
  • Health and welfare benefits such as medical, dental, vision, life, and Short- and Long-Term Disability
  • Flexible Spending Accounts for eligible health care and dependent care expenses
  • Family benefits such as adoption assistance and paid parental leave
  • Defined contribution retirement plans with employer match and other financial wellness programs
  • Educational Assistance Program
  • Premium pay such as shift, on call, and more based on a teammate's job
  • Incentive pay for select positions
  • Opportunity for annual increases based on performance
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy