CrawlJobs Logo

Staff Product Manager, Evaluations and Automation

airbnb.com Logo

Airbnb

Location Icon

Location:
United States

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

194000.00 - 239000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

The Staff Product Manager, Evals & Automation, reporting to the Product Lead, Payments Risk, will define the strategy and roadmap for how Airbnb evaluates, learns from, and automates risk decisions—ensuring we protect the marketplace while minimizing friction and insult to good users.

Job Responsibility:

  • Define the product vision, strategy, and execution for critical evaluation workflows for risk detection & mitigation
  • Design principled evaluation frameworks that determine the right size and shape of holdouts, control groups, and manual review samples—without degrading model performance or decision quality
  • Drive automation that meaningfully reduces manual reviews, operational burden, and customer friction, while preserving the labels and signals required to keep models accurate and resilient over time
  • Review how models, holdouts, and manual reviews interact across the decisioning funnel—examining false positives, label coverage, approval lift, and downstream loss impact
  • Work closely with Data Science, Machine Learning, Risk Engineering, and Operations to understand where current evaluation approaches over-sample good users, introduce bias, or create unnecessary friction
  • Define the end-to-end product vision for risk evaluations and learning loops, building a multi-year roadmap that balances statistical rigor, operational efficiency, customer experience, and regulatory expectations
  • Own requirements and execution for systems that: Dynamically size and manage holdouts
  • Optimize when and how manual reviews are invoked
  • Preserve high-quality labels without over-reliance on human review
  • Enable faster, safer iteration on risk models and policies
  • Partner deeply with Fraud & Safety, Trust, Legal, Policy, Customer Support, and Payments Operations to align on decision principles and ensure evaluation strategies are understood, trusted, and actionable across the company
  • Collaborate with Payments Operations and Support to reduce manual effort, handle edge cases better, and unlock high-quality decisioning at scale
  • Partner deeply with other Airbnb platform organizations such as Fraud & Safety, AirCover, Legal, Customer Support, Policy Enforcement & Payments Operations teams to align on the vision and mission and coordinate tactics to deliver mutually aligned outcomes

Requirements:

  • 9+ years of Product Management experience, or 6+ years with a BS/MS with significant work in payments, risk/fraud, chargebacks/, or marketplace integrity
  • Demonstrated experience working with model-driven systems, evaluation frameworks, experimentation, and decisioning under uncertainty
  • Strong intuition for long-tail risk problems, false positives, and the unintended consequences of sampling and labeling strategies
  • Systems thinker who can design learning loops that scale globally and remain robust as adversarial behavior evolves
  • Highly data-literate: comfortable working with loss curves, precision/recall tradeoffs, operational metrics, and model performance diagnostics
  • Systems thinker with the ability to architect modular processes that scale globally
  • Ability to make principled, high-judgment decisions in ambiguous, high-stakes environments
  • Takes ownership of multiple product areas or one with significant impact, establishing clear expectations, driving communication, quality and timely delivery
  • Experience designing end-to-end user experiences that balance risk mitigation with customer empathy
  • Adapts communication style according to the audience across teams, extended stakeholders and leadership
  • Empathetic, clear communicator who can lead cross-functional partners through influence, not authority
  • Autonomously communicates, influences and aligns stakeholders on the products vision/strategy
  • With minimal guidance defines products that sustain the changing needs of business, industry, users and partners with Eng/Design to translate to long term architecture and Ecosystems thinking, with clear understanding of platform capabilities to be built
  • Strong analytical chops—you’re comfortable diving into financial & customer data, operational metrics, and model performance
  • Proven ability to partner deeply with engineering, design, operations, data science, and legal/compliance teams
  • Comfortable working in a fast-paced environment with evolving regulatory requirements and complex trade-offs
  • Authorized to work in the United States
What we offer:
  • bonus
  • equity
  • benefits
  • Employee Travel Credits

Additional Information:

Job Posted:
March 19, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
Airbnb - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Staff Product Manager, Evaluations and Automation

Staff AI Developer Productivity Engineer

This is a staff-level, hands-on role at the intersection of Developer Productivi...
Location
Location
United Kingdom , London OR Chester
Salary
Salary:
Not provided
equalsplc.com Logo
Equals Group PLC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years in software engineering with a track record of building internal developer tooling/DevEx (CLI/IDE plugins, bots, internal services or web apps)
  • Strong proficiency in TypeScript/Node.js, C#/.NET and front-end experience with React/Next.js
  • Hands-on LLM integration: prompting, tool/function calling, retrieval (embeddings/vector stores) and basic evaluation of quality
  • Solid understanding of CI/CD, test strategy and code-quality tooling
  • able to design fast inner loops and reliable pipelines
  • Product mindset: discovery interviews, hypothesis-driven experiments, before/after evaluation and clear business cases
  • Excellent communication and influence skills
  • comfortable enabling teams via docs, workshops and remote office hours
  • A role model for our values: Make it happen
  • Succeed together
Job Responsibility
Job Responsibility
  • AI-first discovery roadmap - Interview engineers, analyse telemetry and prioritise the highest-leverage opportunities across coding, review, testing, releases and knowledge flows. Set baselines and target deltas and maintain a transparent backlog/roadmap grounded in measurable outcomes
  • Ship internal tools - Build and maintain AI-augmented dev tools across IDE/CLI, GitHub, Slack, Notion, Retool and internal web apps that reduce manual effort and cycle time
  • Agentic flows across the SDLC - Design structured, agentic workflows (including MCP and tool-use with human-in-the-loop gates) to improve code authoring/review, test creation/selection and the release, incident response and onboarding processes
  • Frontier scouting & evaluation - Continuously experiment with cutting-edge AI models, frameworks and runtimes
  • run short, hypothesis-driven pilots with clear success criteria and developer-fit assessments
  • productionise successful approaches
  • Automation pipelines - Implement LLM-assisted and AST-based code-mod workflows for migrations, boilerplate generation, test creation and docs updates
  • Enablement & change management - Drive adoption with playbooks, golden prompts, demos, office hours and a champions network across build teams
  • measure usage and satisfaction and iterate
What we offer
What we offer
  • 25 days holiday per year + your birthday off
  • Opportunities for progression, development and learning new skills - £250 towards the cost of learning & development
  • Free onsite Nuffield Health gym & pool (London) and discounted gym membership elsewhere
  • GetActive with Aviva - Health and Wellbeing discounts on services and products
  • Interbank currency rates on travel money and international transfers
  • Bupa Private Healthcare
  • Free Eye Test and £50 up to the cost of glasses
  • EAP Service - Mental Health Services
  • Life Assurance Policy - x3 annual salary
  • Contributory pension scheme
Read More
Arrow Right

Staff AI Innovation Engineer, Employee Experience

Architect the next generation of Airbnb’s internal operating system by designing...
Location
Location
United States
Salary
Salary:
180000.00 - 225000.00 USD / Year
airbnb.com Logo
Airbnb
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 9+ years in product management, AI engineering, and/or platform architecture, with hands-on experience building and launching AI/ML-powered products
  • Proven 0→1 builder with extensive experience developing GenAI prototypes, tools, and platforms from scratch
  • Ability to produce functional prototypes (using Claude Code or similar) within hours and stakeholder-ready demos within days
  • Strong systems-thinking skills with the ability to map complex workflows, diagnose root causes, and design buildable solutions
  • Expertise in prompt engineering, context orchestration, and adapting LLM behavior to different users, workflows, and decision contexts
  • Data-informed decision-maker who can define success criteria, measure ROI, and refine models and workflows
  • Skilled in communicating technical concepts to non-technical audiences
  • Highly collaborative, systems-oriented, and adept at connecting dots across people, tools, and processes
  • Strong visual and narrative communication skills (Figma, Miro, slideware)
  • Portfolio of prototypes or relevant 0→1 work preferred but not required
Job Responsibility
Job Responsibility
  • Translate employee and manager workflows into well-defined AI product opportunities
  • Rapidly prototype and test working solutions (LLM agents, workflow automations, microapps, embedded tools, etc.)
  • Architect systems integrations across our HR tech stack (Workday, Greenhouse, Qualtrics, Airtable, RightAnswers, Asana, and more)
  • Lead discovery sessions with stakeholders to uncover automation and augmentation opportunities
  • Evaluate third-party AI tools and determine build vs. buy options
  • Design and execute fast-cycle pilots across knowledge management, decision support, communications, and resource planning
  • Define success metrics, measure impact, and iterate based on user feedback
  • Translate complex AI architectures into clear narratives that help stakeholders understand value and adoption paths
  • Ensure alignment with Airbnb’s privacy, security, and ethical AI guardrails
  • Continuously evolve EX’s AI strategy as organizational needs and technologies shift
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Employee Travel Credits
  • Fulltime
Read More
Arrow Right

Staff Cloud Security Engineer

We're making the world of digital assets accessible and secure for everyone. Joi...
Location
Location
France , Paris
Salary
Salary:
Not provided
https://www.ledger.com Logo
Ledger
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in DevSecOps & automation, security assessment, and cloud-native environments
  • 8+ years of experience on information security
  • Proficiency working in Unix/Linux environments, Git, Python, Terraform, Kubernetes, AWS cloud solutions and architectures, CI/CD tools, configuration management, etc.
  • Hands-on experience with security tooling deployment, monitoring, and incident response
  • Proven track record of cross-functional work, with the ability to collaborate effectively with various teams and stakeholders
  • Excellent presentation and written communication skills
  • Ability to work autonomously, deal with ambiguity, and handle high-pressure situations.
Job Responsibility
Job Responsibility
  • Collaborate with the Infrastructure, the engineering and the Donjon teams to integrate security into the delivery plans, ensure early detection and mitigation of security vulnerabilities
  • Work closely with the Donjon, the product Security team responsible, to provide automation and tooling for product security evaluation integration in CI/CD pipeline.
  • Engage in proactive security practices, including penetration testing, vulnerability assessments, and Infrastructure Security (IaC) code reviews to ensure Ledger's platforms and applications are secure.
  • Participate in the design and implementation of security architectures, from the design to the risk assessment.
  • Act as the primary point of contact for any security incidents, ensuring rapid response, mitigation, and post-incident analysis.
  • Drive the adoption of DevSecOps culture, best practices, and methodologies across the organization, ensuring continuous security improvement.
What we offer
What we offer
  • Equity
  • Flexibility: A hybrid work policy
  • Social: Annual company outing for Ledgerdary Days, plus frequent social events, snacks and drinks
  • Medical: Comprehensive health insurance policy offering extensive medical, dental and vision care coverage
  • Well-being: Personal development, coaching & fitness with our dedicated partners
  • Vacation: Five weeks of paid leave per year, in addition to national holidays and rest & relaxation (RTT) days
  • High tech: Access to high performance office equipment and gadgets, including Apple products
  • Transport: Ledger reimburses part of your preferred means of transportation
  • Discounts: Employee discount on all our products.
  • Fulltime
Read More
Arrow Right

Production Management Global Support Lead

The Production Management Global Support Lead (C15 Director) is a Senior Manager...
Location
Location
United Kingdom , London; Belfast
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Relevant industry-relevant experience
  • Highly experienced in various Production Management disciplines with a track record of continual improvement
  • Excellent interpersonal and communication skills
  • Ability to influence and garner support from senior stakeholders and partners
  • Comfortable presenting issues, initiatives, and progress in various forums
  • Adept at distilling complex information into succinct messages
  • Demonstrable commitment to quality, attention to detail, critical thinking, and problem-solving skills
  • Highly effective at navigating complex organizations
  • Strong financial planning and cost discipline
  • Exceptional staff engagement and talent development
Job Responsibility
Job Responsibility
  • Maintain high levels of stability, resiliency, and prevention for TWCS services
  • Actively participate in and guide incident recovery
  • Work with senior management across technology, operations, and business teams to develop actionable outcomes for Production
  • Ensure high standards for Production Change Readiness and control adherence
  • Prioritize supportability, sustainability, and resiliency for technical changes
  • Drive the adoption of standard production tools for TWCS applications
  • Focus on monitoring, observability, capacity, resiliency, recoverability, and automation improvements
  • Proactively assess and manage dominant L1, L2, and L3 workload drivers
  • Identify emerging trends and devise plans to improve efficiency and service levels
  • Minimize human intervention by leveraging Generative AI and Automation capabilities
What we offer
What we offer
  • Competitive base salary (annually reviewed)
  • 27 days annual leave (plus bank holidays)
  • Discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Client Testing Support Analyst

The Apps Support Sr Analyst is a seasoned professional role. Applies in-depth di...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years experience in an Application Support role
  • Experience installing, configuring or supporting business applications
  • Experience with some programming languages and willingness/ability to learn
  • Advanced execution capabilities and ability to adjust quickly to changes and re-prioritization
  • Effective written and verbal communications including ability to explain technical issues in simple terms that non-IT staff can understand
  • Demonstrated analytical skills
  • Issue tracking, monitoring and reporting using tools
  • Knowledge/ experience of problem Management Tools
  • Good all-round technical skills
  • Proactively drives innovation to improve processes and applies automation to reduce manual effort
Job Responsibility
Job Responsibility
  • Provides technical and business support for users of FX Tech Applications
  • Maintains application systems that have completed the development stage and are running in the daily operations of the firm
  • Manages, maintains and supports applications and their operating environments, focusing on stability, quality and functionality against service level expectations
  • Start of day checks, continuous monitoring, and regional handover
  • Perform same day risk reconciliations
  • Develop and maintain technical support documentation
  • Identifies ways to maximize the potential of the applications used
  • Assess risk and impact of testing issues and escalate to business and technology management in a timely manner
  • Ensures that storage and archiving procedures are in place and functioning correctly
  • Formulates and defines scope and objectives for complex application enhancements and problem resolution
  • Fulltime
Read More
Arrow Right
New

Supervisor, Automation Engineering

The Electric Engineering team ensures the delivery of safe and reliable electric...
Location
Location
United States , San Ramon
Salary
Salary:
136000.00 - 232000.00 USD / Year
pge.com Logo
PG&E Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelors Degree in Engineering or equivalent experience
  • 5 years of related experience in electric utility automation systems
Job Responsibility
Job Responsibility
  • Oversees the automation engineering group which implements Supervisory Control and Data Acquisition (SCADA) and remote access on all electric Transmission & Distribution substation equipment
  • Provides and develops detailed automation requirements, engineering design review, Remote Terminal Unit (RTU) settings, and construction support
  • Provides maintenance and operation support of the existing automation infrastructure
  • Participates in product evaluation and automation technology design standard development
  • Ensures the group attends safety training and maintains qualifications
  • Manages and assigns individual work assignments, schedules and priorities
  • Participates in work groups, initiatives and special projects related to process improvement and clarification of responsibilities
  • Provides technical support of substation automation equipment, remote master stations, and Energy Management Systems
  • Provides technical leadership and coaching to the automation engineers
  • Supervises 8-10 represented employees
  • Fulltime
Read More
Arrow Right

Credit Initiation Manager - Consumer Lending

At Citi, we get to connect millions of people across hundreds of cities and coun...
Location
Location
Hong Kong SAR , Kowloon
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of experience in a related role
  • Intermediate to senior level experience in a related role with commensurate people management experience preferred
  • Demonstrated ability to resolve issues utilizing in-depth disciplinary knowledge of concepts and procedures
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Manage and supervise application processing team (between 10 to 12 individuals) to meet day to day operational tasks
  • Assist Credit Initiation Head to manage Projects and team deliverables (like audit review, quality check review and etc.)
  • Manage day to day operational works related to Secured Lending Products (Mortgage, Investment Lending and Premium Financing Loans), including but not limited to new application, credit line changes, annual renewal, account credit maintenance request as well as to achieve service / productivity standards, ensure work quality and take appropriate action to optimize risk-reward outcome
  • Ensure adequate resources are in place from time to time to support business applications volume
  • Monitor & ensure all processes are following credit policies, operating procedures and local regulatory requirements through effective execution of control program such as self-assessment, day 2 review, quality assurance framework etc.
  • Report to Department Head for any control processing deficiencies issues
  • Review and identify opportunities to eliminate, automate or improve the workflow and process for productivity gain, cost efficiency and service improvement
  • Collaborate with various stakeholders such as Products, Risk Management, Technology, Regional Office (Other markets counterpart), other operation units and government statutory bodies to drive various business initiatives, enhancing applications processing & approval, other account credit maintenance request, post approval processes and government guarantee programs
  • Provide training and individual development guidance to staff, manages staff performance, makes compensation decision and manage staff career development
  • Perform credit analysis during credit assessment and exercise sound credit judgement in evaluating Secured Lending Products applications and account maintenance requests with compliance to the established guidelines / policies and maintain a balance thought between risk and business
What we offer
What we offer
  • Access to telehealth options, health advocates, confidential counseling and more
  • Expanded Paid Parental Leave Policy
  • Programs to manage financial well-being
  • Access to learning and development resources
  • Generous paid time off packages
  • Resources and tools to volunteer in communities
  • Fulltime
Read More
Arrow Right

Manager Inpatient Nursing Relief

Coordinates and manages all resources necessary to provide optimal nursing care....
Location
Location
United States
Salary
Salary:
51.05 - 76.60 USD / Hour
advocatehealth.com Logo
Advocate Health Care
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Registered Nurse license issued by the state in which the team member practices
  • certification in specialty within 1 year of eligibility
  • Bachelor's Degree in Nursing or Bachelor’s Degree and Master’s Degree in Nursing
  • Typically requires 5 years of experience in nursing that includes experiences in multiple areas
  • Includes 1 year of supervisory experience in managing a staff and budgets in a nursing environment at the supervisory/management level
  • Advanced knowledge of nursing management concepts, clinical practice, and facilities policies and procedures
  • Excellent interpersonal and communication skills and ability to deal with conflict resolution
  • Strong aptitude in human resource management
  • Ability to handle multiple demands simultaneously
  • Sound decision making and critical thinking skills
Job Responsibility
Job Responsibility
  • Coordinates and manages all resources necessary to provide optimal nursing care, including availability of staff resources, patient care supplies and automated patient care systems
  • Effectively manages resources through systems management and coordinates system issues to assure optimal patient care
  • Maintains an optimal level of productivity, based on the coordination of efficient 24-hour staffing and scheduling patterns and labor management standards
  • Evaluates the quality of patient care provided by department staff by using standards of practice, patient outcomes and other quality indicators to include peer review, incident reports, use of policies and procedures, evaluation of equipment, supplies and products
  • ensures appropriate resources are available for department performance improvement initiatives
  • Develops service strategies and monitors service levels against indicators to demonstrate improvement in customer and patient satisfaction
  • Coordinates and integrates services with other areas
  • Maintains and promotes effective relationships with and between patients, families, department staff, other departments, medical staff and their support staff, other health care facilities and vendors
  • Acts as a liaison between medical and nursing staffs as necessary
  • Facilitates evidence-based nursing by creating an environment that encourages utilization of evidence in practice and decision-making to maintain quality, cost and customer service
What we offer
What we offer
  • Paid Time Off programs
  • Health and welfare benefits such as medical, dental, vision, life, and Short- and Long-Term Disability
  • Flexible Spending Accounts for eligible health care and dependent care expenses
  • Family benefits such as adoption assistance and paid parental leave
  • Defined contribution retirement plans with employer match and other financial wellness programs
  • Educational Assistance Program
  • Premium pay such as shift, on call, and more based on a teammate's job
  • Incentive pay for select positions
  • Opportunity for annual increases based on performance
  • Fulltime
Read More
Arrow Right