CrawlJobs Logo

Senior Product Operations Manager, Evaluation

harvey.ai Logo

Harvey

Location Icon

Location:
United States , San Francisco

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

178000.00 - 210000.00 USD / Year

Job Description:

We’re looking for a technical, systems-minded operator to build and scale the evaluation engine behind Harvey’s platform. As we expand globally, ensuring our models behave reliably, accurately, and jurisdictionally correctly is mission-critical—and evaluation complexity is increasing 10x. As a member of our Product Operations team, you’ll work closely with Applied Legal Researchers, Product, Engineering, AI Research, and human data providers to operationalize evaluation methodologies and embed them into our product development lifecycle. You’ll create the workflows, systems, and tooling that make evaluation a first-class product capability at Harvey. This is a high-ownership role for someone who thrives in ambiguity, loves building structure from ambiguity, and wants to help scale the evaluation infrastructure of a global AI company.

Job Responsibility:

  • Build and scale the systems that power model and product evaluations across Harvey
  • Embed evaluation workflows and readiness checkpoints into the product development lifecycle
  • Create the single source of truth for evaluation status, results, history, and launch readiness
  • Turn Expert-designed evaluation methodologies into scalable, repeatable operational processes
  • Manage relationships with human data vendors and ensure evaluation quality meets legal standards
  • Work with Engineering and Research to improve evaluation tooling, automation, and dashboards
  • Drive evaluation readiness for major product and model launches across geographies and jurisdictions
  • Document and operationalize evaluation governance as complexity increases
  • Help define how Harvey ensures model accuracy, reliability, and trust at global scale

Requirements:

  • 4–7+ years in technical program management, product operations, research operations, or evaluation/benchmarking roles
  • Experience working with ML/AI evaluations, benchmarking frameworks, or scientific workflows
  • Comfort with statistical methodologies and SQL or Python, or similar tools to interpret evaluation data
  • Ability to work deeply with legal experts and operationalize complex evaluation methodologies
  • Strong cross-functional coordination skills across Product, Engineering, Research, and data providers/vendors
  • High attention to detail and a bias toward clarity, rigor, and reproducibility
  • Ability to navigate extreme ambiguity and bring order to complex systems
  • Strong communication skills and comfort translating technical nuance for diverse stakeholders
  • Desire to do whatever it takes to make evaluation systems successful—from writing documentation to diagnosing pipeline issues

Nice to have:

  • Experience in legal tech or working with domain experts in regulated industries
  • Experience managing human data providers or human-in-the-loop evaluation pipelines
  • Background in ML research, data quality management, or evaluation science
  • Early employee at a hyper-growth startup
  • Experience at world-class product or platform operations orgs (ex: Stripe, Ramp)
What we offer:
  • Offers Equity
  • Offers Bonus
  • Comprehensive health, dental and vision coverage
  • retirement benefits (401k match up to 4%)
  • flexible PTO

Additional Information:

Job Posted:
February 18, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Product Operations Manager, Evaluation

Senior FX Operations Manager

Citi Markets Operations is currently at a pivotal point in its evolution and jou...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree or equivalent work experience preferred
  • 8-10+ years of experience in Tier 1 global financial institutions including extensive experience in handling large projects delivering operational activities, especially in FX products
  • Experience delivering strategic change programmes spanning multiple years in a fast paced, large global financial services firm, ideally in an operations organization
  • Energetic, flexible, collaborative, and proactive
  • a leader who can positively and productively add product impact to both strategic and tactical technology
  • Strong, influential communicator who is articulate and concise, demonstrated success interacting with senior management both in the business, corporate functions as well as the Operations, Business and Technology environments
  • Strong risk management and control mindset
  • Provides evaluative judgment based on analysis of factual information in complicated, unique and dynamic situations
  • draws on diverse range of internal and external sources
  • Self-reliant, good problem solver, results oriented
Job Responsibility
Job Responsibility
  • Proactive engagement with Singapore country and APAC regional stakeholders (Business, Technology, Finance/PCG, Operations) in order to support the business and clients trading in Markets products, including but not limited to FX
  • Drive and implement sustainable processes, automation/migration initiatives, and standard adherence to policies
  • Working very closely with Operations Control on developing and adhering to an effective control framework that fully meets Audit, Compliance and Regulatory requirements
  • delivery of periodic presentations to external regulators as required
  • Involvement in shaping/building standardized and sustainable operational workflow and service standards for new product/production variations launches by APAC FX business. ie. NPAC process
  • Ensuring robust infrastructure and tools (Dashboards, MIS, Alerts etc.) are in place to effectively manage risk and service our clients to a high standard
  • Involved in preparing & publishing strong MIS information for regular Management Updates
  • High level of focus on digitization, automation and elimination of manual touch points (MTP)
  • Implementing a successful People and Engagement strategy to help attract, develop, retain and recognize a diverse and talented global workforce
  • Promoting a culture of continuous improvement and cultivating a robust service and control environment
  • Fulltime
Read More
Arrow Right

Senior Product Line Manager, Campus Switching

HPE Aruba Networking is redefining the 'Intelligent Edge'. Aruba is creating new...
Location
Location
United States , San Jose; Roseville
Salary
Salary:
117500.00 - 270000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree or equivalent in computer science, engineering or related field of study
  • 4+ years of work experience in related field
  • Technical understanding and knowledge of the relevant industry
  • Must be located in either San Jose, CA or Roseville, CA to be considered
  • Prior experience with Product Management or Solutions Engineering strongly preferred
  • Demonstrated ability to develop product strategy and lead teams to achieve results
  • Demonstrated skills in cost efficient solution building, financial performance metric creation and analysis
  • Demonstrated business acumen and knowledge of root cause analysis and problem detection
  • Technical understanding and knowledge of the relevant industry and ability to provide product specific technical training to the team
  • Technical and business understanding of networking Technologies, including Layer 2/3 switching, Routing (OSPF, BGP), SD-WAN, VxLAN and Security (Firewall, IDPS)
Job Responsibility
Job Responsibility
  • Lead and drive the evolution and strategy for the Aruba Campus Switching software and hardware product roadmap, end to end strategy, and go to market positioning
  • Drive defining the value proposition, customer segmentation, and business case to bring innovative and disruptive products to the market
  • Evangelize new switching, security, software and cloud management solutions and use cases to customers and partners
  • Manage the synthesis of market requirements (MRD) into marketing/customer details through having intimate customer knowledge and business, financial and industry market acumen
  • Manage product lifecycle to business segment goals across all phases of the product and business segment lifecycles (e.g. planning, development, launch, management, exit)
  • Collaborate product team and drive the evaluation and assessment of the key operational metrics (ie: revenue unit/margins, market share, quality performance, channel route to market, quarterly financials and on time to delivery)
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits that supports physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

Senior Product Manager

The Checkout team is responsible for the complete order lifecycle, from customer...
Location
Location
Germany , Hamburg or Berlin
Salary
Salary:
70000.00 - 85000.00 EUR / Year
aboutyou.de Logo
About You
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Have experience working, understanding & specifying processes within IT systems and are familiar with REST API, databases, etc.
  • Experience in leading technical product deliveries end-to-end
  • Excel at driving the development team to deliver high-quality products in an extremely fast paced environment
  • Experience in managing stakeholders from both technical and business backgrounds
  • Project or product management background with an emphasis on IT or E-Commerce
  • Understanding of impact analysis, identification of edge-cases and dependencies, clarification of priority and business value, and defining potential approaches to resolution
  • Experience in triaging operative issues, identifying technical dependencies and evaluating business impact
  • Analytical mindset, logical and structured approach of problem solving
  • Proactive, solution-oriented, self-motivated and communication is one of your strengths
Job Responsibility
Job Responsibility
  • Building & maintaining scalable & flexible new solutions for our Retail & SCAYLE businesses
  • Working in a multi-application & multi-tenant environment, with multiple stakeholders, each deeply involved in different facets of the Checkout as a product
  • Steering our products in a direction that allows them to be more flexible, open and easy to integrate to support our SCAYLE Customers.
  • Work in a rapidly evolving environment with daily challenges in transforming business goals into technical solutions
  • Collaborate with a dedicated, self-sufficient team from a variety of nationalities in specifying and building end-to-end features
  • Learning new tools to support you and your developers
  • Interface with a multitude of stakeholders, all involved & vested in the many facets of the Checkout as a product
  • Work in a SCRUM environment and act as a facilitator & driver for improvements in how the team works
  • Build on your technical know-how to support the integration process of service providers and consumers from specification and API definition to QA and release.
  • Lots of space for your own ideas and creations, flat hierarchies and very short decision making process
What we offer
What we offer
  • Hybrid working
  • Sports courses
  • Exclusive employee discounts
  • Free drinks
  • Language courses
  • Laracast account for free
  • Company parties
  • Help in the relocation process
  • Mobility subsidy
  • State-of-the-art technology
  • Fulltime
Read More
Arrow Right

Senior Product Manager, Onboarding Experience

Adyen seeks a high-impact Senior Product Manager to build best-in-class, effortl...
Location
Location
United States , Chicago
Salary
Salary:
180000.00 - 243000.00 USD / Year
adyen.com Logo
Adyen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5 + years of experience as a Product Manager in a Fintech SaaS environment or growth related roles (B2B or B2C), successfully leading cross-functional teams to develop and launch innovative software solutions
  • Customer Obsessed
  • Strategic Thinker
  • Results-Oriented
  • Analytical & Data-Driven
  • Entrepreneurial
  • Strong Communicator
  • Simplifier
Job Responsibility
Job Responsibility
  • Product Strategy: Define product vision and strategy focused on maximizing overall onboarding funnel performance and eliminating onboarding friction
  • Customer-Centric Development & Experimentation: Engage directly with all stakeholders to uncover hidden points of resistance and complexity
  • Build vs Buy Evaluations: Assess when to build functionality in-house versus when to leverage third-party solutions through strategic partnerships
  • Cross-Functional Leadership: Collaborate closely with engineering, design, data, compliance/regulatory, and commercial teams to build and launch pilots/MVPs
  • Performance & Iteration: Define metrics and KPIs to gauge the success of newly launched products, and iterate rapidly based on feedback, usage data, and changing market dynamics
  • Regulatory & Compliance Navigation: Operate effectively within a highly regulated environment, serving as the bridge between product innovation and regulatory requirements
  • Stakeholder Management: Present product concepts, updates, and results to executive leadership and secure buy-in on product directions and investments
  • Fulltime
Read More
Arrow Right

Senior Product Manager, Pricing, Monetization and Billing Systems

As a Pricing, Monetization, and Billing Systems Product Manager at Apollo.io, yo...
Location
Location
United States
Salary
Salary:
187000.00 - 240000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in Product Management, preferably in Monetization, Billing Systems, Pricing, or Product-Led Growth (PLG) at a B2B SaaS company
  • Hands-on experience with Stripe or similar billing platforms, including subscription logic, invoicing, discounting, and pricing APIs
  • Proven success building B2B billing products for one-time and recurring use cases, including pricing models, billing runs/schedules, and subscription management, ramps, tiers, bundles, usage-based pricing etc.
  • Deep understanding of how B2B SaaS businesses transact — from self-serve purchases to enterprise contracts, renewals, and expansions
  • Demonstrated ability to build pricing governance and infrastructure, ensuring clarity and consistency across offers
  • Financial acumen: experience with profitability modeling, unit economics, and forecasting revenue impact of pricing decisions
  • Strong analytical and research skills
  • experienced with both quantitative (SQL, Looker, Amplitude) and qualitative (VoC, interviews, market studies) methods
  • Proven ability to lead cross-functional alignment with engineering, finance, GTM, and leadership teams
  • Excellent communication and storytelling skills — able to influence and drive consensus on complex pricing and system topics
Job Responsibility
Job Responsibility
  • Design and Launch Pricing & Packaging Capabilities: Own pricing and packaging initiatives end-to-end — define requirements, partner with engineering, and monitor business KPIs such as ARR, ARPU, ARPA, and NDR
  • Lead Monetization Experiments: Design and run A/B tests to optimize pricing, feature gating, freemium-to-paid conversion, upsell flows, and trial experiences
  • Drive Data-Driven Decisions: Use analytics (SQL, Amplitude, Looker) and customer research to measure and understand the revenue impact of pricing and packaging changes
  • Build Pricing Infrastructure and Governance: Create frameworks for SKU hierarchy, discounting logic, offer rationalization, and pricing governance to ensure consistency across teams
  • Inform Strategy through Market and Customer Insights: Conduct competitive pricing analysis, Win/Loss research, and Voice-of-Customer studies to inform monetization direction
  • Partner on Go-to-Market Execution: Collaborate with sales, marketing, enablement, and finance to operationalize pricing changes, build pricing tools, and deliver internal training
  • Influence and Communicate Effectively: Present monetization strategies and tradeoffs to executive leadership, ensuring alignment across product, finance, and GTM teams
  • Own Apollo’s Billing Platform: Define and evolve Apollo’s end-to-end billing capabilities across one-time and recurring billing, subscriptions, invoicing, discounts, bundles, and SKU catalog
  • Partner with Engineering to Build Scalable Billing Systems: Translate business needs into product requirements that enable flexible billing runs, pricing schedules, and recurring/one-time models on Stripe
  • Build Advanced Billing Models: Implement pricing constructs such as tiers, ramps, bundles, and usage-based components in a unified billing architecture
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • at least 10 paid holidays per year, flex PTO, and parental leave
  • employee assistance program and wellbeing benefits
  • global travel coverage
  • life/AD&D/STD/LTD insurance
  • FSA/HSA and medical, dental, and vision benefits
  • Fulltime
Read More
Arrow Right

Senior Product Manager - CORTRAK Specialty Nutrition Systems, North America

Senior Product Manager role for CORTRAK Specialty Nutrition Systems, North Ameri...
Location
Location
United States , Alpharetta
Salary
Salary:
Not provided
avanos.com Logo
Avanos
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree required
  • At least 7 years of product management and sales experience in the health care industry (or other regulated industry)
  • Ability to travel at least 25%
  • Ability to manage cross-functional teams without direct reporting relationships
  • Ability to collaborate successfully and influence decisions
  • Exceptional written, verbal and communication skills
  • Experience in forecasting and demand planning
  • Development of strategic business plans
  • Development of key tactics and execution plans that drive strategic goals
  • Ability to assess the market and competitive landscape
Job Responsibility
Job Responsibility
  • Provides leadership to the Specialty Nutrition Systems product portfolio managing the CORTRAK and CORGRIP businesses with a focus on growing these categories through the development and execution of the strategic business/ marketing plans
  • To be successful in the role this will require developing a financial budget that drives growth and is achieved each calendar year
  • This individual will also drive the development and execution of the business/ marketing plans that will include market assessments, pricing strategy, key GPO/IDN strategies and competitive landscape
  • This role will also have responsibility for key customer management, new product launches, developing and running SABs (Sales Advisory Boards), improving GP and OP, tradeshow management and advising Global Strategic Marketing on future pipeline decisions
  • Assist in the development and execution of effective plans and programs, both strategic and tactical, to drive net sales, operating profit, and market share for categories
  • Maintain full P&L management responsibility for product portfolios
  • Develop long-term strategic business plans and marketing plans for product portfolio segments
  • Develop pricing strategies that support the growth and profitability of the business
  • Collaborate with Sales, Planning and Finance teams to develop timely and accurate forecasts to ensure required fill rates on existing and new products, supporting sector goals to improve return on working capital and working closely with sales team to develop a financial and demand forecast with a high degree of accuracy
  • Support in the development of GPO/ IDN strategies to grow and maintain the business
What we offer
What we offer
  • benefits on day 1
  • free onsite gym
  • onsite cafeteria
  • HQ region voted 'best place to live' by USA Today
  • uncapped sales commissions
  • generous 401(k) employer match of 100% of each pretax dollar you contribute on the first 4% and 50% of the next 2% of pay contributed with immediate vesting
  • Fulltime
Read More
Arrow Right

Senior Technical Product Marketing Manager

We are seeking an enthusiastic Senior Technical Product Marketing Manager to dev...
Location
Location
United States
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in Service Management, along with hands-on experience in implementing Service Management solutions
  • Over 7 years of experience in technical product marketing, solutions consulting, implementation, sales engineering, or product management, preferably within ITSM, ESM, or ITOM software sectors
  • A comprehensive understanding of the priorities and needs of ITSM and IT operations leaders
  • Exceptional communication skills
  • proficient in presenting and demonstrating the value of products and solutions to IT buyers, influencers, and internal stakeholders
  • Outstanding public speaking and presentation abilities, capable of engaging and inspiring diverse audiences. Demonstrates confidence in both practices and products
  • Strong networking and relationship-building skills. Proficient in establishing trusted relationships with analysts and other influencers through product and solution briefings, demonstrations, evaluations, and engagement in online communities and social media
  • Experience representing organizations at industry events and conferences
  • Relevant certifications in ITSM or related fields are advantageous
Job Responsibility
Job Responsibility
  • Develop compelling, differentiated, and feature-accurate content and messaging that effectively highlights the Atlassian Service Management solution
  • Represent the organization at industry conferences, seminars, and events, delivering presentations and participating in panel discussions
  • Establish and maintain relationships with key stakeholders, including industry leaders, partners, and prospective clients
  • Remain informed about industry trends and advancements to ensure our solutions remain competitive and relevant
  • Serve as a spokesperson for the organization, providing insights and thought leadership on Service Management practices and innovations
  • Engage directly with senior leadership teams at our largest customers to facilitate their understanding of the transition to the Atlassian Service Management solution, emphasizing the integration of practices, personnel, and product
  • Collect feedback from external engagements to inform product development and strategic initiatives
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • bonuses
  • commissions
  • equity
  • Fulltime
Read More
Arrow Right

Senior Manager, Product Analytics

As we scale, we’re investing deeply in data, experimentation, and analytics to i...
Location
Location
United States , New York
Salary
Salary:
200000.00 - 230000.00 USD / Year
clearme.com Logo
Clear
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years experience in product analytics, data science, business analytics, or related fields with 2+ years leading teams
  • Proven track record standing up or significantly scaling product analytics and experimentation capabilities in a tech or consumer product environment
  • Fluency in SQL, experiment design (statistical rigor, power analysis, etc.), attribution, funnel & cohort analysis, and metric design
  • Experience with leading decisions around third party experimentation tooling
  • Strong hands-on experience with product analytics tools (e.g. Heap, Amplitude, Mixpanel, etc.) and BI / dashboarding systems
  • Solid understanding of data infrastructure, ETL pipelines, event logging, data governance, and how to ensure data integrity
  • Exceptional communicator: you can translate complex analyses into clear, compelling narratives that drive decisions
  • Strategic but pragmatic: you know when to ship “good enough” and when to perfect
  • Bias for action, comfort with ambiguity, and willingness to get your hands dirty
  • Leadership presence, collaborative spirit, and the ability to influence across functions
Job Responsibility
Job Responsibility
  • Drive adoption of CLEAR’s front-end measurement and tracking framework: taxonomy, event definitions, data governance, instrumentation standards
  • Standardize the workflow around experimentation across our product surfaces
  • Build reliable analytics pipelines in collaboration with Data Engineering, ensuring data quality, consistency, and scalability
  • Define and socialize core metrics and KPIs across product lines and verticals
  • Deliver dashboards and analyses that distill complexity into clarity for product teams, leadership, and business stakeholders
  • Create frameworks for feature evaluation, long-term holdout analyses, funnel optimization, and user behavior deep dives
  • Empower teams via self-service tooling and documented analytics processes
  • Build learning loops: lead post-mortems, root-cause analyses, and knowledge sharing across the org
  • Build, lead, and grow a team of product analysts and data scientists
  • Mentor and elevate analyst capabilities
What we offer
What we offer
  • Competitive compensation
  • Equity
  • Professional development support
  • Comprehensive healthcare plans
  • Family-building benefits (fertility and adoption/surrogacy support)
  • Flexible time off
  • Annual wellness stipend
  • Free OneMedical memberships for you and your dependents
  • A CLEAR Plus membership
  • 401(k) retirement plan with employer match
  • Fulltime
Read More
Arrow Right