CrawlJobs Logo

Manager, Content Engineering — AI Content Understanding

United States, Menlo Park Employment contract 162000.00 - 227000.00 USD / Year · Job Posted May 05, 2026
Apply Position
Job Link Share

Job Description

Product Content Engineering is a horizontal function supporting initiatives across Meta's Family of Apps. We partner closely with product and technical teams to solve problems by providing content-centered solutions, setting standards of quality, and building the frameworks that ensure AI-powered experiences actually work for people. We're looking for a people manager to lead a team within PCE's AI Content Understanding group. This team is responsible for executing evaluations and improving the quality of Meta's content understanding models — the AI systems that understand what content is about and how it should be ranked, recommended, and moderated. The work spans content quality, AI evaluation, and the search and recommendation systems that power Meta's products — building the frameworks, rubrics, and pipelines that hold AI outputs to a high standard. Your team assesses model behavior, identifies where it falls short, and works cross-functionally with engineering, product, research, and data science teams to make it better. Reporting to the AI CU lead, you'll manage a team of Content Engineers and contingent workers, owning the day-to-day execution of human evaluations, golden dataset creation, auto-eval calibration, and cross-functional delivery with engineering, data science, and product partners. You'll drive operational rigor while navigating a fast-moving environment where evaluation frameworks, model capabilities, and team processes are evolving simultaneously.

Job Responsibility

  • Manage and develop a team of Content Engineers and contingent workers, setting clear goals, providing regular feedback, and supporting career growth
  • Own the execution of continuous CU model evaluations — coordinating sprint planning, reviewer assignments, QA processes, and delivery timelines across multiple concurrent workstreams
  • Drive the creation and maintenance of golden datasets that serve as ground truth for model benchmarking and auto-eval calibration
  • Partner with engineering, data science, and product teams to translate evaluation insights into actionable recommendations for model improvement and prompt optimization
  • Lead the team's contribution to LLM-as-a-Judge (auto-eval) initiatives — ensuring human evaluation data is used to calibrate, validate, and improve automated evaluation systems
  • Define and maintain evaluation guidelines, rubrics, and quality standards in partnership with Lead Content Engineers, ensuring consistency across reviewers and use cases
  • Build repeatable operational processes for evaluation sprints, including reviewer training, calibration sessions, and escalation workflows
  • Manage CW workforce planning — hiring, onboarding, allocation across workstreams, and performance management
  • Synthesize evaluation results into structured reports and present findings to cross-functional leadership, including engineering leads and lead product stakeholders
  • Identify and mitigate operational risks — staffing gaps, timeline conflicts, quality regressions — before they impact delivery

Requirements

  • 8+ years of experience in content strategy, content operations, AI evaluation, or a related field
  • 2+ years of people management experience, including hiring, developing, and performance-managing direct reports
  • Experience managing cross-functional programs with engineering, data science, and product partners in fast-paced environments
  • 1+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or content labeling and analysis
  • Experience designing or operationalizing evaluation frameworks, annotation guidelines, or quality rubrics for AI/ML systems
  • Demonstrated ability to manage multiple concurrent workstreams with competing priorities and tight deadlines
  • Proven analytical skills with experience interpreting evaluation data and communicating findings to technical and non-technical audiences
  • Track record of building team operational processes and quality standards from the ground up or during periods of significant change

Nice to have

  • Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
  • Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
  • Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
  • Experience managing contingent worker (CW) teams, vendor relationships, or scaled annotation operations
  • Familiarity with AI evaluation methods such as human eval, LLM-as-judge, model benchmarking, A/B testing, or red-teaming
  • Experience with Python, SQL, or other tools for data analysis and evaluation automation
  • Background in content understanding, search quality, recommendation systems, or trust and safety
  • Experience managing through organizational transitions, including shifts from manual to automated workflows
  • BA or BS in Computer Science, Data Science, Linguistics, or related field

What we offer

  • bonus
  • equity
  • benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Manager, Content Engineering — AI Content Understanding

8 matching positions

Forward Deployed AI Engineering Manager, Enterprise

As a Forward Deployed AI Engineering Manager on our Enterprise team, you'll be t...
Location
Location
United States , San Francisco; New York
Salary
Salary:
216000.00 - 270000.00 USD / Year
scale.com Logo
Scale
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software engineering experience
  • 2+ years of Management experience with strong fundamentals in data structures, algorithms, and system design
  • Production Python expertise with experience in modern ML/AI frameworks (e.g., LangChain, LlamaIndex, HuggingFace, OpenAI API)
  • Experience with cloud platforms (AWS, GCP, or Azure) and modern data infrastructure
  • Strong problem-solving skills with the ability to navigate ambiguous requirements and rapidly iterate toward solutions
  • Excellent communication skills with the ability to explain complex technical concepts to both technical and non-technical audiences
Job Responsibility
Job Responsibility
  • Partner directly with enterprise customers to understand their technical infrastructure, data pipelines, and business requirements
  • Design and implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
  • Build robust data connectors and ETL pipelines to ingest, process, and prepare customer data for AI workflows
  • Deploy and configure AI models and agents within customer security and compliance boundaries
  • Develop production-grade AI agents tailored to customer use cases across domains like customer support, data analysis, content generation, and workflow automation
  • Architect multi-agent systems that orchestrate between different models, tools, and data sources
  • Implement evaluation frameworks to measure agent performance and iterate toward business objectives
  • Design human-in-the-loop workflows and feedback mechanisms for continuous agent improvement
  • Create sophisticated prompt engineering strategies optimized for customer-specific domains and data
  • Build and maintain prompt libraries, templates, and best practices for customer use cases
What we offer
What we offer
  • Comprehensive health, dental and vision coverage
  • retirement benefits
  • a learning and development stipend
  • generous PTO
  • equity grant
  • commuter stipend
  • Fulltime
Read More
Arrow Right

Growth Marketing Manager, AI Creative & Content Systems

The way growth marketing content gets made is fundamentally changing, and this r...
Location
Location
United States , New York
Salary
Salary:
89400.00 - 167500.00 USD / Year
block.xyz Logo
Block
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of experience in growth marketing, with a strong foundation in paid creative strategy, content strategy, or performance marketing
  • A sharp creative and editorial eye: you can evaluate visual design, ad copy, and long-form content with confidence, identifying what works, what doesn't, and why. You know great creative when you see it, and you can articulate what makes it great.
  • Strong writing and visual sensibility: you're capable of producing high-quality written content and evaluating visual creative, even when using AI to assist. You understand composition, messaging hierarchy, and brand voice.
  • Demonstrated, hands-on experience building and deploying AI-powered workflows for creative or content production. Not just using AI tools, but architecting agentic, multi-step systems around them
  • Strong understanding of paid media creative best practices across major platforms, with the ability to translate performance data into actionable creative direction
  • Experience designing and running structured creative testing programs, with a data-driven approach to measuring and optimizing ad creative and content performance
  • Experience developing content strategies that drive organic visibility, including an understanding of SEO fundamentals and emerging AI-enhanced search optimization (AEO)
  • Proven ability to collaborate cross-functionally with creative, design, product, and engineering teams to ship work on a consistent cadence
  • A builder mindset: you're comfortable prototyping new workflows, evaluating emerging tools, and shipping MVPs before perfecting them
Job Responsibility
Job Responsibility
  • Design, build, and maintain agentic AI workflows that generate paid creative assets, web landing pages, and editorial content at scale
  • Own the end-to-end creative and content production pipeline from brief development through AI-assisted generation, quality review, and deployment, ensuring a reliable, repeatable system that ships on schedule
  • Serve as the creative and editorial quality filter for all AI-generated output, ensuring every asset is on-brand, strategically sound, and meets Cash App's standards for visual and written excellence
  • Collaborate with creative strategists and growth marketers to translate campaign briefs and performance insights into AI-generated creative variations and content that resonate with audiences
  • Design and execute structured creative testing frameworks to continuously improve paid creative performance and inform AI-generated iterations
  • Analyze paid creative and organic content performance, connecting asset-level data to full-funnel metrics to refine AI-generated outputs and demonstrate efficiency gains
  • Develop and execute content strategies that increase organic visibility and traffic through SEO and AI-enhanced search optimization (AEO)
  • Establish quality standards, review processes, and governance frameworks to ensure AI-generated content meets brand, legal, compliance, and performance requirements in a regulated financial services environment
What we offer
What we offer
  • Remote work
  • medical insurance
  • flexible time off
  • retirement savings plans
  • modern family planning
  • Fulltime
Read More
Arrow Right

Senior Technical Program Manager, Media Content Engineering

The Senior Technical Program Manager, Media Content Engineering (‘MCE’) will be ...
Location
Location
United States , New York; Los Angeles; Oakland; Washington; Atlanta
Salary
Salary:
134100.00 - 169000.00 USD / Year
siriusxm.com Logo
SiriusXM
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, engineering, or equivalent work experience
  • Deep experience in leading large-scale technology initiatives within tight deadlines and complex interdependencies
  • Strong architecture literacy
  • Minimum 5 years of experience in managing engineering programs across multiple cross-functional teams, building processes, and coordinating release schedules
  • Minimum 8 years of managing large-scale programs across broadcast and media infrastructure teams, cloud and on-premise operations, content acquisition and distribution, playback flows for live, near-live, and VOD media, and consumer-facing apps
  • Minimum 5 years of senior program management experience, with experience in executive leadership alignment and communication
  • Strong propensity toward relationship building
  • Experience working with multiple Agile methodologies
  • Experience with automation and/or AI tools such as ChatGPT, Gemini, etc.
  • Must have legal right to work in the U.S.
Job Responsibility
Job Responsibility
  • Drive strategic large-scale engagements within Media Content Engineering
  • lead Program resource to ensure project success
  • Implement and manage triage, prioritization, and implementation of projects using JIRA boards
  • manage engineering resources and drive efficiencies across the organization
  • Anticipate systemic risks and long-term impact to influence strategy and prioritization
  • Apply technical understanding to ask the right questions, validate assumptions, anticipate pitfalls, and identify when solutions may impact downstream systems
  • Establish partnerships across technical leads and key stakeholders across engineering, quality, and content teams to provide connective end-to-end flow perspectives in key deliverables for our flagship Sirius XM product
  • Coordinate a program to drive a roadmap of foundational platform changes, including AWS and on-premise subsystems, to support live and on-air workflows, replay management, licensing and rights management, content entitlements, data reporting accuracies, and general content-specific reporting needs
  • Lead cross-functional communications, inclusive of change management and initiative status reporting
  • Frame tradeoffs, options, and risks clearly to help teams and leaders make informed decisions quickly
What we offer
What we offer
  • discretionary short-term and long-term incentives
  • Fulltime
Read More
Arrow Right

AI Research & Content Manager

Yotpo is leading the next era of trust and loyalty in eCommerce. With AI-powered...
Location
Location
United States , New York
Salary
Salary:
110000.00 - 120000.00 USD / Year
yotpo.com Logo
Yotpo
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years in B2B SaaS content marketing, product marketing, market research, or similar
  • Research expertise: Track record designing studies, analyzing data, and creating compelling narratives
  • Customer storytelling: Portfolio of exceptional case studies showcasing business impact
  • Outstanding writing: Can write for technical and executive audiences across formats
  • Extreme autonomy: Self-starter who identifies opportunities, builds plans, and executes independently
  • eCommerce/martech experience: Understanding of how DTC brands drive growth and measure ROI
Job Responsibility
Job Responsibility
  • Original Research & Thought Leadership: Design and execute proprietary research studies on AI search trends, consumer behavior, and AEO impact
  • Analyze Discover product data to uncover market insights and media-worthy stories
  • Create research reports, infographics, and narratives that generate coverage in AdWeek, TechCrunch, Retail Dive
  • Identify emerging trends in AI search and translate them into content opportunities
  • Customer Success Stories & Case Studies: Build relationships with Discover customers and conduct interviews to extract compelling success stories
  • Write comprehensive case studies showcasing quantifiable business impact (traffic growth, AI citations, revenue)
  • Develop multi-format customer content: case studies, video testimonials, quote cards, sales deck snippets
  • Create a library of proof points organized by industry, use case, and business outcome
  • Partner with Customer Success to identify reference customers and advocacy opportunities
  • Educational Content Creation: Write authoritative long-form content: ebooks, guides, whitepapers, playbooks on AEO best practices
What we offer
What we offer
  • Category ownership: Lead Yotpo’s thought leadership in Answer Engine Optimization
  • Direct impact: Your work shapes how the market perceives Discover and AEO
  • Autonomy: Freedom to experiment with formats, methodologies, and strategies
  • Access: Direct partnership with Product team and high-performing customers
  • Visibility: Public-facing, high-profile work that builds your personal brand
  • Ground-floor opportunity: Define this function as Discover scales
  • Fulltime
Read More
Arrow Right

Digital Content & Experience Content Manager

We are seeking a Digital Content & Experience Manager to own the end-to-end comm...
Location
Location
United States , Austin
Salary
Salary:
92000.00 - 138000.00 USD / Year
amd.com Logo
AMD
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong B2B content strategist with experience connecting product value to customer needs
  • Experience owning or managing web platforms or digital ecosystems
  • Deep understanding of content strategy, UX, and search
  • Experience with web analytics and performance tools (e.g., Google Analytics 4, Microsoft Clarity)
  • Data-driven, with the ability to turn insights into action
  • Effective at navigating cross-functional, global environments
Job Responsibility
Job Responsibility
  • Own Commercial Client Digital Journey: Define and lead the end-to-end content and experience strategy for commercial client and AMD.com, ensuring content connects ITDM pain points to AMD value proposition across all stages of the funnel
  • Design and optimize conversion paths, ensuring content and experiences drive lead generation and pipeline impact
  • B2B Content Strategy & Messaging: Develop scalable content frameworks grounded in audience needs, search behavior and marketing trends
  • Partner with product marketing to shape clear, consistent messaging across the digital experience
  • Identify content gaps and opportunities to improve relevance, clarity and impact
  • Experience Design, UX & Optimization: Own page structure, messaging hierarchy, and user flows to improve engagement and conversion
  • Optimize how users discover, navigate, and interact with content
  • Lead content audits lifecycle management, and continuous experience improvements
  • Search & AI-Driven Discoverability: Ensure content is optimized for SEO, generative engine optimization (GEO), and evolving discovery behaviors
  • Use search, AI, and platform insights to inform strategy and uncover demand opportunities
  • Fulltime
Read More
Arrow Right

Engineering Director, AI Solutions and Automation (ASA)-AI Product Acceleration

We are seeking a highly accomplished Engineering Director with extensive technic...
Location
Location
United States , Bellevue, WA
Salary
Salary:
271000.00 - 347000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of experience growing and leading successful Engineering teams, with a proven ability to recruit, land, and grow both engineering technical managers and individual contributors
  • Extensive expertise (15+ years) in Machine Learning (ML), and Artificial Intelligence (AI), with a history of functioning as a technical leader or lead architect on production systems
  • Extensive experience building and deploying complex, large-scale, distributed AI/ML software systems from the ground up
  • Experience as a great collaborator, building models and processes for aligning work across large, multi-disciplinary teams (Engineering, Data Science, Product Management)
  • Hands-on technical experience in relevant ML/AI languages (e.g., Python, C++) and applying data-driven methodologies to define and manage large software projects
  • Demonstrated ability to drive technical strategy and execution in cutting-edge AI domains like multi-modal processing, model evaluation, or RL-based post-training
Job Responsibility
Job Responsibility
  • Lead and manage teams of AI applied researchers and engineers, providing extensive technical guidance, mentorship, and support to ensure the successful end-to-end delivery of high-quality, scalable AI/ML systems
  • Serve as the technical authority, driving the design, development, and deployment of complex AI solutions, including LLM post-training techniques (like Reinforcement Learning and Fine-Tuning), Multi-modal Content Understanding, and Agentic AI platforms
  • Define and lead the long-term technical strategy and roadmap for large, enterprise-wide AI efforts, ensuring alignment with the ASA mission to deliver cost-efficient and performant AI models
  • Foster an environment of innovation, rapid prototyping, and technical excellence, encouraging experimentation and continuous improvement in the pursuit of SoTA performance
  • Identify new, high-leverage opportunities for LLM-based automation across Meta's product portfolio and influence cross-functional partners for appropriate staffing and prioritization
  • Supervise the development of AI-centric platforms, such as the AI Evaluation and scalable inference and serving infrastructure for 1P, 2P, and 3P models
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Content Manager, Localization

Tripadvisor is looking for a Content Manager for our French market to develop ou...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
tripadvisor.com Logo
Tripadvisor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Native-level fluency and cultural authority: A deep, intuitive understanding of the language, culture, and user behaviour in your market
  • 5+ years of experience: You worked in a localization, UX writing, transcreation, translation, content design, or related role within a global ecommerce or tech company. Experience in the travel industry is a significant plus
  • Open-minded, innovative approach: You use AI as an enabler and you have a curious, forward-thinking mind. You are comfortable experimenting with technology to automate the repetitive so you can focus on the creative
  • Excellent command of localization practices: You master foundational internationalization and localization principles. You have 3+ years experience of working with translation management systems and you have familiarity with linguistic quality assurance frameworks (MQM or similar)
  • A solid understanding of UX content methodologies: You are comfortable working with design tools (e.g., Figma, Miro), analyzing user research, and using data to inform your decisions
  • Strong communication and collaboration skills: You build strong, collaborative relationships with cross-functional colleagues, using data and user insights to demonstrate how localized content strategy serves as a primary engine for global growth
  • Demonstrated ability to use AI tools to improve efficiency, quality, and decision-making in day-to-day work
  • Proven ability to operate effectively with a global-first mindset
Job Responsibility
Job Responsibility
  • Craft, Adapt & Refine: Localize, write, edit, and transcreate clear, culturally-relevant, compelling content across all user-facing touchpoints. You’ll own the voice of your market, ensuring content is resonant, persuasive, and local-first
  • Shape the Content Strategy: Partner with product managers, UX designers, SEO, vendors, and researchers to define and execute content strategies for high-priority product features, from initial concept to launch
  • AI-native localization: manage LLM-driven workflows, help design prompts, and leverage machine translation to protect quality, maximize efficiency, and scale content volumes
  • Think as a user: Act as the voice of the traveller. You’ll synthesize local user research and market trends to challenge global assumptions and advocate for local user needs
  • Drive impact through testing: Initiate and support A/B tests on localized content to measure the impact on conversion, engagement, and traffic to inform content strategies
  • Collaborate and Iterate: Work seamlessly with cross-functional teams to ensure content is integrated into the design and development process from the beginning. Provide regular feedback to your global colleagues and contribute to a unified content strategy
  • Own and Maintain Quality: Ensure all content adheres to Tripadvisor Group’s brands voice and tone while feeling completely natural to local users. Partner with translation vendors to create, maintain and optimize all linguistic assets for your market
  • Champion usability: Operate within a continuous QA mentality to keep the UX fresh and relevant. Proactively identify and fix content-related issues in our product, making data-driven, user-centric recommendations for improvements
What we offer
What we offer
  • Competitive compensation packages (routinely benchmarked against the latest industry data), including base salary and annual bonuses
  • “Work your way” with flexibility to suit your lifestyle. Tripadvisor Group takes a remote-friendly approach to collaboration across a worldwide team, with the option to join on-site as often as you’d like or as required by your team
  • Flexible schedule. Work-life balance is ingrained in our culture by design. Trust and accountability make it work
  • Donation matching. Give back? Give more! We match qualifying charitable donations annually
  • Tuition assistance. Want to level up your career? We love to hear it! Receive annual support for qualified programs
  • Lifestyle benefit. An annual benefit to spend on yourself. Use it on travel, wellness, or whatever suits you
  • Travel perks. We believe that travel is employee development, so we provide discounts and more
  • Employee assistance program. We’re here for you with resources and programs to help you through life’s challenges
  • Health benefits. We offer great coverage and competitive premiums
  • Generous referral scheme. Help us grow and be rewarded with generous awards for referring successful candidates
  • Fulltime
Read More
Arrow Right

Engineering Manager, Machine Learning

We are looking for an Engineering Manager, Machine Learning to lead a team of ML...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in machine learning engineering, with a strong track record of shipping models to production in consumer-facing products (recommendations, search, ads, personalization, or similar domains)
  • Experience managing an ML or software engineering team
  • BS/MS in Computer Science, Mathematics, Statistics, or a related quantitative field
  • Deep expertise in recommendation system architectures, deep neural networks, and ranking models
  • Strong software engineering fundamentals and experience writing production-quality code
  • Experience with large-scale ML tooling and infrastructure: PyTorch/TensorFlow, Spark, Airflow, cloud-native MLOps platforms
  • Experience with multi-objective optimization, reinforcement learning, or Bayesian methods in production settings
  • Familiarity with LLM-based approaches for recommendations, content understanding, or generative personalization
  • Demonstrated ability to connect ML work to measurable product and business outcomes
  • Experience building and scaling ML teams in a distributed or multi-site setting
Job Responsibility
Job Responsibility
  • Lead, mentor, and grow a team of ML engineers
  • foster a culture of technical excellence, ownership, and collaboration
  • Set the technical roadmap, aligning priorities across the team and within the broader Recommendations organization
  • Drive system design and architecture decisions for ML models powering content ranking, user modeling, multi-objective optimization, and personalization across Roku's key surfaces
  • Provide technical leadership on model architecture choices, training and serving infrastructure, and evaluation methodologies
  • Own the A/B experimentation and measurement strategy for your team's surfaces
  • ensure ML work is tied to measurable product and business outcomes
  • Champion the adoption of generative AI to push the boundaries of recommendation and personalization
  • Partner with Product, Engineering, and cross-functional stakeholders to translate business goals into ML solutions
  • Recruit and develop ML talent in Bengaluru
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • Local benefits include statutory and voluntary benefits which may include healthcare (medical, dental, and vision)
  • Life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Employees are supported in taking time off, in accordance with local leave policies and other personal needs
  • Fulltime
Read More
Arrow Right