Senior Manager, Data Science - LLM Customization Team Job at Capital One (New York)

Senior Manager, Forward-Deployed Data Science

The Research, Analytics & Data Science (RAD) team at Intercom uses data and insi...

Location

Ireland; United Kingdom , Dublin; London

Salary:

Not provided

Intercom

Expiration Date

Until further notice

Requirements

Proven ability to drive strategic, data-driven outcomes in complex, real-world business environments - ideally in customer-facing or enterprise contexts
Strong leadership in ambiguous, high-stakes environments - able to set strategy, prioritize, and guide a team through fast-evolving challenges and opportunities
Deep customer empathy and executive communication skills, with the ability to influence senior stakeholders, guide AI adoption strategy, and simplify complexity
Track record of building and scaling technical solutions using AI/ML, especially in areas like LLM applications, conversational AI, or intelligent automation
Strong SQL and fluency in Python/R, with experience applying analytical, statistical, and AI/ML techniques to business problems
Experience evaluating and deploying LLM-driven or conversational AI systems, including measurement frameworks and reliability assessments
Demonstrated ability to prototype quickly, balancing rigor with speed to accelerate customer outcomes

Job Responsibility

Drive the adoption of Fin by helping customers automate and scale their support operations
Embed with strategic customers to understand their support workflows, data, and business challenges - to identify and implement opportunities where AI can deliver measurable impact
Steer customers toward best practices in measurement and AI adoption to realize the full value of Fin
Partner closely with Sales, Success, and Product to deliver seamless customer experiences and successful deployments, and to create feedback loops that shape product development
Use AI to prototype, test, and scale data-driven solutions, building tools that make us faster and more effective in driving Fin adoption and customer impact

What we offer

Competitive salary and equity in a fast-growing start-up
We serve lunch every weekday, plus a variety of snack foods and a fully stocked kitchen
Regular compensation reviews - we reward great work!
Pension scheme & match up to 4%
Peace of mind with life assurance, as well as comprehensive health and dental insurance for you and your dependents
Flexible paid time off policy
Paid maternity leave, as well as 6 weeks paternity leave for fathers, to let you spend valuable time with your loved ones
Cycle-to-Work Scheme
MacBooks are our standard, but we also offer Windows for certain roles when needed

Fulltime

AI Product Manager

We’re scaling AI and machine learning across our products, devices, and operatio...

Location

United States , Boston

Salary:

121300.00 - 177900.00 USD / Year

SimpliSafe

Expiration Date

Until further notice

Requirements

8+ years of product management experience, including significant ownership of AI/ML or data-intensive products
Clear track record of shipping production ML systems (not just integrating third-party AI APIs), in close partnership with data science, ML engineering, and MLOps
Principal-level impact: leading cross-team initiatives, shaping strategy, and influencing senior stakeholders
Strong understanding of core ML concepts and lifecycle: data, labeling, training/validation, evaluation metrics, deployment, monitoring, and retraining
ML experience with at least one of following: computer vision or sensor data, LLM-powered applications (prompting, RAG, fine-tuning, evaluation) and/or hardware or edge products (e.g., on-device models, connectivity/latency trade-offs)
Familiarity with modern ML infrastructure (cloud platforms, model serving, CI/CD for ML, monitoring/alerting)
Comfortable going deep into data, metrics, and model behavior—not just the UX layer
Excellent communicator who can make complex AI topics clear to diverse audiences
Strong alignment with our values: customer-obsessed, low ego, highly collaborative, comfortable with ambiguity, and biased toward learning and iteration.

Job Responsibility

Define and communicate the multi-year roadmap for key AI/ML capabilities across SimpliSafe
Identify and prioritize AI opportunities where models and data can materially improve safety, customer experience, or efficiency—on both devices and cloud services
Make build-vs-buy decisions for AI capabilities in partnership with data science and engineering
Partner with data scientists, ML engineers, and MLOps to design and deliver end-to-end ML solutions—from problem framing through data, training, evaluation, deployment, and monitoring
Work with hardware and embedded teams to shape edge AI/ML experiences (e.g., on-device detection, low-latency decisions, bandwidth-aware designs)
Define model-level requirements (metrics, latency, cost, guardrails) and connect them to business outcomes (e.g., false alarm reduction, detection accuracy, handle time, CSAT)
Translate product needs into requirements for ML platform capabilities (model serving, observability, experiment tracking, human-in-the-loop tools)
Lead product direction for LLM and multimodal use cases (e.g., text, vision, sensor data)
Decide when to use prompt engineering, RAG, fine-tuning, or traditional ML—and how to evaluate quality, safety, and hallucinations
Design workflows that incorporate human review and escalation where needed

What we offer

A mission- and values-driven culture and a safe, inclusive environment where you can build, grow, and thrive
A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
Free SimpliSafe system and professional monitoring for your home
Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits.

Fulltime

Senior Director, Data Science

The Senior Director of Data Science will set and drive the enterprise-wide visio...

Location

United States

Salary:

135700.00 - 278300.00 USD / Year

One Call

Expiration Date

Until further notice

Requirements

Bachelor’s degree (B.A. or B.S.) in Statistics, Mathematics, Computer Science, or related quantitative field
advanced degree preferred
10+ years of experience in data science, with several years in senior leadership roles managing larger teams and enterprise-level projects
Strong problem-solving skills with an emphasis on product development and business impact
Experience using statistical computer languages (R, Python, SQL, etc.) to manipulate data and draw insights from large data sets
Knowledge of a variety of machine learning techniques (clustering, decision tree learning, artificial neural networks, etc.) and their real-world advantages/drawbacks
Knowledge of advanced statistical techniques and concepts (regression, properties of distributions, statistical tests and proper usage, etc.) and experience with applications
Excellent written and verbal communication skills for coordinating across teams and influencing senior stakeholders
A drive to learn and master new technologies and techniques
Demonstrated ability to develop and drive strategies that enhance business performance, with proven results at the enterprise level

Job Responsibility

Set and drive the enterprise-wide data science vision, ensuring alignment with executive leadership and long-term business objectives
Architect and oversee technical strategy for all data science initiatives, championing innovation in AI/ML methodologies and platforms
Lead the design, development, and deployment of ML models, focusing on advanced techniques such as Natural Language Processing (NLP), generative AI, and automation
Own the development and governance of a modern data platform for all data consumers
Lead LLM integration projects to automate manual processes and improve operational efficiency
Stay current with emerging technology trends and represent the organization in external forums, conferences, and industry groups
Collaborate with senior leaders across IT, Product, Operations, Marketing, and other business units to identify and execute high-impact, cross-functional data initiatives
Drive AI solutions for automation, decision intelligence, and enhanced customer experience
Translate complex data insights into actionable business strategies and measurable outcomes
Manage larger, multi-disciplinary teams, mentoring and developing future leaders within the data science organization

What we offer

Remote Work: We are a remote-first company, and almost all positions receive the flexibility of working from home
Generous Time Off: Besides 8 company holidays and 2 personal days every year, all colleagues receive a minimum of 18 days of paid time off
Comprehensive Benefits Package: Including medical, dental, vision, and pet insurance
401(k) matching program
and company-paid life insurance and short and long-term disability coverage
Supportive Services: We offer a Colleague Assistance Program that provides free counseling and financial services, and our One Call Foundation, a non-profit arm of our company, provides colleagues financial assistance during times of unexpected hardships

Fulltime

Senior Data Scientist

M365 Copilot Cadets (Customer & Analytics‑Driven Eval Team) turns real‑world cus...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Doctorate in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 1+ year(s) data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
OR Master's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 3+ years data-science experience
OR Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 5+ years data-science experience
OR equivalent experience
Experience with building data pipelines, performing large-scale analysis, and implementing ML workflows using Python and SQL
Experience in developing models or designing evaluation frameworks, including A/B testing or prompt-based assessments for LLMs
Ability to meet Microsoft, customer and/or government security screening requirements
This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Job Responsibility

Evaluation & Feedback Analysis: Convert multi‑source feedback (dogfood, VIP customers, production traces) into a prioritized dataset of 10–100 tasks per scenario, each with prompts and golden outputs
maintain a living failure taxonomy prioritized by volume × impact × fixability
Rubrics & LLM‑as‑Judge: Author crisp, binary‑first rubrics across 7–30 dimensions (e.g., correctness/completeness, refusal calibration, tool‑use quality, formatting/contract, persona/tone, trace hygiene)
Build grader prompts (with few‑shots and counter‑examples) that achieve ≥80% human‑match rate, track TPR/TNR on held‑out sets, and prevent reward hacking
Synthetic & Human‑Labeled Data: Design structured tuples to scale high‑signal synthetic data
orchestrate vendor/partner annotation sprints and live calibrations to align shared judgment
Ensure datasets are reproducible with linked artifacts and robust metadata/trace hygiene
Customer‑Grounded Scenarios: Partner with PMs/solution architects to co‑develop evals with VIP customers so tasks reflect real outcomes and workflows
quantify lift from fixes and inform the next hill‑climb
Team Leadership & Ways of Working: Co‑own the Cadets “feedback flywheel” with PM/Eng (instrumentation, taxonomy, guardrails vs. evaluators) and help operationalize weekly checklists, change logs, and judge refresh cadence

Fulltime

Senior Consultant - Data Science (Customer Data)

Join our frog data team and help shape the future of data and AI consulting. We ...

Location

United Kingdom , London

Salary:

Not provided

frog

Expiration Date

Until further notice

Requirements

Expert in building and evaluating Generative AI solutions and Large Language Models (LLMs) for various use cases
Experience in developing and implementing machine learning models, including predictive, forecasting, classification, and deep learning models
Hands-on experience in customer behaviour analytics, marketing, commercial, web, or product analytics with core focus in customer experience
Experience in working with various data sets, including transactional/EPOS, digital, social and loyalty
Proven experience owning workstreams including planning, execution, and successful delivery of insights or AI/ML POCs, MVPs and production grade solutions
Skilled in using programming languages such as Python
Knowledge of cloud platforms and tools for data science and machine learning
Utilise visualisation tools such as Power BI or Tableau to present data insights effectively
Collaborate with cross-functional teams to understand business challenges and create valuables products/solutions
People management skills, including mentoring, guiding, and developing junior team members

What we offer

Flexible working arrangements
Positive work-life balance
Hybrid working
Mental health support via trained 'Mental Health Champions'
Access to wellbeing apps such as Thrive and Peppy
Flexible benefits options
Variable compensation dependent on grade and on company and personal performance

Vice President, Global Analytics & Data Science

The Vice President, Global Analytics & Data Science, will define, scale, and lea...

Location

United States , Las Vegas, NV; Austin, TX

Salary:

262028.00 - 486623.00 USD / Year

Aristocrat Gaming

Expiration Date

Until further notice

Requirements

15+ years of dynamic experience in analytics, data science, or data-driven transformation
5+ years in senior or executive leadership roles within analytics, data science, or data-driven transformation
Consistent record of defining and delivering enterprise analytics strategies that drive measurable business impact
Demonstrated experience building and scaling analytics and data science platforms
Expertise in AI/ML technologies, including predictive modeling, generative AI, and advanced analytics methodologies
Strong understanding of ML Ops practices, including model deployment, governance, monitoring, and lifecycle management
Experience leading global, cross-functional teams spanning analytics, data science, and engineering
Confirmed ability to collaborate effectively with product, technology, and commercial organizations to translate data and AI capabilities into business solutions
Excellent communication and storytelling skills — able to influence C-suite collaborators and translate sophisticated analytics and AI concepts into strategic insights
Strong familiarity with modern data and analytics stacks, cloud platforms (e.g., AWS, GCP, Azure, Snowflake), and visualization tools (e.g., Tableau, Power BI, Looker). (Sql knowledge, conceptual, not daily coding)

Job Responsibility

Define and implement an enterprise analytics strategy that enables a scalable, customer-facing Analytics-as-a-Service operating model
Establish service models, engagement patterns, prioritization frameworks, and success metrics that balance business demand, delivery capacity, and strategic value
Act as a senior advisor to business leaders and customers, setting clear expectations on scope, timelines, tradeoffs, and outcomes for analytics engagements
Building a long-term vision for analytics evolves the organization from reporting to insight-led decision enablement, including predictive and prescriptive modelling of data and responsible adoption of AI-powered analytics
Promote data storytelling as a core skill in the analytics team, making sure insights are clear, contextual, and ready for decision-making
Establish standards for visualization, narrative flow, and communication with executives across analytics outputs
Ensure analytics leaders and practitioners can turn complex analytical results into business-relevant stories that drive action at all organizational levels
Offer knowledgeable guidance on BI, analytics, and AI platforms, with a solid understanding of what high-quality, scalable analytics look like
Collaborate with data engineering and technology teams to ensure analytics platforms are reliable, user-friendly, and capable of supporting future growth
Define how AI-driven analytics (such as augmented analytics, natural language insights, and automation) can ethically improve scale, efficiency, and customer experience

What we offer

health, dental, and vision insurance
paid time off
401(k) plan with employer matching

Fulltime

Senior Data Scientist

At Vanta, our mission is to help businesses earn and prove trust. We believe tha...

Location

United States; Canada

Salary:

Not provided

Vanta

Expiration Date

Until further notice

Requirements

Have at least 4 years of experience working with data as a data scientist / analyst in an applied business context
Deep experience with data visualization
Professional experience with statistics and analytical techniques
Experience with experiment design and hypothesis testing in small n experiments
Building models for predicting the P(churn) of a customer
Building models for predicting risk
Intense curiosity about data, the world, where they match, and why they do or don’t
Product lifecycle expertise, in particular converting a product experience into a growth analytics framework
Executive communication skills. You can tell a compelling story about the status quo
Deep understanding of Product analytics stacks (Heap, Amplitude, StatSig, client stride tracking, and browser mechanics) and integration of product data with Customer Success teams

Job Responsibility

Write DBT SQL pipelines to automate and manage data assets in Snowflake for our product partners
Python/R with Hex.tech to conduct statistical analysis of product usage and engagement data
Work in Sigma Computing to find insights in our customer journey
Conduct and manage business enhancing analytical projects: defining and predicting churn, specifying and building a product
Set the bar high for what is expected of predictive analytics projects
Define the analytics practice for our Product Analytics efforts
Help craft our AI and LLM measurement practices
Lead Analytics Reviews with C-level partners

What we offer

Offers Equity
Eligible for medical benefits
401(k) plan
Other company perk programs
Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans
16 weeks fully-paid Parental Leave for all new parents
Health & wellness stipend
Remote workspace, internet, and cellphone stipend
Commuter benefits for team members who report to the SF and NYC office
Family planning benefits

Fulltime

Lead Advanced Analytics, Digital & AI Products

The Analytics Centre of Excellence (ACOE) at Airbnb, based in India, is a hub of...

Location

India , Bangalore

Salary:

2940000.00 - 4170000.00 INR / Year

Airbnb

Expiration Date

Until further notice

Requirements

Min 8 or more years in industry experience and a degree (Masters or PhD is a plus) in a quantitative field (e.g., Statistics, Econometrics, Computer Science, Engineering, Mathematics, Data Science, Operations Research)
Expert communication and collaboration skills with the ability to work effectively with internal teams in a cross-cultural and cross-functional environment. Ability to conduct rigorous analysis and communicate conclusions to both technical and non-technical audiences
Strong expertise in Python, SQL, A/B testing platforms and best practices
Expertise in EDA, hypothesis testing, significance testing, regression, clustering techniques, concepts of NLP/Text Mining, machine learning and deep learning techniques, language model fine-tuning etc
Understanding of LLM architectures (e.g., prompt chains, retrieval augmentation, orchestration frameworks like LangChain or DSPy)
Data engineering foundations, including ability to work with data engineering teams on pipeline design, metric computation jobs, data model changes, and maintaining reliable end-to-end metric systems
Familiarity with Agentic AI systems, human-in-the-loop design, and AI observability best practices
Experience partnering with internal teams to drive action and providing expertise and direction on analytics, data science, experimental design, and measurement
Experience designing and building metrics, from conception to building prototypes with data pipelines

Job Responsibility

Data thought partner to product and business leaders across marketplace teams through providing insights, recommendations, and enabling data informed decisions
Drive day to day product analytics and build scalable analytical solutions
Develop a deep understanding of how guests and hosts interact with our CS products including but not limited to AI Assistant, IVR and other agent assisting tools to improve the customer experience
Owning the product analytics roadmap, prioritisation & delivery of solutions in the Contact Center Product space
Own projects from start to end: building out timelines, key milestones, providing regular updates to product managers, analytics management and delivery against agreed timelines
Lead end-to-end measurement for AI systems, aligning metrics with business outcomes, user experience, and trustworthiness
Collaborate with engineering to define scalable logging and ensure observability across agentic and LLM workflows
Lead the design and evaluate A/B and causal tests to quantify impact of AI features and optimisations
Translate insights into strategic recommendations for senior leaders
shape product priorities through data

What we offer

bonus or incentives
one or more equity programs
benefits
Employee Travel Credits

Senior Manager, Data Science - LLM Customization Team

Capital One

Location:
United States , New York ▼
McLean
San Jose

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
February 14, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Manager, Data Science - LLM Customization Team

Senior Manager, Forward-Deployed Data Science

AI Product Manager

Senior Director, Data Science

Senior Data Scientist

Senior Consultant - Data Science (Customer Data)

Vice President, Global Analytics & Data Science

Senior Data Scientist

Lead Advanced Analytics, Digital & AI Products

Senior Manager, Data Science - LLM Customization Team

Capital One

Location:United States , New York ▼McLeanSan Jose

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:February 14, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Manager, Data Science - LLM Customization Team

Senior Manager, Forward-Deployed Data Science

AI Product Manager

Senior Director, Data Science

Senior Data Scientist

Senior Consultant - Data Science (Customer Data)

Vice President, Global Analytics & Data Science

Senior Data Scientist

Lead Advanced Analytics, Digital & AI Products

Location:
United States , New York ▼
McLean
San Jose

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
February 14, 2026