CrawlJobs Logo

Data Scientist, AI Agent

replit.com Logo

Replit

Location Icon

Location:
United States , Foster City

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

140000.00 - 280000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

You'll directly impact Replit's AI agent—the core of our product strategy—by defining how we measure success, designing experiments that drive improvements, and turning agent trace data into actionable insights for the AI team and company leadership.

Job Responsibility:

  • Design and analyze experiments to measure agent improvements—from model changes to UX variations—with statistical rigor and practical tradeoffs
  • Define success metrics that connect agent trace data (prompts, responses, code changes, execution outcomes) to user outcomes like successful deploys, retention, and revenue
  • Build the semantic layer for agent data in partnership with data engineering—defining the tables, metrics, and models that enable self-serve analysis across the AI team
  • Surface insights from trace analysis that identify failure modes, successful patterns, and opportunities to improve agent effectiveness
  • Partner with AI engineering, product, and leadership to translate data into roadmap decisions
  • you'll have a seat at the table for critical agent strategy discussions
  • Create dashboards and reporting that surface agent performance metrics (task completion, latency, quality scores, user satisfaction) for the AI team and executives

Requirements:

  • 5+ years of experience in data science, analytics, or a quantitative role with a focus on product, growth, or experimentation
  • Deep experimentation expertise: A/B testing, experiment design, power analysis, handling skewed data, interpreting results beyond p-values
  • Strong SQL skills and experience designing data models for high-volume event data
  • experience with dbt or similar transformation tools
  • Proficiency in Python and data science libraries (pandas, scipy, statsmodels, etc.)
  • Ability to translate ambiguous questions into structured analysis and communicate findings clearly to both technical and non-technical stakeholders
  • Bias toward action: you ship insights that influence decisions, not just dashboards

Nice to have:

  • Experience with LLM or AI agent evaluation—understanding of prompt-response patterns, agent evaluation frameworks, or model quality measurement
  • Background in high-growth SaaS or PLG companies with large-scale event data
  • Experience with modern data stack (BigQuery, dbt, Fivetran, Segment, Hex)
  • Familiarity with experimentation platforms (LaunchDarkly, Statsig, Eppo, or similar)
  • Understanding of developer tools or software engineering workflows
  • You've built agent or LLM evaluation frameworks from scratch
  • Experience with causal inference methods (difference-in-differences, synthetic control, CUPED)
  • Familiarity with real-time data systems or operational analytics for monitoring agent performance
  • Experience working with trace data, logging systems, or observability tooling
What we offer:
  • Competitive Salary & Equity
  • 401(k) Program with a 4% match
  • Health, Dental, Vision and Life Insurance
  • Short Term and Long Term Disability
  • Paid Parental, Medical, Caregiver Leave
  • Commuter Benefits
  • Monthly Wellness Stipend
  • Autonomous Work Environment
  • In Office Set-Up Reimbursement
  • Flexible Time Off (FTO) + Holidays
  • Quarterly Team Gatherings
  • In Office Amenities

Additional Information:

Job Posted:
February 18, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Replit - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Scientist, AI Agent

Data Scientist - AI

The Data Scientist builds from the ground up to meet the needs of mission-critic...
Location
Location
Puerto Rico , Aguadilla
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, engineering, information systems, or closely related quantitative discipline. Master’s desirable
  • Typically, 4-7 years’ experience
  • Strong background in statistical and machine learning techniques such as anomaly detection, clustering and ranking of events, time series analysis, event stream mining, hypothesis testing, causal inference, deep learning
  • Great at communicating concepts and results
  • strong data visualization skills
  • Expert Python coder (PySpark, Scikit-learn)
  • experience with software engineering best practice
  • Relevant industry experience in data science, machine learning
  • Experience with online learning algorithms, reinforcement learning, semi-supervised learning, or mixed time-series/event streams
  • Experience with Agentic AI
Job Responsibility
Job Responsibility
  • Work with domain experts to identify and formalize machine learning problems for wireless and wired network diagnostics, root causing, problem remediation, and optimization
  • Discover new problem signatures in customer networks
  • Design, implement, and validate machine learning algorithms on big data
  • Guide and oversee deployment of implemented machine learning solutions and monitor their operation
  • Use Agentic AI to solve networking problems
  • Analyses the feature specifications and determines the required coding, testing, and integration activities
  • Designs and develops moderate to complex cloud application modules per feature specifications adhering to security policies
  • Identifies debugs and creates solutions for issues with code and integration into application architecture
  • Develops and executes comprehensive test plans for features adhering to performance, scale, usability, and security requirements
  • Deploy cloud-based systems and applications code using continuous integration/deployment (CI/CD) pipelines to automate cloud applications' management, scaling, and deployment
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Junior Data Scientist - AI

Hewlett Packard Enterprise (HPE) is seeking a Junior Data Scientist - AI to desi...
Location
Location
United States , San Juan
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science, engineering, information systems, or closely related quantitative discipline
  • typically, 2-4 years’ experience
  • strong background in statistical and machine learning techniques such as anomaly detection, clustering and ranking of events, time series analysis, event stream mining, hypothesis testing, causal inference, deep learning
  • great at communicating concepts and results
  • strong data visualization skills
  • expert Python coder (PySpark, Scikit-learn)
  • experience with software engineering best practice
  • relevant industry experience in data science, machine learning
  • experience with online learning algorithms, reinforcement learning, semi-supervised learning, or mixed time-series/event streams
  • experience with Agentic AI
Job Responsibility
Job Responsibility
  • Works with domain experts to identify and formalize machine learning problems for wireless and wired network diagnostics, root causing, problem remediation, and optimization
  • discover new problem signatures in customer networks
  • design, implement, and validate machine learning algorithms on big data
  • guide and oversee deployment of implemented machine learning solutions and monitor their operation
  • use Agentic AI to solve networking problems
  • analyses the feature specifications and determines the required coding, testing, and integration activities
  • designs and develops moderate to complex cloud application modules per feature specifications adhering to security policies
  • identifies debugs and creates solutions for issues with code and integration into application architecture
  • develops and executes comprehensive test plans for features adhering to performance, scale, usability, and security requirements
  • deploy cloud-based systems and applications code using continuous integration/deployment (CI/CD) pipelines to automate cloud applications' management, scaling, and deployment
What we offer
What we offer
  • comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • specific programs catered to helping reach career goals
  • unconditional inclusion.
  • Fulltime
Read More
Arrow Right

AI Data Scientist

We are seeking a highly skilled and experienced Senior Data Scientist / AI Engin...
Location
Location
Poland , Warszawa
Salary
Salary:
Not provided
https://www.bosch.pl/ Logo
Robert Bosch Sp. z o.o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Data Science, or a related field. A PhD is preferred
  • Minimum of 5 years of experience in data science and AI engineering
  • Strong proficiency in programming languages like Python
  • In-depth knowledge of machine learning algorithms and techniques
  • Experience with LLMs and RAG or agent frameworks (Langchain, LLamaIndex, etc.)
  • Proficiency in NLP (Natural Language Processing) techniques and libraries
  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration abilities
  • Ability to work independently and in a team environment
  • Strong attention to detail and ability to prioritize tasks
Job Responsibility
Job Responsibility
  • Collaborate with cross-functional teams to identify, understand, and solve business problems
  • Design, develop, and implement advanced machine learning algorithms, models, and LLM-based pipelines
  • Analyze large datasets to extract meaningful insights and patterns
  • Write production-quality code in Python, using standard software engineering best practices (git, testing, etc.)
  • Stay up-to-date with the latest advancements in AI, GenAI, and data science
  • Collaborate with software engineers to integrate AI models into production systems
  • Provide guidance and mentorship to junior data scientists and engineers
What we offer
What we offer
  • Competitive salary + annual bonus
  • Hybrid work with flexible working hours
  • Referral Bonus Program
  • Copyright costs for IT employees
  • Complex environment of working, professional support and possibility to share knowledge and best practices
  • Ongoing development opportunities in a multinational environment
  • Broad access to professional trainings (incl. language courses), conferences and webinars
  • Private medical care and life insurance
  • Cafeteria System with multiple benefits (incl. MultiSport, shopping vouchers, cinema tickets, etc.)
  • Prepaid Lunch Card
  • Fulltime
Read More
Arrow Right

AI Data Scientist - Senior

We are seeking a highly skilled and experienced Senior Data Scientist / AI Engin...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
https://www.bosch.pl/ Logo
Robert Bosch Sp. z o.o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Data Science, or a related field. A PhD is preferred
  • Minimum of 5 years of experience in data science and AI engineering
  • Strong proficiency in programming languages like Python
  • In-depth knowledge of machine learning algorithms and techniques
  • Experience with LLMs and RAG or agent frameworks (Langchain, LLamaIndex, etc.)
  • Proficiency in NLP (Natural Language Processing) techniques and libraries
  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration abilities
  • Ability to work independently and in a team environment
  • Strong attention to detail and ability to prioritize tasks
Job Responsibility
Job Responsibility
  • Collaborate with cross-functional teams to identify, understand, and solve business problems
  • Design, develop, and implement advanced machine learning algorithms, models, and LLM-based pipelines
  • Analyze large datasets to extract meaningful insights and patterns
  • Write production-quality code in Python, using standard software engineering best practices (git, testing, etc.)
  • Stay up-to-date with the latest advancements in AI, GenAI, and data science
  • Collaborate with software engineers to integrate AI models into production systems
  • Provide guidance and mentorship to junior data scientists and engineers
What we offer
What we offer
  • Competitive salary + annual bonus
  • Hybrid work with flexible working hours
  • Referral Bonus Program
  • Copyright costs for IT employees
  • Complex environment of working, professional support and possibility to share knowledge and best practices
  • Ongoing development opportunities in a multinational environment
  • Broad access to professional trainings (incl. language courses), conferences and webinars
  • Private medical care and life insurance
  • Cafeteria System with multiple benefits (incl. MultiSport, shopping vouchers, cinema tickets, etc.)
  • Prepaid Lunch Card
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

We are seeking a Senior Data Scientist with deep expertise in unstructured data ...
Location
Location
Taiwan
Salary
Salary:
Not provided
beyond.ai Logo
Beyond Limits
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience in AI, Machine Learning, and Data Science, with a strong focus on production-scale AI
  • Expertise in LLMs, including fine-tuning, distributed training, quantization, and pruning techniques
  • Experience working with OCR, ASR, and TTS applications in real-world deployments
  • Proven experience deploying AI models in production, with real-world examples of scaled AI applications
  • Strong understanding of cloud computing, containerization (Docker, Kubernetes), and ML Ops best practices
  • Proficiency in Python, PyTorch, and ML libraries
  • Hands-on experience with vector databases and retrieval-augmented generation (RAG) architectures
  • Strong awareness of AI system performance benchmarks (latency, speed, throughput) and ability to optimize models accordingly
  • Experience working with AI agents, designing real-world intelligent automation solutions beyond just open-source experimentation
  • Proficiency in transformer-based architectures (BERT, GPT, LLaMA, Whisper, etc.), including pre-training, fine-tuning, and task-specific adaptation
Job Responsibility
Job Responsibility
  • Develop and deploy AI models for unstructured data (text, speech, audio, images) with a focus on enterprise-scale performance
  • Fine-tune, optimize, and deploy LLMs and multimodal models, integrating distributed training, quantization, and pruning techniques for efficiency
  • Design and implement production-ready AI solutions, ensuring scalability, low-latency inference, and high throughput
  • Work with AI agents and automation frameworks to create intelligent, real-world AI applications for enterprise clients
  • Build and maintain end-to-end LLM Ops pipelines, ensuring efficient training, deployment, monitoring, and model updates
  • Implement vector search and retrieval-augmented generation (RAG) systems for large-scale data solutions
  • Monitor AI performance using key metrics such as speed, latency, and throughput, continuously refining models for real-world efficiency
  • Work with cloud-based AI infrastructure (AWS, GCP) and containerized environments (Docker, Kubernetes) to scale AI solutions
  • Collaborate with engineering, DevOps, and product teams to align AI solutions with business needs and client requirements
  • Implement data curation pipelines, including data collection, cleaning, deduplication, decontamination, etc. for training high-quality AI models
Read More
Arrow Right

Senior Data Scientist

We are seeking a Senior Data Scientist with deep expertise in unstructured data ...
Location
Location
Salary
Salary:
Not provided
beyond.ai Logo
Beyond Limits
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience in AI, Machine Learning, and Data Science, with a strong focus on production-scale AI
  • Expertise in LLMs, including fine-tuning, distributed training, quantization, and pruning techniques
  • Experience working with OCR, ASR, and TTS applications in real-world deployments
  • Proven experience deploying AI models in production, with real-world examples of scaled AI applications
  • Strong understanding of cloud computing, containerization (Docker, Kubernetes), and ML Ops best practices
  • Proficiency in Python, PyTorch, and ML libraries
  • Hands-on experience with vector databases and retrieval-augmented generation (RAG) architectures
  • Strong awareness of AI system performance benchmarks (latency, speed, throughput) and ability to optimize models accordingly
  • Experience working with AI agents, designing real-world intelligent automation solutions beyond just open-source experimentation
  • Proficiency in transformer-based architectures (BERT, GPT, LLaMA, Whisper, etc.), including pre-training, fine-tuning, and task-specific adaptation
Job Responsibility
Job Responsibility
  • Develop and deploy AI models for unstructured data (text, speech, audio, images) with a focus on enterprise-scale performance
  • Fine-tune, optimize, and deploy LLMs and multimodal models, integrating distributed training, quantization, and pruning techniques for efficiency
  • Design and implement production-ready AI solutions, ensuring scalability, low-latency inference, and high throughput
  • Work with AI agents and automation frameworks to create intelligent, real-world AI applications for enterprise clients
  • Build and maintain end-to-end LLM Ops pipelines, ensuring efficient training, deployment, monitoring, and model updates
  • Implement vector search and retrieval-augmented generation (RAG) systems for large-scale data solutions
  • Monitor AI performance using key metrics such as speed, latency, and throughput, continuously refining models for real-world efficiency
  • Work with cloud-based AI infrastructure (AWS, GCP) and containerized environments (Docker, Kubernetes) to scale AI solutions
  • Collaborate with engineering, DevOps, and product teams to align AI solutions with business needs and client requirements
  • Implement data curation pipelines, including data collection, cleaning, deduplication, decontamination, etc. for training high-quality AI models
Read More
Arrow Right

Data Scientist

Growth through diversity, equity, and inclusion. As an ethical business, we do w...
Location
Location
India
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Familiarity with theory behind various deep learning concepts
  • Experience with Machine Learning (ML), especially in the area of Generative AI (LLM/LMM) with focus on Natural Language Processing (NLP) or multimodal models
  • Experience with business requirements gathering, transforming them into technical plan, data processing, feature engineering, models evaluation, hypothesis testing and model deployment
  • Fluency in Python and object programing, working knowledge of SQL and vector database
  • Solid experience with GCP/VertexAI is a must
  • Knowledge of specific Deep Learning and GenAI libraries like: NumPy, PyTorch, HuggingFace, LangChain, LangGraph and GenAI APIs i.e. OpenAI/Gemini/Claude
  • Experience with microservice architectures
  • Experience with code repositories and code assistants
  • Strong business acumen
  • Ability to come up with creative solutions to address customer problem
Job Responsibility
Job Responsibility
  • Implementing end-to-end GenAI powered RAG & multi-agent systems: Providing guidance on system architecture & components
  • Building TTD system components: LLM Agents, LLM Agents setup & prompt engineering / prompting strategies, Routing, State management, Vector stores and more generally context providing, Rerankers, Validation and assessment rules
  • Supporting project delivery: Running end-to-end initiative (Business understanding, Data understanding/preparation, Modeling, Evaluation and Deployment)
  • Analyzing and interpreting the findings
  • Delivering high quality technical solution to the customer
  • Drawing conclusions and recommendations- including expected benefits
What we offer
What we offer
  • Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites
  • “Office as an option” model. You can choose to work remotely or in the office, depending on your location
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs. Lingarians earn 500+ technology certificates yearly
  • Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly
  • Internal Gallup Certified Strengths Coach to support your growth
  • Grow as we grow as a company. 76% of our managers are internal promotions
Read More
Arrow Right

Senior Data Scientist

We are seeking a highly experienced and motivated Senior Data Scientist to join ...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Data Science, Statistics, Computer Science, Business Analytics, or a related field, with 8–14 years of relevant experience
Job Responsibility
Job Responsibility
  • Lead the design, development, and deployment of advanced analytics, statistical models, and machine learning solutions to generate actionable insights that enhance compliance monitoring, auditing, and risk assessment
  • Manage and oversee data science projects end-to-end, including project scoping, planning, execution, and delivery
  • ensure quality control (QC) and validation of work produced by junior data scientists
  • Develop scalable, automated data pipelines and AI-driven analytics products to improve efficiency and accuracy in audit and compliance processes
  • Partner with cross-functional stakeholders across Compliance, Internal Audit, Commercial, R&D, and Information Systems to design and implement analytics solutions aligned with business priorities
  • Access, integrate, and analyze data from multiple enterprise systems (e.g., SAP, Concur, Salesforce.com) to identify trends, anomalies, and compliance risks
  • Serve as a technical and analytical mentor to data scientists and analysts, promoting best practices in data science methodology, documentation, and reproducibility
  • Stay current with emerging technologies and techniques, including generative AI, agentic AI, and automation frameworks, to continuously advance analytical capabilities
  • Effectively communicate complex analytical concepts and findings to both technical and non-technical audiences, including senior leaders
  • Contribute to strategic planning and roadmap development for analytics initiatives within Compliance and Internal Audit
What we offer
What we offer
  • competitive and comprehensive Total Rewards Plans that are aligned with local industry standards
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy