Senior Data Scientist (NLP & LLMs) Job at Gong (Tel Aviv)

Senior Data Scientist (NLP & LLMs)

Gong

Location:
Israel , Tel Aviv

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Not provided

Save Job

Apply Position

Job Description:

Gong harnesses the power of AI to transform how revenue teams win. The Gong Revenue AI Operating System unifies data, insights, and workflows into a single, trusted system that observes, guides, and acts alongside the world’s most successful revenue teams. Powered by the Gong Revenue Graph, AI-powered intelligence, specialized agents, and trusted applications, Gong helps more than 5,000 companies around the world deeply understand their teams and customers, automate critical sales workflows, and close more deals with less effort. For more information, visit www.gong.io. At Gong, you will join a company built on innovative products, ambitious goals, and passionate people. We are shaping the future of revenue intelligence and we want people who are excited to build what comes next. You will work with a team that dreams big, moves fast, and cares deeply about the craft and about each other. Here, transparency and trust are core to how we operate, and every person has the opportunity to make a visible impact. If you want to grow, stretch, and do work that truly matters, Gong is the place to do the best work of your career. As a Senior Data Scientist (NLP & LLMs), you will combine strong hands-on machine learning, extensive NLP expertise, and sharp product thinking to build the next generation of Gong AI. You’ll work with real customer interaction data, applying core NLP principles and a deep understanding of LLMs to design and run large-scale experiments. You’ll partner closely with Product and Engineering to turn cutting-edge NLP solutions and LLM capabilities into impactful features that our customers love. You’ll collaborate with a team of exceptional data scientists, data analysts, and prompt engineers, and you’ll be a key driver in shaping how Gong uses LLMs, NLP practices, and data to power our product.

Job Responsibility:

The AI Product Lifecycle: Driving the roadmap from ideation to deployment, including defining success metrics and assessing technical feasibility for complex ML problems
Agentic Systems: Architecting the dynamic reasoning chains, tool-use logic, and multi-step workflows that power the Gong AI Assistant, enabling it to navigate complex tasks with intelligence and autonomy
Conversational Intelligence Strategy: Deep-diving into millions of calls and emails to extract key insights, ensuring our models capture the true intent and nuance of unstructured human interactions at scale
Model & Pipeline Engineering: Building robust Python environments to collect proprietary datasets, training models from scratch or fine-tuning them, and integrating LLMs into sophisticated pipelines that serve our global customer base
Temporal Context & Deal Dynamics: Developing methods to track intent and extract key insights across continuous, multi-month sales cycles, connecting the dots between multiple conversations and interactions across an entire deal journey
Applied AI Research & Implementation: Applying a versatile toolkit that includes advanced RAG, unsupervised clustering, fine-tuning custom models, and designing agentic workflows to build high-impact features
Intelligent Sales Assistance: Architecting the Gong AI Assistant to serve as a deep-research partner
you'll build models that answer complex user queries, perform deal-level research, and surface non-obvious insights that are traditionally hard to extract from raw dialogue
Technical Product Translation: Partnering closely with Product Managers to transform high-level product requirements into scalable ML solutions and production-ready model architectures
Global Sales Transformation: The features you build will directly empower thousands of companies and their sales teams, fundamentally changing how they interact with customers and close deals
From Innovation to Implementation: You will bridge the gap between SOTA NLP breakthroughs and real-world application, translating advanced theoretical concepts into high-quality, scalable code that drives Gong AI forward
Strategic Experimental Frameworks: You will design and execute rigorous experimental setups and POCs, providing the technical clarity and data-backed evidence needed to guide critical product and architectural decisions
The Future of Agentic AI: You will establish the standard for how the Gong AI Assistant understands and navigates the subtle nuances of human dynamics, ensuring agents can interpret intent, sentiment, and deal momentum across millions of interactions

Requirements:

M.Sc. or Ph.D. in an exact science field or equivalent industry experience
5+ years of industry experience in data science/machine learning, including hands-on work with deep learning or large language models in real products
Practical LLM/NLP experience in building agentic workflows and NLP features end-to-end, from problem framing and data preparation to prompt/model design and production deployment
Deep familiarity with modern techniques, including RAG, fine-tuning, LLMs, as well as the evaluation frameworks required to benchmark them
Expert-level Python skills, including working with common data and ML libraries (e.g., pandas, NumPy, scikit-learn, PyTorch, Transformers, LangChain, or similar)
Proven track record designing and running large-scale experiments (e.g., offline benchmarks, prompt/model pipelines), and turning results into concrete decisions
Deep expertise in statistics and data analysis
Demonstrated skill in parsing unstructured, real-world data to uncover patterns and drive research strategy
Product mindset - Experience working with product managers and other stakeholders, with a strong sense for customer needs and value
Ability to break down ambiguous problems, propose alternatives, and help the team focus on what will move the needle for users and the business
Excellent communication skills and the ability to collaborate effectively with cross-functional teams in a fast-paced environment