Senior Data Scientist (NLP & LLMs) at Gong.io

Tel-Aviv, Tel-Aviv District, Israel -

Full Time

Start Date

Immediate

Expiry Date

09 May, 26

Salary

0.0

Posted On

08 Feb, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Machine Learning, Deep Learning, Large Language Models, NLP, Python, Data Analysis, Statistics, Product Management, Experimental Design, Data Preparation, Prompt Design, Model Deployment, Collaboration, Communication, Heuristics, Technical Feasibility

Industry

Software Development

Description

Gong harnesses the power of AI to transform how revenue teams win. The Gong Revenue AI Operating System unifies data, insights, and workflows into a single, trusted system that observes, guides, and acts alongside the world’s most successful revenue teams. Powered by the Gong Revenue Graph, AI-powered intelligence, specialized agents, and trusted applications, Gong helps more than 5,000 companies around the world deeply understand their teams and customers, automate critical sales workflows, and close more deals with less effort. For more information, visit www.gong.io. At Gong, you will join a company built on innovative products, ambitious goals, and passionate people. We are shaping the future of revenue intelligence and we want people who are excited to build what comes next. You will work with a team that dreams big, moves fast, and cares deeply about the craft and about each other. Here, transparency and trust are core to how we operate, and every person has the opportunity to make a visible impact. If you want to grow, stretch, and do work that truly matters, Gong is the place to do the best work of your career. As a Senior Data Scientist (NLP & LLMs), you will combine strong hands-on machine learning, deep understanding in LLMs, and sharp product thinking to build the next generation of Gong AI. You’ll work with real customer interaction data, design and run large-scale experiments, and partner closely with Product and Engineering to turn cutting-edge LLM capabilities into impactful features that our customers love. You’ll collaborate with a team of exceptional data scientists, data analysts, and prompt engineers, and you’ll be a key driver in shaping how Gong uses LLMs, NLP practices, and data to power our product. You’ll Own: The AI Product Lifecycle: Driving the roadmap from ideation to production, including defining success metrics and assessing technical feasibility for ML problems. Agentic Frameworks: Designing multi-step reasoning flows and the evaluation harnesses required to stabilize the "Gong Agent" behavior. Semantic Data Strategy: Defining ground truth and designing schemas to parse the nuance and intent of unstructured human conversation. Experimental Industrialization: Building robust Python pipelines for systematic comparison of prompts, models, and architectures. You’ll Solve: Signal-to-Noise Complexity: Analyzing deep meaning within data and developing heuristics to extract valuable signals from long-form conversations. Ambiguity in Requirements: Partnering with Product Managers to translate vague customer needs into concrete, solvable ML problems. Subjectivity in Quality: Moving quality measurement beyond "vibes" by designing offline benchmarks and online tests that provide statistically significant insights. Implementation Strategy: Determining the optimal technical approach, whether it's advanced RAG, unsupervised clustering, or fine-tuning custom models. You’ll Impact: Technical & Academic Excellence: Mentoring the team on translating SOTA NLP research into production-grade, architecturally robust code. Evidence-Based Decision Making: Synthesizing complex experimental results into data-driven stories that help stakeholders navigate technical trade-offs. The Future of Agentic AI: Establishing the foundation for how agents interact with and understand human dynamics at scale. How You’ll Succeed Here: M.Sc. or Ph.D. in an exact science field or equivalent industry experience. 5+ years of industry experience in data science/machine learning, including hands-on work with deep learning or large language models in real products. Practical LLM/NLP experience in building agentic workflows and NLP features end-to-end, from problem framing and data preparation to prompt/model design and production deployment. Deep familiarity with modern techniques, including RAG, fine-tuning, LLMs, as well as the evaluation frameworks required to benchmark them. Expert-level Python skills, including working with common data and ML libraries (e.g., pandas, NumPy, scikit-learn, PyTorch, Transformers, LangChain, or similar). Proven track record designing and running large-scale experiments (e.g., offline benchmarks, prompt/model pipelines), and turning results into concrete decisions. Deep expertise in statistics and data analysis. Demonstrated skill in parsing unstructured, real-world data to uncover patterns and drive research strategy Product mindset - Experience working with product managers and other stakeholders, with a strong sense for customer needs and value. Ability to break down ambiguous problems, propose alternatives, and help the team focus on what will move the needle for users and the business. Excellent communication skills and the ability to collaborate effectively with cross-functional teams in a fast-paced environment. What makes Engineering at Gong unique? Here at Gong, we trust and empower our employees with ownership to solve complex problems, make the right decisions, and build the best products that create radical impact. We call this “Own. Solve. Impact.” For our engineers, it means being involved and able to influence the entire process to create the best product. If you are curious to discover Gong's wonderful and challenging world, what are you waiting for? Don’t delay - fill in your application details. Who knows, maybe there’s a Gongster in you! About us we encourage our employees to express their personality and identity (whether gender, ethnic, religious, or sexual), and we ensure fairness and equal opportunities. We follow a hybrid working model that combines working from home, on the go, or at the office. This allows us: flexibility, autonomy, positive work relationships, and effective work habits. If these considerations are important to you when choosing a work place, we'd love to see you with us. To review Gong's privacy policy, visit www.gong.io/privacy-policy/ for more details. #LI-GB4

Responsibilities

As a Senior Data Scientist, you will drive the AI product lifecycle from ideation to production, focusing on building the next generation of Gong AI using real customer interaction data. You will collaborate with cross-functional teams to design and run large-scale experiments and develop impactful features.