CrawlJobs Logo

LLM Engineer

Israel, Tel Aviv · Job Posted May 04, 2026
Apply Position
Job Link Share

Job Description

As an LLM Engineer, you will be responsible for developing and implementing cutting-edge Large Language Model (LLM) technologies to create innovative hiring agents for Paradox’s global clients.

Job Responsibility

  • Dive deep into LLM technologies, actively researching and experimenting with new solutions to drive innovation in hiring practices
  • Implement practical applications of LLM research findings into end-user-facing applications, creating scalable and impactful tools that directly impact clients
  • Design and implement LLM evaluation frameworks to assess and integrate new AI models, parameters, and techniques
  • Adopt lean methodologies to swiftly meet business objectives, swiftly iterating based on client feedback and being unafraid to take risks and learn from failures
  • Deeply understand product challenges to make intelligent and efficient software-building decisions

Requirements

  • 4+ years of hands-on experience in Data Science/ML
  • 2+ years experience developing agents and other LLM-based products
  • Proven experience with Python
  • Experience with LLM evaluations
  • Experience developing with modern AI tools (Cursor/Copilot/etc.)
  • Advanced knowledge of modern LLM practices (RAG/MCPs/etc.)
  • Passion for learning, staying current with innovative technologies, and thriving in a fast-paced, high-ownership environment
  • Fluent in English, including both written and verbal communication
  • Authorization to work in Israel

Nice to have

  • Bachelor’s Degree in Computer Science or other relevant fields, advantage for a M.Sc.
  • Experience with LLM evaluations
  • Experience with Conversational AI
  • Experience in Data Science or MLOps
  • Experience in software architecture design
  • Experience in a cloud-based environment and CI/CD flows

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

LLM Engineer

8 matching positions

LLM Engineer

You will join our global Machine Learning and Data Science unit — a core team of...
Location
Location
Spain , Barcelona
Salary
Salary:
Not provided
gipo.it Logo
Gipo
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least one year of professional experience in LLM development or integration in a fast-paced, product-driven tech environment
  • Demonstrated expertise in production-grade LLM deployments, including prompt management systems, vector databases, semantic search implementation, and API integration with foundation models
  • Good understanding of transformer architectures and proficiency in LLM frameworks such as LangChain, LlamaIndex, or similar tools
  • Proficiency in Python
  • Experience in collaborative project development
  • Appreciation for good engineering practices and maintainable code
  • Proven experience in evaluating LLMs through systematic testing, benchmark design, and the development of custom metrics (e.g. accuracy, consistency, factuality, and bias), with a focus on aligning results to product and user needs
  • Proven ability to integrate, deploy, and optimize large language models in production-grade industry environments, ensuring scalability and robust performance
  • Strong knowledge in prompt engineering, agent-based workflows, and the generation and manipulation of embeddings
  • Experience with RAG (Retrieval-Augmented Generation) techniques, vector similarity search, and information retrieval methods to enhance LLM capabilities
Job Responsibility
Job Responsibility
  • Work closely with cross-functional teams, including scientists, engineers, and product stakeholders, to deliver LLM-driven initiatives that directly contribute to business objectives
  • Design, deploy and iterate over LLM services for text-based applications (and beyond), while proactively identifying and eliminating performance bottlenecks
  • Build small to medium-sized Python projects and collaborate with engineers on production code and deployments at scale
  • Assess platform engineering and LLMOps bottlenecks
  • research and design scalable prompt management strategies, and recommend solutions that balance performance, cost, and reliability
  • Research, architect, and deploy LLM-powered information retrieval solutions (e.g., RAG) to deliver accurate results in complex, multilingual product environments
  • Partner with the AI Platform team to refine LLMOps best practices, evolve frameworks, and establish efficient, scalable workflows
What we offer
What we offer
  • Flexible remuneration and benefits system via Flexoh, which includes: restaurant card, transportation card, kindergarten, and training tax savings
  • Share options plan after 6 months of working with us
  • Remote or hybrid work model with our hub in Barcelona
  • Flexible working hours (fully flexible, as in most cases you only have to be on a couple of meetings weekly)
  • Summer intensive schedule during July and August (work 7 hours, finish earlier)
  • 23 paid holidays, with exchangeable local bank holidays
  • Additional paid holiday on your birthday or work anniversary (you choose what you want to celebrate)
  • Private healthcare plan with Adeslas for you and subsidized for your family (medical and dental)
  • Access to hundreds of gyms for a symbolic fee in partnership for you and your family with Wellhub
  • Access to iFeel, a technological platform for mental wellness offering online psychological support and counseling
  • Fulltime
Read More
Arrow Right

LLM Engineer

You will join our global Machine Learning and Data Science unit — a core team of...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
gipo.it Logo
Gipo
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least one year of professional experience in LLM development or integration in a fast-paced, product-driven tech environment
  • Demonstrated expertise in production-grade LLM deployments, including prompt management systems, vector databases, semantic search implementation, and API integration with foundation models
  • Good understanding of transformer architectures and proficiency in LLM frameworks such as LangChain, LlamaIndex, or similar tools
  • Proficiency in Python
  • Experience in collaborative project development
  • Appreciation for good engineering practices and maintainable code
  • Proven experience in evaluating LLMs through systematic testing, benchmark design, and the development of custom metrics (e.g. accuracy, consistency, factuality, and bias), with a focus on aligning results to product and user needs
  • Proven ability to integrate, deploy, and optimize large language models in production-grade industry environments, ensuring scalability and robust performance
  • Strong knowledge in prompt engineering, agent-based workflows, and the generation and manipulation of embeddings
  • Experience with RAG (Retrieval-Augmented Generation) techniques, vector similarity search, and information retrieval methods to enhance LLM capabilities
Job Responsibility
Job Responsibility
  • Work closely with cross-functional teams, including scientists, engineers, and product stakeholders, to deliver LLM-driven initiatives that directly contribute to business objectives
  • Design, deploy and iterate over LLM services for text-based applications (and beyond), while proactively identifying and eliminating performance bottlenecks
  • Build small to medium-sized Python projects and collaborate with engineers on production code and deployments at scale
  • Assess platform engineering and LLMOps bottlenecks
  • research and design scalable prompt management strategies, and recommend solutions that balance performance, cost, and reliability
  • Research, architect, and deploy LLM-powered information retrieval solutions (e.g., RAG) to deliver accurate results in complex, multilingual product environments
  • Partner with the AI Platform team to refine LLMOps best practices, evolve frameworks, and establish efficient, scalable workflows
What we offer
What we offer
  • Share options plan after 6 months of working with us
  • Remote or hybrid work model with or hub in Warsaw
  • Flexible working hours (fully flexible, as in most cases you only have to be on a couple of meetings weekly)
  • 20/26 days of paid time off (depending on your contract)
  • Additional paid day off on your birthday or work anniversary (you choose what you want to celebrate)
  • Private healthcare plan with Signal Iduna for you and subsidized for your family
  • Multisport card co-financing for you to have access to sports facilities across Poland
  • Access to iFeel, a technological platform for mental wellness offering online psychological support and counseling
  • Free English classes
  • Fulltime
Read More
Arrow Right
New

Applied AI / LLM Engineer (Python)

We're looking for an AI Engineer to own the AI layer of our products - from rese...
Location
Location
Salary
Salary:
Not provided
maddevs.io Logo
Mad Devs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience building production LLM applications
  • Hands-on expertise with RAG, embeddings, vector search, prompt engineering, and LLM evaluation
  • Experience with LangGraph, LangChain, or similar frameworks
  • Solid Python backend background (Django, PostgreSQL, async programming)
  • Strong SQL/Pandas skills and a data-driven mindset
  • Language Proficiency: English at B2-C1 level, Russian at C1 level
  • Location: any, except Russia and Belarus
Job Responsibility
Job Responsibility
  • Design and build LLM pipelines, AI agents, and RAG-based systems: function/tool calling, structured output (JSON schema)
  • Develop production-grade Python services (Django, Celery, Redis)
  • Validate product hypotheses using real-world data and analytics
  • Measure and optimize LLM quality, performance, and cost
  • Collaborate closely with product managers and engineers to turn ideas into scalable solutions
What we offer
What we offer
  • Flexible working hours
  • Remote-first culture
  • Long-term projects
  • Salary in dollars
  • Professional communities
  • Onsite business trips
  • Training budget
  • Paid conferences
Read More
Arrow Right

Full-Stack Software Engineer — LLM Tooling & Data Applications

You'll be joining a small full-stack team building internal applications that bl...
Location
Location
United States
Salary
Salary:
70.00 - 90.00 USD / Hour
signifytechnology.com Logo
Signify Technology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years building production web or data applications with Node.js and TypeScript
  • Practical experience with LLM prompt engineering and production retrieval-augmented generation (RAG) pipelines
  • Working knowledge of a graph database such as Neo4j or Memgraph, or equivalent experience with semantic search layers over a data warehouse
  • Comfort with modern LLM tooling patterns including tool use, agent architectures, and integration with enterprise data sources
  • Familiarity with enterprise engineering tooling — ticketing, source control, observability, and deployment pipelines
  • Comfortable operating in an agile team with CI/CD
  • Bachelor's degree in Computer Science, Information Systems, or a related field
Job Responsibility
Job Responsibility
  • Build and ship features across a TypeScript and Node backend with data and AI-assisted components
  • Work on LLM-powered features including prompt engineering, retrieval-augmented generation, and integration with internal data sources
  • Contribute to graph-database-backed retrieval and semantic search work
  • Integrate with enterprise SaaS platforms and internal data systems via their APIs
  • Partner with frontend engineers on data visualization and dashboard work
  • Participate in code review, deployment automation, and standard quality engineering practices
  • Work directly with internal users to scope, prototype, and refine what gets built
Read More
Arrow Right

Principal LLM Engineer

We are looking for a Principal LLM Engineer to lead the design and development o...
Location
Location
United States , Oakland
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience developing and scaling software systems
  • 5+ years experience shipping LLM applications particularly in consumer-focused or AI-driven products
  • Proven track record as a Principal Engineer, Staff Engineer, or Architect in leading complex system designs
  • Proficient in Python, with preferred experience in frameworks such as Django, Flask, or FastAPI
  • Demonstrated knowledge in cloud architectures and distributed systems, including services like EC2, Lambda, S3, and CloudFront
Job Responsibility
Job Responsibility
  • Develop and deploy workflows powered by large language models (LLMs) to improve the search, recommendation, and personalization capabilities of the platform
  • Collaborate with product, data, and AI teams to create intelligent services such as classification, relevance ranking, and summarization
  • Establish and enforce architectural standards across backend, frontend, and infrastructure layers to ensure system reliability and scalability
  • Lead modernization efforts for backend systems built on Python/Django and frontend technologies like React
  • Mentor engineering teams, providing technical guidance and fostering best practices through code reviews and collaborative design sessions
  • Conduct technical exploration of emerging tools and technologies, including vector databases and real-time video personalization frameworks
  • Prototype and test innovative solutions to ensure the platform remains at the forefront of applied AI developments
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • eligible to enroll in our company 401(k) plan
Read More
Arrow Right

Senior Data Engineer (LLM)

Sunscrapers is a technology consultancy that empowers finance and healthcare lea...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
sunscrapers.com Logo
Sunscrapers sp. z o.o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5+ years of professional experience in data-related or full-stack engineering role
  • Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar
  • Strong proficiency in Next.js / React for frontend development
  • Expertise in Python and SQL languages
  • Experience with data warehouses (Snowflake) and different database technologies (RDBMS, vector, graphs)
  • Proven experience building secure, scalable web applications
  • Expertise in AWS stack and services, proficiency in using Docker
  • Experience with infrastructure-as-code tools, like Terraform
  • Excellent command in spoken and written English, at least C1
  • Creative problem-solving skills and excellent technical documentation
Job Responsibility
Job Responsibility
  • Developing PoCs using latest technologies, experimenting with third party integrations
  • Owning and evolving Next.js/React frontend with authenticated flows and secure session handling
  • Delivering production grade applications once PoCs are validated
  • Creating solutions that enable data scientists and business analysts to be self-sufficient as much as possible
  • Designing and implementing secure, scalable access patterns (OAuth2/OIDC, authorization boundaries)
  • Finding new ways how to leverage Gen AI applications and underlying vector and graph data storages
  • Contributing across the stack including FastAPI backend services and agent-driven workflows
  • Contributing data technology stacks including data warehouses and ETL pipelines
  • Building data flows for fetching, aggregation and data modeling using batch and streaming pipelines
  • Documenting design decisions before implementation
What we offer
What we offer
  • Working alongside a talented team of software engineers who are changing the image of Poland abroad
  • Culture of teamwork, professional development and knowledge sharing
  • Flexible working hours and remote work possibility
  • Comfortable office in central Warsaw, equipped with all the necessary tools for conquering the universe (Macbook Pro/Dell, external screen, ergonomic chairs)
Read More
Arrow Right

Senior Research Engineer, LLM Evaluation and Behavioral Analysis

Together AI is building the fastest, most capable open-source-aligned LLMs and i...
Location
Location
United States , San Francisco
Salary
Salary:
220000.00 - 270000.00 USD / Year
together.ai Logo
Together AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong engineering skills with Python, evaluation tooling, and distributed workflows
  • Experience working with LLMs or transformer-based models, particularly in model evaluation, testing, or red-teaming
  • Ability to reason clearly about qualitative behavior, edge cases, and model failure patterns
  • Experience designing experiments, building datasets, and interpreting noisy behavioral signals
  • Understanding of function calling and structured output formats
  • Familiarity with GPU or distributed compute environments
  • Hands-on experience evaluating function-calling models, agentic systems, or tool-augmented LLM pipelines
  • Experience with multi-turn or multi-step reasoning tasks
  • Familiarity with inference systems, distributed infrastructure, or post-training workflows
  • Passion for discovering subtle behaviors, surprising model gaps, or edge-case failures
Job Responsibility
Job Responsibility
  • Build and iterate on evaluation frameworks that measure model performance across instruction following, function calling, long-context reasoning, multi-turn dialog, safety, and agentic behaviors
  • Develop specialized evaluation suites for: Function calling — argument correctness, schema adherence, tool selection, multi-function planning, and error recovery
  • Agentic workflows — task decomposition, multi-step planning, self-correction, and autonomous tool-use sequences
  • Tool-augmented interactions — search, retrieval, code execution, API-driven actions
  • Create CI/CD automated pipelines for A/B comparisons, regression detection, behavioral drift monitoring, and adversarial probing
  • Design and curate high-quality evaluation datasets, especially nuanced or challenging cases across domains
  • Collaborate with researchers and engineers to diagnose failures, triage regressions, and guide data selection, shaping strategies, objective design, and system improvements
  • Work with engineering teams to build dashboards, reports, and internal tools that help visualize behavior changes across releases
  • Operate in a fast-paced, high-impact environment with deep technical ownership and close partnership with world-class model researchers and infra engineers
What we offer
What we offer
  • competitive compensation
  • startup equity
  • health insurance
  • other benefits
  • Fulltime
Read More
Arrow Right

Full Stack LLM Engineer

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. ...
Location
Location
Canada , Toronto
Salary
Salary:
Not provided
cerebras.net Logo
Cerebras Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s, Master’s, or PhD in Computer Science, Engineering, or a related field
  • Comfort navigating the full AI toolchain: Python modeling code, compiler IRs, performance profiling, etc.
  • Strong debugging skills across performance, numerical accuracy, and runtime integration
  • Experience with deep learning frameworks (e.g., PyTorch, TensorFlow) and familiarity with model internals (e.g., attention, MoE, diffusion)
  • Proficiency in C/C++ programming and experience with low-level optimization
  • Proven experience in compiler development, particularly with LLVM and/or MLIR
  • Strong background in optimization techniques, particularly those involving NP-hard problems
Job Responsibility
Job Responsibility
  • Contribute to the end-to-end bring up of ML models on Cerebras CSX systems
  • Work across the stack: model architecture translation, graph lowering, compiler optimizations, runtime integration, and performance tuning
  • Debug performance and correctness issues spanning model code, compiler IRs, runtime behavior, and hardware utilization
  • Propose and prototype improvements across tools, APIs, or automation flows to accelerate future bring ups
What we offer
What we offer
  • Competitive salary and benefits package
  • Opportunities for professional growth and career advancement
  • A dynamic and innovative work environment
  • The chance to work on cutting-edge technologies and make a significant impact on the future of AI
Read More
Arrow Right