LLM Engineer Job at Workday (Tel Aviv)

UX Engineer, LLM Experimentation Platform

You'll work on our LLM evaluation and prompt experimentation platform, taking fu...

Location

United States

Salary:

175000.00 - 200000.00 USD / Year

Arize

Expiration Date

Until further notice

Requirements

You've made products noticeably better through interaction refinement
You're comfortable with modern frontend frameworks and animation libraries
You've used session replay tools and incorporated user feedback into designs
You can work in Figma to prototype before committing to code
You think about edge cases, loading states, and empty states automatically
You've worked on complex tools (dev tools, data tools, B2B SaaS) where UX really matters

Job Responsibility

Refine and iterate on UX for existing features
Watch real users struggle in Fullstory, identify friction points, and fix them
Prototype interaction alternatives rapidly (in Figma or code) to test different approaches
Work closely with our Senior engineers who own feature architecture
Own the 'feel' of the product: transitions, feedback, error handling, progressive disclosure
Build reusable interaction patterns that the team can leverage
Run lightweight usability tests to validate improvements

What we offer

competitive equity package
comprehensive benefits package, including medical, dental, vision
a 401(k) plan
unlimited paid time off
a generous parental leave plan
additional support for mental health and wellness
WFH monthly stipend to pay for co-working spaces

Fulltime

Senior LLM Backend Engineer

We are looking for a Senior Backend Engineer with a strong focus on Large Langua...

Location

Spain

Salary:

Not provided

Bark

Expiration Date

Until further notice

Requirements

Extensive production experience with Python in backend engineering
Proven experience integrating LLMs into applications via APIs or SDKs
Strong experience building and maintaining APIs for LLM-based features
Strong experience building and maintaining event-driven workflows
Strong experience building and maintaining business logic that consumes AI outputs
Strong experience building and maintaining integrations with 3rd party AI/ML platforms
Solid SQL and NoSQL experience (especially in AI data pipelines)
Production experience with Docker, ideally with Kubernetes or AWS Fargate/ECS/EKS
Experience deploying and maintaining AI services in cloud environments
Strong organisational skills and ability to deliver in a fast-paced, product-focused environment

Job Responsibility

Work with product managers to understand user needs and translate them into AI-powered functionality
Design and build APIs, services, and workflows that integrate LLMs (both proprietary and open-source)
Implement prompt engineering, RAG pipelines, and model fine-tuning where required
Optimise AI inference performance, scalability, and cost-effectiveness
Ensure AI features meet high standards for security, reliability, and maintainability
Collaborate with other engineers to integrate AI features seamlessly into the wider system
Stay on top of emerging LLM technologies and best practices, running experiments and sharing knowledge across the team

What we offer

Fully remote working
Personal annual L&D Budgets with 600€ to spend on your development
Being at the forefront of an industry with new and exciting problems to solve

Fulltime

Senior Principal Machine Learning Engineer - LLM Post-Training and Optimization

Atlassian is seeking a highly skilled and experienced Senior Principle Machine L...

Location

United States , Mountain View

Salary:

243100.00 - 407200.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

Ph.D. or Master’s degree in Computer Science, Machine Learning, Artificial Intelligence, or a related field
8+ years of experience in machine learning, with a focus on large-scale model development and optimization
Deep expertise in LLM and transformer architectures (e.g., GPT, BERT, T5)
Strong proficiency in Python and ML frameworks such as PyTorch, JAX, or TensorFlow
Experience with distributed training techniques and large-scale data processing pipelines
Proven track record of deploying machine learning models in production environments
Familiarity with model optimization techniques, including quantization, pruning, and knowledge distillation
Strong problem-solving skills and ability to work in a fast-paced, collaborative environment
Excellent communication skills and ability to translate technical concepts for diverse audiences

Job Responsibility

Lead the fine-tuning and post-training optimization of large language models (LLMs) for diverse applications
Develop and implement techniques for model compression, quantization, pruning, and knowledge distillation to optimize performance and reduce computational costs
Conduct research on advanced techniques in transfer learning, reinforcement learning, and prompt engineering for LLMs
Design and execute rigorous benchmarking and evaluation frameworks to assess model performance across multiple dimensions
Collaborate with infrastructure teams to optimize LLM deployment pipelines, ensuring scalability and efficiency in production environments
Stay at the forefront of advancements in LLM technologies, sharing insights, driving innovation within the team, and leading agile development
Mentoring other team members, facilitating within/across team workshops, fostering a culture of technical excellence and continuous learning

What we offer

health coverage
paid volunteer days
wellness resources

Fulltime

LLM - Senior Staff Engineer - Python + Machine Learning

AquSag is seeking a hands-on Machine Learning Senior Staff Engineer to lead cros...

Location

Salary:

40.00 - 60.00 USD / Hour

AquSag Technologies

Expiration Date

Until further notice

Requirements

9+ yrs of strong background in Machine Learning, NLP, and modern deep learning architectures (Transformers, LLMs)
Hands-on experience with frameworks such as PyTorch, TensorFlow, Hugging Face, or DeepSpeed
Hands-on experience in Docker for Production deployment
Proven experience managing teams delivering ML/LLM models in production environments
Knowledge of distributed training, GPU/TPU optimization, and cloud platforms (AWS, GCP, Azure)
Familiarity with MLOps tools like MLflow, Kubeflow, or Vertex AI for scalable ML pipelines
Excellent leadership, communication, and cross-functional collaboration skills
Bachelor’s or Master’s in Computer Science, Engineering, or related field (PhD preferred)
Overlap of 6 hours with PST time zone is mandatory
Commitments Required: 8 hours per day with overlap of 6 hours with PST

Job Responsibility

Lead and mentor a cross-functional team of ML engineers, data scientists, and MLOps professionals
Oversee the full lifecycle of LLM and ML projects — from data collection to training, evaluation, and deployment
Collaborate with Research, Product, and Infrastructure teams to define goals, milestones, and success metrics
Provide technical direction on large-scale model training, fine-tuning, and distributed systems design
Implement best practices in MLOps, model governance, experiment tracking, and CI/CD for ML
Manage compute resources, budgets, and ensure compliance with data security and responsible AI standards
Communicate progress, risks, and results to stakeholders and executives effectively

Fulltime

Director of AI Engineering

We are entering a hyper-growth phase of AI innovation and are hiring a Director ...

Location

Canada; United States

Salary:

300000.00 - 450000.00 USD / Year

Apollo.io

Expiration Date

Until further notice

Requirements

10–15+ years in software engineering, with significant leadership experience owning AI/ML or applied LLM systems at scale
Proven history shipping LLM-powered features, agentic workflows, or AI assistants used by real customers in production
Deep understanding of LLM orchestration frameworks (LangChain, LlamaIndex), RAG pipelines, vector search, embeddings, and prompt engineering
Expert in backend & distributed systems (Python strongly preferred) and cloud infrastructure (AWS/GCP)
Strong experience with telemetry, observability, and cost-aware real-time inference optimizations
Demonstrated ability to lead senior engineers, define technical roadmaps, and deliver outcomes aligned to business metrics
Experience building or scaling teams working on experimentation, optimization, personalization, or ML-powered growth systems
Exceptional ability to simplify complex problems, set clear standards, and drive alignment across Product, Data, Design, and Engineering
Strong product sense, ability to weigh novelty vs. impact, focus on user value, and prioritize speed with guardrails
Fluent in integrating AI tools into engineering workflows for code generation, debugging, delivery velocity, and operational efficiency

Job Responsibility

Define the multi-year technical vision for Apollo’s AI stack, spanning agents, orchestration, inference, retrieval, and platformization
Prioritize high-impact AI investments by partnering with Product, Design, Research, and Data leaders to align engineering outcomes with business goals
Establish technical standards, evaluation criteria, and success metrics for every AI-powered feature shipped
Lead the architecture and deployment of long-horizon autonomous agents, multi-agent workflows, and API-driven orchestration frameworks
Build reusable, scalable agentic components that power GTM workflows like research, enrichment, sequencing, lead scoring, routing, and personalization
Own the evolution of Apollo’s internal LLM platform for high-scale, low-latency, cost-optimized inference
Oversee model-driven experiences for natural-language interfaces, RAG pipelines, semantic search, personalized recommendations, and email intelligence
Partner with Product & Design to build intuitive conversational UX that hides underlying complexity while elevating user productivity
Implement rigorous evaluation frameworks, including offline benchmarking, human-in-the-loop review, and online A/B experimentation
Ensure robust observability, monitoring, and safety guardrails for all AI systems in production

What we offer

Equity
Company bonus or sales commissions/bonuses
401(k) plan
At least 10 paid holidays per year
Flex PTO
Parental leave
Employee assistance program and wellbeing benefits
Global travel coverage
Life/AD&D/STD/LTD insurance
FSA/HSA

Fulltime

AI Engineer

AI Engineer position at Inetum, a European leader in digital services, focusing ...

Location

Romania , Bucharest

Salary:

Not provided

Inetum

Expiration Date

Until further notice

Requirements

Minimum 3 to 5 years of experience in AI solutions deployment in enterprise environments
Understanding of how LLMs (GPT-4, Gemini, Claude, Llama, Mistral AI) work, their capabilities, and limitations
Familiarity with model architecture, tokenization, context windows, and prompt formatting
Crafting effective prompts for various tasks (text generation, summarization, Q&A, code generation, images and sound manipulations)
Techniques for prompt chaining, few-shot and zero-shot learning, and multi-turn conversations
Knowledge of prompt templates, system instructions, and role-based prompting
Understanding the concept of AI agents: autonomous entities that perceive, reason, and act to achieve goals
Familiarity with multi-agent systems, agent orchestration, and agentic workflows (e.g., using frameworks like Lang Chain, Crew AI, Auto Gen)
Ability to design, prompt, and coordinate groups of AI agents for collaborative or competitive tasks
Knowledge of agent communication, delegation, and task decomposition

Job Responsibility

Develop, refine, and optimize prompts for LLMs (GPT-4, Gemini, Claude, Llama, Mistral) to support a variety of tasks such as text generation, summarization, Q&A, and code generation
Design and implement prompt strategies for multi-turn conversations, prompt chaining, and role-based instructions
Build and coordinate groups of AI agents (multi-agent systems) for collaborative or competitive tasks using frameworks such as Lang Chain, Crew AI, or Auto Gen
Upgrade existing prompts while releases and solutions set evolve
Evaluate and improve the effectiveness of prompts and agent workflows through iterative testing, A/B experimentation, and performance analysis
Collaborate with cross-functional teams (developers, data scientists, product managers) to integrate prompt engineering and agentic workflows into enterprise solutions
Ensure compliance with data privacy, security, and regulatory standards (GDPR, NIS2) in all prompt and agent designs
Document prompt strategies, agent architectures, and best practices for internal knowledge sharing and training
Ensure provided solutions are ready for production, documented and monitored ensuring consistent delivery and quality

What we offer

Full access to foreign language learning platform
Personalized access to tech learning platforms
Tailored workshops and trainings to sustain your growth
Medical Insurance
Meal tickets
Monthly budget to allocate on flexible benefit platform
Access to 7 Card services
Wellbeing activities and gatherings

Fulltime

AI Engineer

AI Engineer position at Inetum, a European leader in digital services, focusing ...

Location

Romania , Bucharest

Salary:

Not provided

Inetum

Expiration Date

Until further notice

Requirements

Minimum 3 to 5 years of experience in AI solutions deployment in enterprise environments
Understanding of how LLMs (GPT-4, Gemini, Claude, Llama, Mistral AI) work, their capabilities, and limitations
Familiarity with model architecture, tokenization, context windows, and prompt formatting
Crafting effective prompts for various tasks (text generation, summarization, Q&A, code generation, images and sound manipulations)
Techniques for prompt chaining, few-shot and zero-shot learning, and multi-turn conversations
Knowledge of prompt templates, system instructions, and role-based prompting
Understanding the concept of AI agents: autonomous entities that perceive, reason, and act to achieve goals
Familiarity with multi-agent systems, agent orchestration, and agentic workflows (e.g., using frameworks like Lang Chain, Crew AI, Auto Gen)
Ability to design, prompt, and coordinate groups of AI agents for collaborative or competitive tasks
Knowledge of agent communication, delegation, and task decomposition

Job Responsibility

Develop, refine, and optimize prompts for LLMs (GPT-4, Gemini, Claude, Llama, Mistral) to support a variety of tasks such as text generation, summarization, Q&A, and code generation
Design and implement prompt strategies for multi-turn conversations, prompt chaining, and role-based instructions
Build and coordinate groups of AI agents (multi-agent systems) for collaborative or competitive tasks using frameworks such as Lang Chain, Crew AI, or Auto Gen
Upgrade existing prompts while releases and solutions set evolve
Evaluate and improve the effectiveness of prompts and agent workflows through iterative testing, A/B experimentation, and performance analysis
Collaborate with cross-functional teams (developers, data scientists, product managers) to integrate prompt engineering and agentic workflows into enterprise solutions
Ensure compliance with data privacy, security, and regulatory standards (GDPR, NIS2) in all prompt and agent designs
Document prompt strategies, agent architectures, and best practices for internal knowledge sharing and training
Ensure provided solutions are ready for production, documented and monitored ensuring consistent delivery and quality

What we offer

Full access to foreign language learning platform
Personalized access to tech learning platforms
Tailored workshops and trainings to sustain your growth
Medical Insurance
Meal tickets
Monthly budget to allocate on flexible benefit platform
Access to 7 Card services
Wellbeing activities and gatherings

Fulltime

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...

Location

Canada; United States

Salary:

160000.00 - 260000.00 USD / Year

Apollo.io

Expiration Date

Until further notice

Requirements

8+ years of software engineering experience with a focus on production systems
1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
Production LLM Applications: Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
Agent Development: Experience building multi-step AI agents, LLM chaining, and complex workflow automation
Prompt Engineering Expertise: Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
Python Proficiency: Expert-level Python skills for production AI systems
Backend Engineering: Strong experience building scalable backend systems, APIs, and distributed architectures
LangChain or Similar Frameworks: Experience with LangChain, LlamaIndex, or other LLM application frameworks
API Integration: Proven ability to integrate multiple APIs and services to create advanced AI capabilities
Production Deployment: Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)

Job Responsibility

Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions

What we offer

equity
company bonus or sales commissions/bonuses
401(k) plan
at least 10 paid holidays per year, flex PTO, and parental leave
employee assistance program and wellbeing benefits
global travel coverage
life/AD&D/STD/LTD insurance
FSA/HSA and medical, dental, and vision benefits

Fulltime

LLM Engineer

Workday

Location:
Israel , Tel Aviv

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
May 04, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for LLM Engineer