CrawlJobs Logo

LLM Programmer

https://www.roberthalf.com Logo

Robert Half

Location Icon

Location:
United States , Charlotte

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The LLM Programmer will be responsible for building and optimizing applications that leverage large language models (LLMs) to solve business problems, improve user experiences, and automate complex workflows. You will work closely with engineering, product, and data teams to bring AI-driven features from concept to production.

Job Responsibility:

  • Design and develop applications using large language models (e.g., GPT-style systems)
  • Build and maintain RAG (Retrieval-Augmented Generation) pipelines to integrate enterprise data with LLMs
  • Develop prompt engineering strategies and reusable AI workflows
  • Fine-tune or adapt models for domain-specific use cases when needed
  • Integrate LLM APIs into production systems and applications
  • Optimize performance, latency, cost, and accuracy of AI solutions
  • Evaluate model outputs for quality, reliability, and safety
  • Collaborate with cross-functional teams to identify and implement AI opportunities
  • Stay current with advancements in generative AI and LLM tooling

Requirements:

  • Experience in Python and backend development
  • Understanding of large language models and transformer-based architectures
  • Familiarity with LLM APIs (OpenAI, Anthropic, open-source models, etc.)
  • Experience with prompt engineering and AI system design
  • Knowledge of REST APIs and cloud environments (AWS, Azure, or GCP)
  • Strong problem-solving skills and ability to work in fast-paced environments

Nice to have:

  • Experience building RAG systems using vector databases (Pinecone, FAISS, Weaviate, etc.)
  • Familiarity with frameworks like LangChain or LlamaIndex
  • Background in machine learning or natural language processing
  • Experience deploying AI applications in production at scale
  • Understanding of evaluation methods for LLM performance and hallucination mitigation
What we offer:
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training

Additional Information:

Job Posted:
April 27, 2026

Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for LLM Programmer

Google AI Gemini Developer

A large enterprise organisation based in Newcastle upon Tyne is seeking Gemini-f...
Location
Location
United Kingdom , Newcastle upon Tyne
Salary
Salary:
Not provided
brosterbuchanan.com Logo
Broster Buchanan
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Commercial experience as a Developer / Engineer / Programmer
  • Hands-on experience developing with Google AI / Gemini
  • Strong understanding of LLM integration patterns and API-based communication
  • Full-stack development experience (frontend and backend integration)
  • Experience working within cloud environments
  • Ability and willingness to work onsite in Newcastle, 3 days per week
  • Minimum of 5 years of continuous UK residency and full UK working rights (for BPSS clearance)
Job Responsibility
Job Responsibility
  • Design and deliver AI proofs of concept leveraging Google AI / Gemini
  • Build and integrate full-stack applications powered by Large Language Models (LLMs)
  • Develop systems that interact with Gemini APIs, alongside other LLMs such as ChatGPT and Claude
  • Implement AI-driven features, including prompt workflows, data processing, and system integrations
  • Develop AI automation for simple and repetitive tasks
  • Deploy and support AI solutions on Google Cloud infrastructure
  • Collaborate closely with on-site enterprise teams to rapidly prototype and iterate solutions
  • Fulltime
Read More
Arrow Right

Senior Machine Learning Engineer (Team Lead)

As our Artificial Intelligence (AI) and Machine Learning (ML) Team Leader, you w...
Location
Location
Australia , South Bank
Salary
Salary:
Not provided
fctgcareers.com Logo
Flight Centre Brand
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years delivering production grade ML or AI systems with proven commercial impact
  • 3+ years Leading and Mentoring engineers
  • Experience building AI agents, RAG systems or LLM powered applications in production
  • Demonstrated experience leading technical teams and managing complex AI programmes
  • Strong hands on experience across ML infrastructure, distributed systems and scalable AI architecture
  • Experience building and governing AI agent platforms including endpoints, gateways and tool orchestration
  • Familiarity with MCP servers and emerging agent communication standards and protocols
  • Experience defining evaluation frameworks, safety mechanisms and governance for LLM and agent based systems
  • Deep knowledge of Python, modern AI/ML frameworks and scalable AI platforms including Databricks
  • Strong expertise in Kubernetes and cloud native production environments
Job Responsibility
Job Responsibility
  • Lead the development and productionisation of ML models, LLM powered systems and agent based applications
  • Define and build end to end MLOps including CI CD, model registry, monitoring, drift detection and retraining for predictive ML systems
  • Establish LLMOps standards including context engineering, automated evaluation pipelines, red teaming, safeguards and policy guardrails
  • Architect and build AI agent workflows, endpoints, gateways and orchestration layers enabling secure tool access, structured reasoning and multi agent collaboration
  • Design and govern MCP servers and modern agent communication protocols to ensure interoperability, security and scalability
  • Implement strong observability across ML and GenAI systems including reliability, latency, evaluation metrics, usage tracking and cost control
  • Drive scalable ML infrastructure, feature stores and data platforms on Databricks
  • Oversee Kubernetes based deployments and cloud native AI infrastructure
  • Partner with senior stakeholders to prioritise and deliver multiple high impact AI initiatives
  • Coach and grow a high performing AI engineering team
What we offer
What we offer
  • Individualised, ongoing Learning & Development via communities of practice
  • Innovation Days
  • Dedicated Engineering Days
  • Access to 'LinkedIn Learning' for ongoing skills development
  • Women in PM&E group
  • Exclusive Staff Discounts
  • Travel Discounts
  • Career opportunities in a network of brands and businesses across the globe
  • Corporate Health Discounts
  • Mental Health Support and Employee Assistance Program for staff and family
  • Fulltime
Read More
Arrow Right

Machine Learning Engineer

Together AI is looking for an ML Engineer who will develop systems and APIs that...
Location
Location
United States , San Francisco
Salary
Salary:
160000.00 - 220000.00 USD / Year
together.ai Logo
Together AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years experience writing high-performance, well-tested, production quality code
  • Bachelor’s degree in computer science or equivalent industry experience
  • Familiar with LLM inference ecosystem, including frameworks and engines (e.g. vLLM, SGLang, TRT, ...)
  • Demonstrated experience in building large scale, fault tolerant, distributed systems like storage, search, and computation
  • Expert level programmer in one or more of Python, Go, Rust, or C/C++
  • Experience implementing runtime inference services at scale or similar
Job Responsibility
Job Responsibility
  • Design and build the production systems that power the Together Cloud inference and fine-tuning APIs, enabling reliability and performance at scale
  • Partner with researchers, engineers, product managers, and designers to bring new features and research capabilities to the world
  • Analyze and improve efficiency, scalability, and stability of various system resources
  • Conduct design and code reviews
  • Create services, tools & developer documentation
  • Create testing frameworks for robustness and fault-tolerance
  • Participate in an on-call rotation to respond to critical incidents as needed
What we offer
What we offer
  • competitive compensation
  • startup equity
  • health insurance
  • other competitive benefits
  • Fulltime
Read More
Arrow Right

Applications Development Senior Programmer Analyst

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
United States , Tampa
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant experience
  • experience in systems analysis and programming of software applications
  • experience in managing and implementing successful projects
  • working knowledge of consulting/project management techniques/methods
  • ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • bachelor’s degree/university degree or equivalent experience
  • Python 3-5 years
  • very familiar with different LLM models including Google Vertex, OpenAI, and Anthropic
  • strong understanding of how to code middleware services, either in Python FastAPI or Java Springboot
  • very strong organizational and communication skills
Job Responsibility
Job Responsibility
  • conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • ensure essential procedures are followed and help define operating standards and processes
  • serve as advisor or coach to new or lower level analysts
  • operate with a limited level of direct supervision
  • exercise independence of judgement and autonomy
  • act as SME to senior stakeholders and/or other team members
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
Read More
Arrow Right

Lead AI Architect

We’re partnering with a leading investment firm operating across multiple asset ...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
150000.00 GBP / Year
dynamicsearch.co.uk Logo
Dynamic Search Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven track record as a Lead AI Architect, Principal Engineer, or Senior AI/ML Specialist, ideally in investment management, hedge funds, or financial services
  • Deep technical experience across LLMs, agent based systems, vector databases, model orchestration, and scalable AI architectures
  • Strong experience working with multiple AI vendors and ecosystems (e.g., ChatGPT/GPT models, Claude, Copilot, Azure AI, GCP Vertex, Amazon Bedrock)
  • Solid understanding of data engineering, MLOps pipelines, secure AI deployment, and integration with enterprise systems
  • Exceptional communication skills with the ability to influence executive leadership and translate business needs into technical design
  • Experience leading AI programmes in complex, regulated environments
Job Responsibility
Job Responsibility
  • Define and lead the firm wide AI strategy, roadmap, and architectural standards
  • Advise and collaborate with C suite executives, presenting insights, capabilities, and emerging opportunities
  • Partner with business units to understand their challenges and design AI powered solutions that drive measurable outcomes
  • Build AI frameworks, pipelines, RAG systems, and intelligent agents to support investment analysis, automation, and decision support
  • Oversee AI model development, validation, governance, and ethical use of AI across the organisation
  • Evaluate and integrate multiple AI vendors and platforms including GPT based solutions, Claude, Copilot, and other enterprise LLM ecosystems
  • Lead technical design across data engineering, model deployment, prompt engineering, and enterprise architecture
  • Ensure robust security, compliance, and risk controls around AI and data usage
  • Mentor engineering and data teams and help establish best practices, patterns, and reusable components
What we offer
What we offer
  • Bonus
  • Benefits
  • Relocation package
  • Influence the AI direction of a major investment organisation
  • Shape enterprise wide architecture and build new AI capabilities from the ground up
  • Work directly with senior leadership in a strategic, high impact role
  • Join a forward thinking firm investing heavily in modern technology and automation
  • Fulltime
Read More
Arrow Right

Lead AI Architect

We’re partnering with a leading investment firm operating across multiple asset ...
Location
Location
United Kingdom , London
Salary
Salary:
150000.00 GBP / Year
dynamicsearch.co.uk Logo
Dynamic Search Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven track record as a Lead AI Architect, Principal Engineer, or Senior AI/ML Specialist, ideally in investment management, hedge funds, or financial services
  • Deep technical experience across LLMs, agent based systems, vector databases, model orchestration, and scalable AI architectures
  • Strong experience working with multiple AI vendors and ecosystems (e.g., ChatGPT/GPT models, Claude, Copilot, Azure AI, GCP Vertex, Amazon Bedrock)
  • Solid understanding of data engineering, MLOps pipelines, secure AI deployment, and integration with enterprise systems
  • Exceptional communication skills with the ability to influence executive leadership and translate business needs into technical design
  • Experience leading AI programmes in complex, regulated environments
Job Responsibility
Job Responsibility
  • Define and lead the firm wide AI strategy, roadmap, and architectural standards
  • Advise and collaborate with C suite executives, presenting insights, capabilities, and emerging opportunities
  • Partner with business units to understand their challenges and design AI powered solutions that drive measurable outcomes
  • Build AI frameworks, pipelines, RAG systems, and intelligent agents to support investment analysis, automation, and decision support
  • Oversee AI model development, validation, governance, and ethical use of AI across the organisation
  • Evaluate and integrate multiple AI vendors and platforms including GPT based solutions, Claude, Copilot, and other enterprise LLM ecosystems
  • Lead technical design across data engineering, model deployment, prompt engineering, and enterprise architecture
  • Ensure robust security, compliance, and risk controls around AI and data usage
  • Mentor engineering and data teams and help establish best practices, patterns, and reusable components
What we offer
What we offer
  • Bonus
  • Relocation package
  • Fulltime
Read More
Arrow Right

Software Engineer

At Flip, you'll create user experiences, design and implement new features, and ...
Location
Location
United States , Marina del Rey, CA
Salary
Salary:
110000.00 - 150000.00 USD / Year
redroute.com Logo
RedRoute
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS in Computer Science, Mathematics, Engineering, or related scientific/technical discipline
  • Exceptional programmer with strong proficiency in Python (minimum 3-5 years)
  • Experience writing pythonic code, asyncio, decorators, advanced class usage (dataclasses, inheritance), modules, and frameworks like FastAPI or Pipecat
  • Familiarity with REST APIs, authentication methods (OAuth2, JWT, Bearer Tokens), and third-party integrations
  • Good working knowledge of data analytics and metrics pipelines
  • Experience with data analytics systems such as Omni, Tableau, Looker, Grafana, etc.
  • Ability to effectively communicate with non-technical teammates and clients
  • Eagerness to support teammates
  • Ability to work onsite in NYC/LA office
Job Responsibility
Job Responsibility
  • Create user experiences
  • Design and implement new features
  • Oversee entire pipelines of the Flip assistant
  • Get deep into the data
  • Interact with customers
  • Help shape the direction of the product
  • Work on intricate Python-based systems interfacing with external APIs
  • Develop optimized LLM interfaces
  • Handle complex dialogue management and flows
  • Shape conversational workflows
What we offer
What we offer
  • Comprehensive healthcare
  • Unlimited vacation
  • Mandatory half week off over July 4
  • Full week off at the end of the year
  • Equity (subject to board approval)
  • Fulltime
Read More
Arrow Right

Software Engineer

At Flip, you'll create user experiences, design and implement new features, and ...
Location
Location
United States , Brooklyn
Salary
Salary:
110000.00 - 150000.00 USD / Year
redroute.com Logo
RedRoute
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS in Computer Science, Mathematics or Engineering, or related scientific or technical discipline
  • Exceptional programmer with strong proficiency in Python (minimum of 3-5 years): ability to write pythonic code and experience with asyncio, decorators, advanced class usage (dataclasses, inheritance), an array of modules, and frameworks like FastAPI or Pipecat
  • Familiarity with REST APIs, authentication methods (OAuth2, JWT, Bearer Tokens, etc), and third-party integrations
  • Good working knowledge of data analytics and metrics pipelines, and experience with data analytics systems such as Omni, Tableau, Looker, Grafana, etc
  • Ability to effectively communicate with non-technical teammates and clients
  • Eager and willing to support teammates
  • Ability to work onsite in NYC/LA office
Job Responsibility
Job Responsibility
  • Create user experiences, design and implement new features, and oversee entire pipelines of the Flip assistant
  • Get deep into the data, interact with our customers, and help shape the direction of the product
  • Work on intricate Python-based systems that interface with a wide range of external APIs, develop optimized LLM interfaces, handle complex dialogue management and flows, shape conversational workflows, and ensure low-latency, high-availability voice experiences
  • Dive into the deep end of a complex Python codebase
  • Write clean, pythonic, well-tested, and maintainable code
  • Perform thorough yet swift PR code reviews
  • Monitor performance and troubleshoot production issues across services and integrations in a timely manner
  • Push the product forwards
What we offer
What we offer
  • Comprehensive healthcare
  • Unlimited vacation, including a mandatory half week for everyone over July 4, and a full week off at the end of the year
  • Equity, in accordance with company policy, and subject to board approval
  • Fulltime
Read More
Arrow Right