CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

LLM Programmer

United States, Charlotte · Job Posted April 27, 2026
Apply Position
Job Link Share

Job Description

The LLM Programmer will be responsible for building and optimizing applications that leverage large language models (LLMs) to solve business problems, improve user experiences, and automate complex workflows. You will work closely with engineering, product, and data teams to bring AI-driven features from concept to production.

Job Responsibility

  • Design and develop applications using large language models (e.g., GPT-style systems)
  • Build and maintain RAG (Retrieval-Augmented Generation) pipelines to integrate enterprise data with LLMs
  • Develop prompt engineering strategies and reusable AI workflows
  • Fine-tune or adapt models for domain-specific use cases when needed
  • Integrate LLM APIs into production systems and applications
  • Optimize performance, latency, cost, and accuracy of AI solutions
  • Evaluate model outputs for quality, reliability, and safety
  • Collaborate with cross-functional teams to identify and implement AI opportunities
  • Stay current with advancements in generative AI and LLM tooling

Requirements

  • Experience in Python and backend development
  • Understanding of large language models and transformer-based architectures
  • Familiarity with LLM APIs (OpenAI, Anthropic, open-source models, etc.)
  • Experience with prompt engineering and AI system design
  • Knowledge of REST APIs and cloud environments (AWS, Azure, or GCP)
  • Strong problem-solving skills and ability to work in fast-paced environments

Nice to have

  • Experience building RAG systems using vector databases (Pinecone, FAISS, Weaviate, etc.)
  • Familiarity with frameworks like LangChain or LlamaIndex
  • Background in machine learning or natural language processing
  • Experience deploying AI applications in production at scale
  • Understanding of evaluation methods for LLM performance and hallucination mitigation

What we offer

  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

LLM Programmer

8 matching positions

New

Applications Development Sr Programmer Analyst

Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of overall experience in large-scale application development with recent mandatory platform for the secure and scalable deployment of AI agents into application contexts
  • Minimum of 5+ years of proven experience in a Python and pyspark Engineering lead role focused on building enterprise-grade, high-volume ELT/ETL processes using the PySpark and Databricks ecosystem
  • Hands-on experience with agentic AI development using YAML, JSON, FAST API or Spring boot, Google ADK, LLM integrations, including Devin.AI or Github Copilot, and integrating models via platforms like MCP using advanced prompt engineering
  • Proven experience developing and automating microservice integrations to support data-intensive applications
  • Proficiency in at least one programming language commonly used for data analytics, engineering, such as Python or Scala
  • Strong SQL skills and experience with various relational databases
  • Deep understanding of data modeling, data warehousing concepts, Data Mesh architecture, and data federation
  • Excellent communication, collaboration, and problem-solving skills
  • Bachelor's degree in Computer Science, Engineering, or a related field
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable, enterprise-grade AI agents, supporting ELT/ETL processes to handle large data volumes using the Python, FAST API, Microservices, PySpark, Kafka and Databricks ecosystem
  • Build and Deploy GEN AI Agents using Googles ADK and Google Flash 2.5+ LLMs to support application automation supports and its deep insights, workflow support with HIL - Human in loop architecture
  • Build and maintain data federation layers for lambda and Data Mesh architectures using tools like Starburst, with a strategy for adopting AI-based use cases (e.g., machine learning, deep learning, NLP) to drive efficiency
  • Develop, deploy, and automate microservice integrations to support data-intensive applications, ensuring scalability, resilience, and maintainability using cloud native infrastructure and openshift or Kubernates architecture including CI/CD pipelines
  • Integrate and leverage agentic AI tools (e.g., Devin.AI, Github Copilot) and platforms (e.g., MCP) through advanced prompt engineering to enhance development and operational efficiency
  • Ensure data quality, integrity, and security throughout the entire data lifecycle
  • Contribute to the continuous improvement of data engineering processes, standards, and best practices within the team
  • Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citi, its clients, and assets by driving compliance with applicable laws, rules, and regulations. Adhere to Policy, apply sound ethical judgment, and escalate, manage, and report control issues with transparency
  • Fulltime
Read More
Arrow Right
New

Global Senior Security Manager

We are seeking a seasoned security leader to partner with our CISO in protecting...
Location
Location
United States , New York
Salary
Salary:
150000.00 - 210000.00 USD / Year
alterdomus.com Logo
Alter Domus
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years in cybersecurity with at least 5 years in a leadership role managing global, cross-functional teams
  • Proven track record of representing security at C-suite and board level, translating complex risk into clear business narrative
  • Experience in financial services or a similarly regulated industry (FCA, PRA, DORA, SOX, PCI-DSS)
  • Familiarity with deploying AI security frameworks such as NIST AI RMF 1.0, MITRE ATLAS, and financial services AI governance standards
  • Practical knowledge of implementing AI-powered security tools to automate detection, response, and guardrail enforcement
  • Familiarity with AI model risk, LLM threat surfaces, data poisoning, prompt injection, and adversarial ML attack vectors
  • Familiarity with enterprise security tools
  • Broad exposure to endpoint protection, vulnerability management, CSPM, DLP, and email security platforms
  • CISSP, CISM, or CRISC — one or more preferred
  • CCSP or equivalent cloud security credential
Job Responsibility
Job Responsibility
  • Support CISO in key decision making and regulatory meetings — presenting risk posture, programme status, and strategic recommendations with clarity and confidence
  • Build, mentor, and manage high-performing, globally distributed security teams spanning multiple time zones and functions
  • Define and execute the enterprise security roadmap aligned with business strategy and applicable regulatory requirements (FCA, PRA, DORA, SOX, PCI-DSS)
  • Lead end-to-end transformation of Identity & Access Management (IAM) and Privileged Access Management (PAM), including strategy, tooling selection, and programme delivery
  • Drive implementation of an Identity Governance & Administration (IGA) framework — encompassing joiner/mover/leaver processes, role engineering, access certification, and policy enforcement
  • Oversee deployment and maturation of PAM controls, credential vaulting, just-in-time access, and session monitoring to eliminate over-privileged accounts across the enterprise
  • Establish access management metrics and KPIs reported to executive leadership and regulators
  • Lead the Zero Trust Architecture (ZTA) transformation programme — defining principles, technology roadmap, and phased rollout across on-premises, cloud, and hybrid environments
  • Drive AI-augmented network and security architecture, leveraging machine learning for anomaly detection, automated policy enforcement, and predictive threat modelling
  • Build and operationalise a Network Operations (NetOps) operating model — defining governance, runbooks, escalation paths, and SLA frameworks for a globally resilient network
What we offer
What we offer
  • Support for professional accreditations
  • Flexible arrangements, generous holidays, plus an additional day off for your birthday
  • Continuous mentoring along your career progression
  • Active sports, events and social committees across our offices
  • 24/7 support available from our Employee Assistance Program
  • The opportunity to invest in our growth and success through our Employee Share Plan
  • Plus additional local benefits depending on your location
  • Fulltime
Read More
Arrow Right
New

Customer Success Automation Specialist

Are you ready to define the future of Customer Success? We are looking for our n...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
supermetrics.com Logo
Supermetrics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A track record of owning and designing automation or AI systems in a CS environment: you have made architectural decisions, not just implemented them
  • Deep knowledge of customer success processes and the data that drives them: health scoring, lifecycle management, renewal management and escalation handling
  • Strong understanding of what lives in Gainsight and what patterns signal churn risk
  • Hands-on experience evaluating and selecting AI or automation tooling in a CS context
  • Practical experience with LLMs and agentic AI: you understand where agents can act autonomously and where human judgment is genuinely needed
  • Strong stakeholder management: CS leaders care deeply about customer outcomes and you earn credibility by shipping things that demonstrably work
  • Systems thinking: you design for coherence and long-term maintainability, not just the immediate use case
Job Responsibility
Job Responsibility
  • Own the full AI agent programme for Customers Success
  • Design the business logic each CS agent follows: what triggers it, what data it reads, what action it takes
  • Continuously evaluate the agent landscape, identifying gaps, redundancies and opportunities across customer success
  • Research and recommend new AI tools and frameworks relevant to customer success automation
  • Define and maintain the quality standards and test cases that determine whether a CS agent is ready for production
  • Act as the primary strategic partner to Customers for Life leadership, translating operational needs into agent architecture decisions
  • Designing and owning the business logic for each CS agent across the full customer lifecycle
  • Leading the agent roadmap for CS workstreams and making the case to leadership for where new agents create the most value
  • Running structured evaluations of new customer success automation tools and recommending what to adopt or deprioritise
  • Owning the recurring review cycle to ensure agents stay accurate as the customer base changes
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

At myPOS, we’re all about helping businesses grow and get paid. We make payments...
Location
Location
Bulgaria , Sofia
Salary
Salary:
Not provided
mypos.com Logo
myPOS
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • MSc or PhD in Computer Science, Statistics, Applied Mathematics, Econometrics or a related quantitative field (or equivalent commercial experience)
  • 7+ years of applied data science and ML experience in a commercial environment, with a strong portfolio of models in production that drove measurable business outcomes
  • Expert Python for data science and ML engineering: pandas, scikit-learn, XGBoost / LightGBM, PyTorch or TensorFlow
  • clean, tested, modular code as a default
  • Deep expertise across the ML methodological spectrum: survival analysis, time-series and sequence modelling, uplift and causal inference, anomaly detection, and recommendation systems
  • Proven end-to-end ownership of at least three of: CLTV models, churn models, propensity models, fraud/risk models, recommendation or NBA systems - in a production commercial setting
  • Strong MLOps capability: feature stores, model registries, model serving infrastructure, drift monitoring, and CI/CD for ML pipelines
  • Deep SQL and data platform proficiency (GCP / BigQuery strongly preferred)
  • experience with streaming architectures for real-time feature generation
  • Hands-on expertise building LLM-powered applications: RAG pipelines, tool-use agents, multi-agent orchestration, and agent evaluation frameworks
Job Responsibility
Job Responsibility
  • Own the full lifecycle of complex modelling programmes across Customer & Commercial Intelligence: CLTV, Churn Prediction, Propensity to Buy, and Next Most Likely Product (NMLP)
  • Architect multi-horizon churn models and build the churn intervention scoring layer that prioritises at-risk merchants for Account Management teams
  • Lead the NMLP engine — designing and productionizing a multi-output recommendation system that identifies the next product across myPOS's full catalogue
  • Take technical ownership of core fraud model components: transaction-level classifiers, merchant behaviour anomaly detectors, and new-account fraud scorers optimised for high-throughput, low-latency inference
  • Architect and own the Next Best Action (NBA) decisioning engine - a real-time system that selects the highest-expected-value action for each merchant at every interaction
  • Design and build production-grade agentic AI systems that automate high-value analytical and operational workflows
  • Define and execute experiment designs for online evaluation - A/B tests, uplift experiments, and bandits - and analyse results with statistical rigour
  • Set and enforce technical standards across the team: code quality, reproducibility, evaluation rigour, model documentation, and MLOps practices
  • Produce high-quality model documentation and present complex modelling work clearly to stakeholders across Sales, Marketing, Risk, Product, and Operations
What we offer
What we offer
  • Excellent compensation package
  • 25 days annual paid leave (+1 day per year up to 30)
  • Full "Luxury" package health insurance including dental care and optical glasses
  • Meal vouchers of 102.26 EUR per month
  • Fully covered Multisport card
  • Fully covered public transport pass for Sofia
  • Free coffee, snacks and drinks at the office
  • Annual salary reviews, promotions and performance bonuses
  • myPOS Academy for upskilling and training
  • Unlimited access to courses on LinkedIn Learning
  • Fulltime
Read More
Arrow Right

Principal Engineer

We are looking for a strategic and technically deep Principal Engineer to lead t...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
Cisco
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in networking software, embedded systems, or security architecture, with a consistent track record of delivering complex products
  • Deep domain knowledge of Cisco networking architectures, IOS-XR/Classic, and the life cycle of Service Provider or Enterprise routing platforms
  • Strong background in network security, including ACLs, Lawful Intercept, uRPF, Control Plane Policing, and encryption standards
  • A solid conceptual understanding of LLMs and AI workflows, with the ability to identify how these technologies can be applied to network telemetry and data path optimization
  • Expert-level proficiency in C or C++
  • Experience with packet processing, QoS, and traffic management on programmable silicon (e.g., SiliconOne, Broadcom, or similar)
  • Bachelor’s or Master’s degree in Computer Science, Electronics, or a related technical field
Job Responsibility
Job Responsibility
  • Collaborate with LLM and AI research teams to integrate intelligent capabilities into networking platforms, focusing on predictive analytics, automated troubleshooting, and traffic optimization
  • Lead the design of next-generation security features (e.g., hardware-accelerated threat detection, AI-driven anomaly detection, and advanced telemetry) to provide a competitive edge and drive additional product revenue
  • Define the architectural roadmap for high-capacity networking platforms, ensuring they are optimized for both traditional data forwarding and emerging AI-driven workloads
  • Identify opportunities to monetize AI and security features within existing networking products, translating technical innovations into business value and growth
  • Oversee the programming of NPUs and ASICs (e.g., SiliconOne, DNX) to support the high-telemetry demands of AI models and the performance requirements of advanced security protocols
  • Serve as a subject matter expert across business units, mentoring engineers and guiding cross-functional teams through the complexities of hardware-software-AI integration
  • Fulltime
Read More
Arrow Right

Senior Principal AI Infrastructure Architect

The Senior Principal AI Infrastructure Architect is a highly skilled and advance...
Location
Location
Italy , Milano
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant experience in a consulting, presales or architecture role within a large-scale (preferably multi-national) technology services environment, with a track record of leading AI infrastructure pursuits
  • Demonstrable experience designing and delivering production AI platforms — from single multi-GPU servers through to multi-rack training clusters and inference factories
  • Strong working knowledge of the AI hardware vendor landscape (NVIDIA, AMD, Intel, Dell, HPE, Lenovo, Supermicro, Cisco, Pure, VAST, WEKA, DDN, NetApp) and how to position partner ecosystems competitively
  • Proven ability to translate AI workload requirements (model size, parameter count, sequence length, throughput SLOs, latency targets) into accurate hardware bills of materials and sizing justifications
  • Significant client engagement and consulting experience, including client needs assessment, change management and the ability to identify whitespace for follow-on AI infrastructure and managed-services work
  • Significant business development and presales experience on infrastructure-led deals, ideally including sovereign AI, AI Factory or regulated-industry GenAI programmes
  • Strong understanding of how AI infrastructure integrates with business processes, applications, data platforms and existing enterprise architecture
  • Bachelor's degree or equivalent in Information Technology, Engineering, Computer Science or a related field
  • Deep, hands-on knowledge of AI hardware: GPU and accelerator portfolios (NVIDIA Hopper / Blackwell, AMD MI300/MI325, Intel Gaudi 3, emerging custom silicon), host CPU platforms (Intel Xeon, AMD EPYC, NVIDIA Grace), system topologies (HGX, DGX, MGX, OAM) and how each choice maps to specific AI workloads
  • Strong understanding of AI-class storage: parallel filesystems, all-flash NVMe platforms, S3-class object stores, checkpoint and dataset pipelines and the I/O patterns of large-scale training and inference (VAST, WEKA, DDN EXAScaler, Pure FlashBlade, NetApp ONTAP AI, Dell PowerScale)
Job Responsibility
Job Responsibility
  • Lead the end-to-end design of large, complex AI infrastructure solutions — covering accelerated compute (NVIDIA H100/H200/B200 and GB200 NVL72, AMD Instinct MI300X/MI325X, Intel Gaudi 3), CPU host platforms (Intel Xeon, AMD EPYC, NVIDIA Grace), high-throughput storage tiers and lossless AI fabric — for enterprise, sovereign AI and AI Factory clients
  • Architect reference designs built on NVIDIA DGX/HGX SuperPOD, Dell AI Factory with NVIDIA, Cisco Nexus HyperFabric AI, HPE / Lenovo / Supermicro accelerated compute and equivalent platforms, balancing single-node performance with cluster-scale efficiency
  • Size and validate GPU clusters against real workloads — foundation-model pre-training, distributed fine-tuning, RAG, real-time and batch inference — using the right combination of NVLink/NVSwitch domains, InfiniBand NDR/XDR or Ultra Ethernet / NVIDIA Spectrum-X fabrics and tiered NVMe and parallel storage (VAST, WEKA, DDN, Pure FlashBlade, NetApp ONTAP AI, Dell PowerScale)
  • Define the supporting datacenter design: high-density power (50–140 kW/rack), direct-to-chip and rear-door liquid cooling, structured cabling for AI fabrics and modular deployment models across on-prem, colo and sovereign-cloud footprints
  • Work closely with the sales team to drive the presales process for AI infrastructure pursuits — client discovery, technical workshops, proposal writing, executive presentations and bid defence
  • Translate clients' AI ambitions and business outcomes into a hardware and platform roadmap, positioning NTT DATA's end-to-end portfolio — silicon, systems, storage, fabric, MLOps stack and managed services — to land service-led AI solutions
  • Lead integration of compute, storage, networking, the AI software stack (CUDA, ROCm, Triton, NIM, NVIDIA AI Enterprise, Run:ai, Slurm, Kubernetes / Kubeflow) and managed-service operating models across multiple domains, delivery units and geographies
  • Build business cases, TCO and unit-economics models (cost per token, cost per training run, GPU-hour economics) and end-to-end transition roadmaps for cloud-to-private AI migrations and sovereign AI deployments
  • Define architectural principles for AI infrastructure — accelerator utilisation, data gravity, multi-tenancy, model lifecycle, energy efficiency — and apply them to influence architectural outcomes and governance
  • Develop As-Is, Vision, FMO and To-Be AI platform architectures, identify gaps and develop transition roadmaps
  • Fulltime
Read More
Arrow Right

Avp Applications Development Senior Programmer Analyst

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
Canada , Mississauga
Salary
Salary:
94300.00 - 141500.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant experience
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Deep expertise in Large Language Models (LLMs) including OpenAI, Gemini, Claude, Llama, and local/open‑source models
  • Strong hands‑on experience with Python, FastAPI, async programming, SQL and high‑performance AI APIs
  • Solid frontend experience with modern JavaScript frameworks (React, Angular, or Vue)
  • Experience designing and delivering scalable, cloud‑native applications
  • Extensive experience with Gen‑AI frameworks such as LangChain, LangGraph, LlamaIndex, and Hugging Face
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Senior Data Scientist

As a Senior Data Scientist at myPOS, you will be the technical cornerstone of a ...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
mypos.com Logo
myPOS
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • MSc or PhD in Computer Science, Statistics, Applied Mathematics, Econometrics or a related quantitative field (or equivalent commercial experience)
  • 7+ years of applied data science and ML experience in a commercial environment, with a strong portfolio of models in production that drove measurable business outcomes
  • Expert Python for data science and ML engineering: pandas, scikit-learn, XGBoost / LightGBM, PyTorch or TensorFlow
  • clean, tested, modular code as a default
  • Deep expertise across the ML methodological spectrum: survival analysis, time-series and sequence modelling, uplift and causal inference, anomaly detection, and recommendation systems
  • Proven end-to-end ownership of at least three of: CLTV models, churn models, propensity models, fraud/risk models, recommendation or NBA systems - in a production commercial setting
  • Strong MLOps capability: feature stores, model registries, model serving infrastructure, drift monitoring, and CI/CD for ML pipelines
  • Deep SQL and data platform proficiency (GCP / BigQuery strongly preferred)
  • experience with streaming architectures for real-time feature generation
  • Hands-on expertise building LLM-powered applications: RAG pipelines, tool-use agents, multi-agent orchestration, and agent evaluation frameworks
Job Responsibility
Job Responsibility
  • Own the full lifecycle of complex modelling programmes across Customer & Commercial Intelligence: CLTV, Churn Prediction, Propensity to Buy, and Next Most Likely Product (NMLP)
  • Architect multi-horizon churn models and build the churn intervention scoring layer that prioritises at-risk merchants for Account Management teams
  • Lead the NMLP engine - designing and productionizing a multi-output recommendation system that identifies the next product across myPOS's full catalogue
  • Take technical ownership of core fraud model components: transaction-level classifiers, merchant behaviour anomaly detectors, and new-account fraud scorers optimised for high-throughput, low-latency inference
  • Architect and own the Next Best Action (NBA) decisioning engine - a real-time system that selects the highest-expected-value action for each merchant at every interaction
  • Design and build production-grade agentic AI systems that automate high-value analytical and operational workflows
  • Define and execute experiment designs for online evaluation - A/B tests, uplift experiments, and bandits - and analyse results with statistical rigour
  • Set and enforce technical standards across the team: code quality, reproducibility, evaluation rigour, model documentation, and MLOps practices
  • Produce high-quality model documentation and present complex modelling work clearly to stakeholders across Sales, Marketing, Risk, Product, and Operations
What we offer
What we offer
  • Vibrant international team operating in hi-tech environment
  • Excellent compensation package
  • myPOS Academy for upskilling and training
  • Unlimited access to courses on LinkedIn Learning
  • Refer a friend bonus as we know that working with friends is fun
  • Teambuilding, social activities and networks on a multi-national level
  • Fulltime
Read More
Arrow Right