CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Principal LLM Engineer

United States, Oakland · Job Posted March 13, 2026
Apply Position
Job Link Share

Job Description

We are looking for a Principal LLM Engineer to lead the design and development of advanced LLM applications that enhance our video-based medical education platform. This role offers a unique opportunity to shape the future of how healthcare professionals access and engage with cutting-edge clinical knowledge. If you are passionate about creating intelligent, scalable solutions to improve user experiences, we invite you to join our dynamic team in Oakland, California.

Job Responsibility

  • Develop and deploy workflows powered by large language models (LLMs) to improve the search, recommendation, and personalization capabilities of the platform
  • Collaborate with product, data, and AI teams to create intelligent services such as classification, relevance ranking, and summarization
  • Establish and enforce architectural standards across backend, frontend, and infrastructure layers to ensure system reliability and scalability
  • Lead modernization efforts for backend systems built on Python/Django and frontend technologies like React
  • Mentor engineering teams, providing technical guidance and fostering best practices through code reviews and collaborative design sessions
  • Conduct technical exploration of emerging tools and technologies, including vector databases and real-time video personalization frameworks
  • Prototype and test innovative solutions to ensure the platform remains at the forefront of applied AI developments

Requirements

  • 10+ years of experience developing and scaling software systems
  • 5+ years experience shipping LLM applications particularly in consumer-focused or AI-driven products
  • Proven track record as a Principal Engineer, Staff Engineer, or Architect in leading complex system designs
  • Proficient in Python, with preferred experience in frameworks such as Django, Flask, or FastAPI
  • Demonstrated knowledge in cloud architectures and distributed systems, including services like EC2, Lambda, S3, and CloudFront

What we offer

  • medical
  • vision
  • dental
  • life and disability insurance
  • eligible to enroll in our company 401(k) plan
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal LLM Engineer

8 matching positions

Principal Engineer Software - LLM(Cortex Agentix)

As a Principal Software Engineer, you will be a technical trailblazer responsibl...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience as a software engineer
  • Deep understanding of prompting and context management
  • Hands-on experience building and running LLM-based systems in production
  • Experience defining system architectural vision end-to-end
  • Capability to define scalable data-driven standards
  • Strong Python skills, with working knowledge of Go
  • Experience with end-to-end codebase ownership, including CI/CD, testing, and releases
  • Familiarity with security and automation workflows, APIs, integrations, and building automated responses
Job Responsibility
Job Responsibility
  • Define and own the technical vision for the Cortex Platform's automation foundations and Agentic AI integrations
  • Architect highly resilient and non-deterministic systems, designing abstract frameworks that optimize security workflows for autonomous planning and execution
  • Define the right technical approach for emerging challenges where no proven solution yet exists, specifically addressing LLM limitations like latency, hallucinations, and determinism
  • Define global technical standards for the platform's automation ecosystem, merging advanced CI/CD governance with robust telemetry and metrics to track execution health across thousands of production tenants
  • Align diverse engineering stakeholders around a single, cohesive technical direction for platform-wide automation and integration features
  • Drive step-function improvements in system reliability and quality, establishing a technical roadmap that anticipates the next generation of 'Agentic Response'
  • Fulltime
Read More
Arrow Right

Python Software Engineer with LLM (Principal)

You will be a founding member of a new, globally distributed team dedicated to a...
Location
Location
Poland , Kielce; Kraków; Wrocław
Salary
Salary:
30000.00 - 37000.00 PLN / Month
virtuslab.com Logo
VirtusLab
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven polyglot programming skills with the ability to rapidly learn new languages, frameworks, and domains
  • Strong, hands-on experience in Python
  • Hands-on, practical experience building with or integrating LLMs, coding assistants, or AI agents
  • A proactive, self-starter attitude
  • Excellent communication skills in English and the ability to effectively collaborate with team members in the US West Coast time zone
Job Responsibility
Job Responsibility
  • Design and implement integrations with cutting-edge Large Language Models (LLMs) and APIs (like OpenAI’s models, Anthropic’s Claude, and more)
  • Develop intelligent, agent-based systems to automate and assist in complex software development tasks
  • Engineer the core infrastructure for our AI agents, including components like MCP servers
  • Seamlessly weave AI capabilities into the daily workflows of our developers by integrating with essential tools like GitHub, Slack, IDEs, and client internal services, mostly Scala-based
  • Collaborate within a distributed, international team to research, prototype, and deploy solutions that have a direct impact on developer productivity and satisfaction
What we offer
What we offer
  • Building tech community
  • Flexible hybrid work model
  • Home office reimbursement
  • Language lessons
  • MyBenefit points
  • Private healthcare
  • Training Package
  • Fulltime
Read More
Arrow Right

Principal Engineer - Capital Markets Regulatory Technology

Wells Fargo is seeking a Principal Engineer within the Commercial Corporate & In...
Location
Location
United States , Charlotte
Salary
Salary:
159000.00 - 305000.00 USD / Year
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
June 27, 2026
Flip Icon
Requirements
Requirements
  • 7+ years of Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 4 + years of Software Engineering experience, with at least 5 years in a principal or Lead Architect capacity within a global Capital Markets environment
  • 4+ years in FICC Trade Life Cycle: Deep domain knowledge of Fixed Income, Currencies, and Commodities, including trade capture, valuation models, and lifecycle event management
  • 4+ years High-Performance Stack: Proven mastery of Java (concurrency, JVM tuning) and Python (FastAPI, data science libraries)
  • 4+ years Distributed Systems: Extensive experience with gRPC, Service Mesh (Istio/Linkerd), and high-performance messaging protocols
Job Responsibility
Job Responsibility
  • Architect, build, and lead the next-generation Strategic Trade Management platform components for our Fixed Income, Currencies & Commodities (FICC) and Derivatives businesses
  • Contribute to the end-to-end technical vision for a vertically integrated system-of-record that positions Wells Fargo Trading Businesses with a competitive advantage while introducing agentic, AI-augmented workflows that accelerate business growth
  • Working directly with trading desks, quant teams, and senior technology leadership, drive the modernization journey that supports double-digit business expansion, regulatory agility, and next-generation client experience in one of the most dynamic capital markets environments
  • Hands-on, Lead by example — design, code, and deliver production-grade microservices using Java, gRPC, Python/FastAPI, service mesh, reactive architectures, and Micro Front-End patterns. Integrate agentic development practices with GitHub Copilot and custom LLM agents to accelerate delivery velocity
  • Engineer sub-millisecond trade processing paths for rates, credit, FX, and commodities while maintaining strict non-functional requirements (NFRs) for throughput, resilience, data consistency, and auditability
  • Lead the decommissioning of legacy monolithic systems and the migration to a cloud-native, vertically integrated system-of-record with embedded agentic intelligence for trade-event modeling, exception handling, and real-time valuations
  • Partner across Trading, Quant, Risk, Operations, and Compliance to translate complex business needs into scalable technology solutions. Influence enterprise standards, architecture review boards, and capital markets platform strategy
  • Mentor senior engineers and technologists
  • establish best practices for secure, observable, and testable code
  • drive adoption of modern engineering disciplines across the Capital Markets Technology organization
What we offer
What we offer
  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Fulltime
!
Read More
Arrow Right

Principal Engineer

We are looking for a strategic and technically deep Principal Engineer to lead t...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
Cisco
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in networking software, embedded systems, or security architecture, with a consistent track record of delivering complex products
  • Deep domain knowledge of Cisco networking architectures, IOS-XR/Classic, and the life cycle of Service Provider or Enterprise routing platforms
  • Strong background in network security, including ACLs, Lawful Intercept, uRPF, Control Plane Policing, and encryption standards
  • A solid conceptual understanding of LLMs and AI workflows, with the ability to identify how these technologies can be applied to network telemetry and data path optimization
  • Expert-level proficiency in C or C++
  • Experience with packet processing, QoS, and traffic management on programmable silicon (e.g., SiliconOne, Broadcom, or similar)
  • Bachelor’s or Master’s degree in Computer Science, Electronics, or a related technical field
Job Responsibility
Job Responsibility
  • Collaborate with LLM and AI research teams to integrate intelligent capabilities into networking platforms, focusing on predictive analytics, automated troubleshooting, and traffic optimization
  • Lead the design of next-generation security features (e.g., hardware-accelerated threat detection, AI-driven anomaly detection, and advanced telemetry) to provide a competitive edge and drive additional product revenue
  • Define the architectural roadmap for high-capacity networking platforms, ensuring they are optimized for both traditional data forwarding and emerging AI-driven workloads
  • Identify opportunities to monetize AI and security features within existing networking products, translating technical innovations into business value and growth
  • Oversee the programming of NPUs and ASICs (e.g., SiliconOne, DNX) to support the high-telemetry demands of AI models and the performance requirements of advanced security protocols
  • Serve as a subject matter expert across business units, mentoring engineers and guiding cross-functional teams through the complexities of hardware-software-AI integration
  • Fulltime
Read More
Arrow Right

Principal Engineer Conversational AI

We’re building a world of health around every individual — shaping a more connec...
Location
Location
United States , Wellesley
Salary
Salary:
144200.00 - 288400.00 USD / Year
https://www.cvshealth.com/ Logo
CVS Health
Expiration Date
July 02, 2026
Flip Icon
Requirements
Requirements
  • 10+ years of experience with designing and building software engineering solutions in cloud environments
  • 10+ years of experience in one or more modern languages, such as Python, Java, C#, JavaScript, SQL, etc
  • 10+ years of experience with APIs, microservices, and modern software patterns
  • 5+ year(s) of soliciting complex requirements and managing relationships with key stakeholders
  • Strong understanding of conversational AI technologies (e.g., chatbots, voice assistants, LLMs, STT/TTS, NLU/NLP engines)
  • Bachelor degree from accredited university or equivalent work experience (HS diploma + 4 years relevant experience)
Job Responsibility
Job Responsibility
  • Create a technical vision to meet short- and longer-term business needs
  • Ensure the long-term quality of the design and code of our software systems
  • Oversee the creation and own critical software components
  • Lead hands-on, perform design and code and reviews
  • Help deploy and maintain large scale software in Production, ensure operational excellence
  • Possess expert knowledge in performance, scalability, distributed architecture, and engineering best practices
  • Help translate business requirements into software system in an Agile environment
  • Serve as technical lead on the most demanding, cross-functional projects
  • Advise leadership on technical decisions, strong communications skills required
  • Help the career development of other team members, mentor individuals on advanced technical issues, help managers grow their teams
What we offer
What we offer
  • Medical
  • dental
  • vision coverage
  • paid time off
  • retirement savings options
  • wellness programs
  • bonus
  • commission or short-term incentive program
  • equity award program
  • Fulltime
Read More
Arrow Right

Principal Engineer, Engineering AI Productivity

We’re not just building better tech. We’re rewriting how data moves and what the...
Location
Location
United States
Salary
Salary:
285000.00 - 342000.00 USD / Year
confluent.io Logo
Confluent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years driving strategic productivity initiatives, ideally in SaaS/Cloud platforms or developer tools with some proven experience in AI initiatives
  • Considered an expert in building distributed systems and/or the infrastructure and tools to support it
  • Proven ability to lead cross-functional teams and influence senior stakeholders without direct authority
  • Strong communicator who can translate complex technical strategies into impact-oriented outcomes
  • Demonstrated track record delivering products or features that generated measurable business value
  • Comfortable defining success criteria, metrics, and ROI for ambiguous, future-facing domains
  • Hands-on experience with AI or adjacent AI/ML platform experience with LLM integration and workflow automation, with demonstrated appetite to build toward agentic patterns
  • Deep understanding of responsible AI practices and governance
  • Passion for solving real customer problems with elegant, scalable solutions
  • Ability to tie technical efforts directly to business KPIs (adoption, retention, revenue impact)
Job Responsibility
Job Responsibility
  • Define and evangelize the AI and agentic flows strategy — aligning business metrics, engineering needs, and platform opportunities
  • Build a roadmap for introducing agentic automation features, smart assistants, and AI-driven workflows across all aspects of engineering
  • Identify and resolve bottlenecks across the entire product and software development life cycle
  • Partner with Engineering, Trust and Security to integrate AI capabilities responsibly and at scale
  • Operationalize AI adoption internally and share use cases externally
  • Drive complex cross-team projects requiring multi-stakeholder alignment
  • Continuously raise the bar for code/architectural quality across engineering
  • Lead the delivery of core agentic workflows that improves productivity across engineering
  • Balance of hands-on contributions with effective delegation to others
  • Expect 60% execution and 40% strategy setting
What we offer
What we offer
  • Remote-First Work
  • Robust Insurance Benefits
  • Flexible Time Away
  • The Best Teammates
  • Experience Ambassadors
  • Open and Honest Culture
  • Well-Being and Growth
  • Offers Equity
  • Fulltime
Read More
Arrow Right

Principal Engineer, UI Platform & Experiences

We are rebuilding the Tripleseat front-end on shadcn/ui, Radix, Tailwind, and Re...
Location
Location
United States
Salary
Salary:
200000.00 - 220000.00 USD / Year
tripleseat.com Logo
Tripleseat
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years building production UIs at SaaS scale
  • Humble, hungry, and smart. You have high standards and strong opinions, but low ego. You build trust, listen well, and know how to push for better outcomes while bringing others along
  • Deep expertise in React 18, TypeScript, Tailwind, Radix, and modern front-end tooling
  • Hands-on experience with shadcn/ui in a production environment, not just prototyping
  • Shipped AI-powered UX in production: LLM streaming UIs, tool-call flows, agentic interfaces, or RAG surfaces
  • Fluent in AI-native development workflows (Cursor, Claude Code, or equivalent) with demonstrated throughput gains
  • Strong testing philosophy with hands-on experience in component, visual regression, and end-to-end testing for production UIs
  • Track record of leading large front-end migrations without stalling product velocity
  • Strong design sensibility and a history of close partnership with Product Design leaders
Job Responsibility
Job Responsibility
  • Own the creation of a modern UI platform and component system that rapidly enables Tripleseat AI features
  • Architect the Tripleseat component system on top of shadcn/ui, Radix primitives, and Tailwind
  • Define theming, design tokens, composition patterns, and accessibility baselines across the product
  • Design AI-native UX patterns: streaming responses, tool-calling surfaces, inline assistance, agentic flows, and human-in-the-loop review
  • Design and own the Tripleseat UI MCP server, enabling agentic workflows and LLM-powered tooling to interact with the component system and product surfaces
  • Build agentic workflows that automate UI migration, component adoption, and ongoing UI consistency at scale
  • Lead the Kendo to shadcn migration and the overall UI modernization, collapsing two front-end codebases into one
  • Partner with Product and Design on the UX redesign for clarity, speed, and ease of use, directly tied to our 1H26 Defining Objectives
  • Set front-end engineering standards, performance budgets, and the craft bar across approximately 36 engineers
  • Establish front-end testing standards, including component testing, visual regression, and end-to-end coverage, and drive adoption across the engineering org
What we offer
What we offer
  • Competitive Medical, Dental, and Vision Insurance
  • Company Paid Life Insurance, Short- and Long-Term Disability Plans
  • Supplemental Insurance Options
  • Commuter Benefits
  • 401(k) with Company Match
  • Parental Leave
  • Flexible Paid Time Off
  • LinkedIn Learning Access
  • Pet Insurance
  • Employee Discount Programs
  • Fulltime
Read More
Arrow Right

Principal Engineer, ASIC Development Engineering (Frontend Architect - AI Storage Solutions)

In this Frontend Architect position, you will develop AI Storage Solutions based...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
sandisk.com Logo
Sandisk
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelors or Masters or PhD in Computer/Electrical Engineering with 8+ years of hands-on Architecture experience authoring specifications
  • Strong technical background architecting SoC and I/O subsystems involving PCIe and PCIe-DMA engines, or UCIe or CXL or UAL
  • Strong IO subsystem microarchitecture, technical, and working knowledge of the PCIe/UCIe protocol specifications
  • Knowledge of I/O Subsystem and DMA interactions with internal embedded processor-subsystems (x86, RISC-V or ARM) and external host CPU
  • Good understanding of computer/graphics architecture, ML, LLM
  • Architecting an GPU/TPU/xPU Accelerator systems with optimized high bandwidth memory hierarchy and frontend architecture for multi-trillion parameter LLM training/inference including Dense, Mixture of Experts (MoE) with multiple modalities (text, vision, speech)
  • Deep experience optimizing large-scale ML systems, GPU architectures
  • Proficiency in principles and methods of microarchitecture, software, and hardware relevant to performance engineering
  • Multi-disciplinary experience, including familiarity with Firmware and ASIC design
  • Expertise in CUDA programming, GPU memory hierarchies, and hardware-specific optimizations
Job Responsibility
Job Responsibility
  • Responsible for driving the SoC architecture, with a particular focus on I/O subsystems connected over UCIe, PCIe, UAL or CXL
  • Define I/O subsystem and PCIe DMA architectures, including their interactions with internal embedded processor-subsystems, Network on Chip, Memory controllers, and FPGA fabric
  • Create flexible and modular I/O subsystem architectures that can be deployed in either chiplet, monolithic or 3D form factors
  • Work with customers, and cross-functional teams to scope SoC requirements, analyze PPA tradeoffs, and then define architectural requirements that meet the PPA and schedule targets
  • Define I/O subsystem and DMA hardware, software, and firmware interactions with embedded processing subsystems and SoC CPUs on the device side and Host CPUs
  • Author architecture specifications in clear and concise language. Guide and assist pre-silicon design/verification and post-silicon validation during the execution phase
  • Responsible for improving the AI/ML ASIC Architecture performance through hardware & software co-optimization, post-silicon performance analysis, and influencing the strategic product roadmap
  • LLM Workload analysis and characterization of ASIC and competitive datacenter and AI solutions to identify opportunities for performance improvement in our products
  • Experience architecting one or some components of AI/ML accelerator ASICs such as HBM, PCIe/UCIe/CXL, NoC, DMA, Firmware Interactions, NAND, xPU, fabrics, etc
  • Drive the AI Storage Solutions frontend system architecture with GPU/TPU/NPU/xPU to match or exceed the nextgen HBM bandwidth
  • Fulltime
Read More
Arrow Right