CrawlJobs Logo
T
Thrive Career Wellness Inc · IT - Software Development

LLMOps Engineer

Canada, Toronto 140000.00 - 160000.00 CAD / Year · Job Posted February 24, 2026
Apply Position
Job Link Share

Job Description

We are seeking an experienced and highly skilled LLMOps Engineer to join our team at Thrive. This newly created role will be responsible for deploying, optimizing, and scaling large language model (LLM) applications across our platform. The successful candidate will own the operational backbone of our AI-driven products, ensuring performance, reliability, and cost-efficiency while collaborating closely with our AI and engineering teams. If you are someone who thrives in fast-paced environments, enjoys building scalable AI infrastructure, and is excited about shaping the future of LLM capabilities at Thrive, this is the role for you.

Job Responsibility

  • Lead LLM infrastructure efforts across multiple engineering teams, ensuring scalable, secure, and efficient delivery of AI-powered features
  • Design, build, and maintain production-grade systems for deploying and managing LLMs, including versioning, A/B testing, and rollback strategies
  • Collaborate with the AI team to implement prompt management systems, prompt versioning, and token optimization strategies
  • Monitor and optimize inference latency, throughput, caching strategies, and multi-provider cost management (OpenAI, Anthropic, AWS Bedrock, etc.)
  • Develop observability pipelines including quality metrics, evaluation workflows, error monitoring, and user feedback loops
  • Implement and maintain Retrieval-Augmented Generation (RAG) systems, embedding pipelines, and vector database operations
  • Support fine-tuning workflows and manage model registries for both proprietary and open-source models
  • Implement AI safety guardrails, content filtering, and compliance measures to ensure responsible deployment
  • Support general DevOps initiatives ~10% of the time, including CI/CD improvements and cloud infrastructure updates
  • Maintain thorough documentation of all LLM infrastructure, processes, and best practices

Requirements

  • 3+ years of experience in LLMOps, MLOps, or similar production-focused AI/ML roles
  • Strong Python programming skills and familiarity with LLM libraries and frameworks
  • Hands-on experience with LLM providers (OpenAI, Anthropic, AWS Bedrock, Azure, Vertex, Databricks)
  • Experience with vector databases such as Pinecone, Weaviate, Qdrant, or Chroma
  • Knowledge of model serving tools (vLLM, TGI, Ray Serve)
  • Proficiency with Docker, Kubernetes, and cloud environments (AWS preferred)
  • Familiarity with prompt engineering, token optimization, chain-of-thought approaches, and evaluation metrics
  • Experience with LLM-specific tooling (LangSmith, Weights & Biases, Phoenix, MLflow)
  • Ability to troubleshoot LLM issues such as latency improvements, hallucination mitigation, and context window strategies
  • Strong communication skills with both technical and non-technical stakeholders

Nice to have

  • Experience with open-source LLMs (Llama, Mistral, etc.)
  • Knowledge of advanced RAG techniques including hybrid search and re-ranking
  • Exposure to agent frameworks and real-time LLM applications
  • Background in traditional MLOps, data engineering, or multimodal models
  • Experience with Ruby on Rails
  • Understanding of AI safety and alignment principles

What we offer

  • 3 weeks paid vacation + 1-week holiday shutdown
  • Health insurance & wellness coverage
  • Yearly Learning & Development Allowance
  • Yearly Workspace Allowance
Thrive Career Wellness Inc - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

LLMOps Engineer

8 matching positions

Senior MLOps / LLMOps Engineer

Location
Location
Germany , Berlin
Salary
Salary:
Not provided
immoscout24.de Logo
ImmoScout24 GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience in MLOps (CI/CD, Docker, Kubernetes) and operating production-grade systems
  • Proficiency in Python and solid software engineering and scalable system design skills
  • Hands-on experience with LLMs and generative AI technologies (e.g. GPT, Gemini or Anthropic-like models)
  • Expertise in prompt engineering, agent orchestration, context management, and output validation
  • Experience with LLM evaluation frameworks and deploying self-hosted LLMs
  • Familiarity with cloud platforms (e.g. AWS, GCP) as well as DevOps, testing, and observability practices
  • Strong communication skills and ability to collaborate with cross-functional teams and stakeholders
Job Responsibility
Job Responsibility
  • Design and maintain scalable ML/LLM infrastructure and pipelines
  • Productionize traditional ML and generative AI solutions with cross-functional product teams
  • Own the ML/LLMOps lifecycle: prompting, deployment, monitoring, evaluation and optimization
  • Build and evolve an LLM Gateway service to standardize access, routing, and governance
  • Develop evaluation frameworks to measure quality, performance, and reliability of LLM outputs
  • Design and implement MCP-compatible services to enable standardized context exchange between LLMs, tools, and data sources
  • Integrate MCP into internal platforms to support tool use, retrieval, and agent-based workflows across teams
  • Work with AWS and integrate self-hosted open-source AI models for scalable, secure applications
  • Ensure observability, cost efficiency, and system performance
  • Contribute to project management, stakeholder communication and cross-team collaboration
What we offer
What we offer
  • A competitive salary package and a bonus on top
  • Hybrid work model with three days of on-site work per week in the office
  • 30 days of vacation per year
  • Possibility to work from abroad for 10 days per year
  • Relocation agency support with visa process and attractive relocation package
  • Plus membership for tenants on ImmoScout24
  • Dedicated learning time per month, online courses on ScoutAcademy, regular book challenges, structured feedback, Lunch & Learn events and individual career paths
  • Professional family service for childcare
  • Bring your dog to work (upon approval)
  • Subsidized public transport or Job Bikes
Read More
Arrow Right

Senior LLMOps Engineer

Working closely with our Engineering Manager, you’ll be a Senior LLMOps Engineer...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
heidihealth.com Logo
Heidi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven track record of designing, building, and maintaining MLOps or LLMOps infrastructure in a production environment
  • Previous hands-on experience building scalable, cloud-native infrastructure and platforms
  • Deployed and managed large-scale machine learning models in a production environment
  • Expert in Python, cloud platforms (AWS, GCP, or Azure), containerization (Docker, Kubernetes), and Infrastructure as Code (e.g., Terraform, CloudFormation)
  • Deep and practical understanding of the entire machine learning lifecycle and the specific operational challenges of large language models
  • Ability to translate complex engineering and research requirements into concrete, robust, and automated platform solutions
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Lead the architecture, design, and implementation of our end-to-end LLMOps platform, from data ingestion and model training pipelines to production deployment and monitoring
  • Build and maintain robust CI/CD/CT (Continuous Integration/Continuous Delivery/Continuous Training) pipelines to automate the testing, validation, and deployment of large language models
  • Engineer highly available and scalable model serving solutions using modern infrastructure like Kubernetes, ensuring low latency and high throughput for our production services
  • Collaborate closely with AI research and engineering teams to understand their needs, streamline workflows, and create the tooling that accelerates their development cycles
  • Champion and implement best practices for model versioning, experiment tracking, monitoring, and governance across the organization
  • Mentor mid-level and junior engineers, sharing your deep expertise in infrastructure, automation, and operational excellence to foster a culture of reliability and scalability
What we offer
What we offer
  • Flexible hybrid working environment, with 3 days in the office
  • Additional paid day off for your birthday and wellness days
  • Special corporate rates at Anytime Fitness in Melbourne, Sydney tbc
  • A generous personal development budget of $500 per annum
  • Learn from some of the best engineers and creatives, joining a diverse team
  • Become an owner, with shares (equity) in the company
  • Fulltime
Read More
Arrow Right

Applied Ai Engineer

You will be working with the Head of Data and AI office on R&D and Product initi...
Location
Location
Poland
Salary
Salary:
16000.00 - 24000.00 PLN / Month ▼
https://www.montrosesoftware.com/ Logo
Montrose Software
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience delivering end-to-end Data and AI solutions and products
  • Experience in delivering systems and solutions with LLM agentic architectures
  • Understanding of cloud-native architectures and operations
  • Hands-on experience with Databricks or a comparable Lakehouse platform (Snowflake, BigQuery + Vertex, Microsoft Fabric)
  • Familiarity with machine learning mathematical toolboxes
  • Experience with containerized, scalable, elastic deployments, microservice architecture (REST, gRPC)
  • Comfortable with data engineering
  • Proficiency with SQL
  • Understanding of data architectures: OLTP, OLAP, vector and graph databases, column-based file formats
  • Knowledge of DevOps, MLOps, LLMOps best practices
Job Responsibility
Job Responsibility
  • Define and develop proof of concepts for Data and AI products and solutions
  • Conduct market and technology research
  • architect optimal solutions to address business challenges
  • Map AI/ML techniques to specific business problems
  • Build and productionise solutions on the Lakehouse (Databricks: Unity Catalog, Delta Lake, MLflow, Model Serving, Mosaic AI Agent Framework, Vector Search)
  • Forecast operational AI costs for solutions at scale
  • Support business intelligence reporting to guide Data solutions
  • Develop end-to-end data products and solutions with an MLOps and LLMOps mindset within Montrose Software’s Data and AI framework
  • Conduct product and feature discovery meetings with Clients aiming for a cost efficient solution addressing clients goals within their context like budgets, operations, talent pools, data maturity
  • Execute within Montrose's AI delivery and ops patterns and best practices
What we offer
What we offer
  • High-quality equipment
  • Flexible working hours
  • Remote work possibility
  • International project teams
  • English lessons
  • Training budget
  • Clear career path
  • Private medical insurance
  • Multisport card
  • Lunch budget
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

We believe in the power of ingenuity to build a positive human future. We challe...
Location
Location
United Kingdom , Manchester
Salary
Salary:
Not provided
paconsulting.com Logo
PA Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Software engineers with a passion for AI – or data scientists who’ve embraced engineering
  • People who experiment, prototype, and explore emerging AI tools in their own time
  • Strong foundation in a language suited to AI system development and data workflows
  • Experience integrating models with APIs, data sources, or production systems
  • Curiosity about LLMs, RAG pipelines (Graph & Vector based), and agent frameworks
  • Understanding of cloud-native (AWS / GCP / Azure) and DevOps / DevSecOps practices
  • A collaborative mindset and willingness to share, learn, and teach
  • Understanding of prompt and context engineering and model evaluation
  • Solid grasp of distributed systems, microservices, and RESTful APIs
  • An understanding of LLMOps tools for managing GenAI workflows
Job Responsibility
Job Responsibility
  • Work to agile best practices and cross-functionally with multiple teams and stakeholders
  • Use technical skills to problem solve with clients
  • Work on internal projects
  • Live in-person whiteboarding sessions
  • Hybrid working with the team on client site or in our office a minimum of two days per week
  • Explore emerging technologies
  • Experimenting with Generative AI frameworks and tools
  • Building retrieval-augmented generation (RAG) prototypes
  • Developing and testing agentic architectures
  • Exploring LLMOps, evaluation tools, and model observability platforms
What we offer
What we offer
  • Health and lifestyle perks accompanying private healthcare for you and your family
  • 25 days annual leave (plus a bonus half day on Christmas Eve) with the opportunity to buy 5 additional days
  • Generous company pension scheme
  • Opportunity to get involved with community and charity-based initiatives
  • Annual performance-based bonus
  • PA share ownership
  • Tax efficient benefits (cycle to work, give as you earn)
  • Fulltime
Read More
Arrow Right
New

Senior AI Engineer – LLM & Agentic Systems

Our partner, Hungary's largest agricultural machinery manufacturer, is looking f...
Location
Location
Hungary , Budapest
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
September 30, 2026
Flip Icon
Requirements
Requirements
  • Relevant Education: successfully completed a degree in computer science, data science, software engineering, mathematics, or a comparable field is a big advantage
  • AI & ML Experience: proven track record in developing AI- or ML-based applications, ideally with a strong focus on Large Language Models (LLMs)
  • Programming & Frameworks: sound knowledge of Python and hands-on experience with relevant AI libraries and frameworks, such as LangChain and LangGraph
  • Cloud & Microservices: experience with cloud platforms (primarily Azure or AWS) and designing distributed systems or microservice architectures using Java and Spring Boot
  • API & Core Concepts: deep familiarity with developing and integrating APIs, container technologies (Docker, Kubernetes), prompt engineering, RAG, vector databases, and agent-based systems
  • CI/CD & MLOps: knowledge or experience with CI/CD, MLOps, or LLMOps practices is considered a strong plus
  • Consultative & Communication Skills: excellent teamwork, solution-oriented mindset, and very good English communication skills (written and spoken) to effectively advise business departments
  • German knowledge is a plus
Job Responsibility
Job Responsibility
  • Generative AI Production: Design, implement, and operate services based on modern Large Language Models (LLMs) for productive systems
  • Agentic Workflows: Build intelligent, autonomous agent-based workflows together with our development teams
  • Cloud Architecture: Design and implement scalable microservice architectures that deliver AI functionality in cloud environments (Azure, GCP or AWS)
  • RAG Optimization: Develop and optimize Retrieval-Augmented Generation (RAG) pipelines as well as prompt and tool integrations
  • Cross-Functional Integration: Partner closely with various business departments, product, data, and infrastructure teams to integrate AI solutions into existing systems and business processes
  • Performance & Evaluation: Ensure the performance, scalability, and reliability of AI services through monitoring, testing, and deployment, while continuously evaluating new Generative AI trends
What we offer
What we offer
  • Fast growing company with strong and stable international background
  • Interesting company scope with improvement opportunities
  • Market level compensation package
  • Inspiring work atmosphere
  • Great team work and familiar company culture
  • Opportunity for joining a new Hungarain team with great ambitions
  • Hybrid working model (around 10% onsite)
  • Fulltime
Read More
Arrow Right

Staff AI Engineer

Rapid7 is seeking a Staff AI Engineer to join our Data Science team as we expand...
Location
Location
India , Pune
Salary
Salary:
Not provided
rapid7.com Logo
Rapid7
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–12 years of experience as a Data Scientist, ML Engineer, or AI Engineer
  • Strong end-to-end practical expertise in ML/AI/DS
  • Able to explore, experiment, and deliver independently
  • Proficiency in scikit-learn, PyTorch, TensorFlow, Keras, HuggingFace, LangChain, Transformers, Pandas, NumPy
  • Strong communication skills
  • Collaboration across engineering, data science, product, and security teams
  • Experience mentoring and guiding junior data scientists
  • Agentic AI and LLM expertise
  • Hands-on experience with agentic AI architectures (CrewAI, LangGraph, LangChain agents, tool-calling, function-chaining)
  • Experience building multi-step reasoning workflows, autonomous agents, or LLM-powered decision systems
Job Responsibility
Job Responsibility
  • Work with security teams to define, scope, and design research efforts for new threat detections, automations, and AI-driven workflows
  • Collaborate with data scientists to transform research into production-ready solutions, mentoring on both methods and execution
  • Research, build, and evaluate ML and generative/LLM models, including agentic and multi-step reasoning systems
  • Design and optimise agentic architectures, including tool-calling, decision-making, memory, orchestration, and evaluation frameworks
  • Partner with engineering teams to ship AI features, integrating models into high-scale systems
  • Deploy AI/ML workloads in AWS using SageMaker, Bedrock, Lambda, EKS, Step Functions, and related services
  • Contribute to our LLMOps and MLOps workflows, improving evaluation pipelines, observability, reproducibility, and governance
  • Support development of AI security features, improving reasoning, context understanding, automation, and analyst workflows
  • Embrace agile development, iterative experimentation, and collaborative problem solving
  • Mentor junior team members and uplift the technical bar for agentic AI and ML engineering
  • Fulltime
Read More
Arrow Right

Senior Data Scientist – Gen AI Engineer - Assistant Vice President

Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Data Science, Artificial Intelligence, or a related quantitative field.
  • 8–12 years of experience as a Data Scientist or equivalent role, with at least 2 years of specialized, hands-on experience in Generative AI, including leading technical development and mentoring teams.
  • Demonstrable experience across the full lifecycle of production-level GenAI projects — from ideation and prototyping through deployment, monitoring, and ongoing maintenance in live environments.
  • Expert-level Python proficiency
  • Scikit-learn, XGBoost, LightGBM
  • PyTorch
  • Hugging Face Transformers, LangChain, LlamaIndex, Semantic Kernel
  • LangGraph, CrewAI, AutoGen
  • Transformer architectures
  • RAG patterns
Job Responsibility
Job Responsibility
  • Working with financial and enterprise data, applying modern NLP and GenAI techniques to solve business problems.
  • Designing, refining, and systematizing prompt engineering strategies for large language models (LLMs), including structured prompting, chain-of-thought, and few-shot/zero-shot approaches.
  • Collaborating with business stakeholders to translate requirements into GenAI-powered solutions.
  • Developing, testing, and maintaining production-grade Python code for GenAI applications.
  • Integrating with vector databases (e.g., Pinecone, Weaviate, Milvus, pgvector, Qdrant) for retrieval-augmented generation (RAG) pipelines.
  • Building, monitoring, and optimizing MLOps/LLMOps pipelines for continuous model deployment and observability.
  • Researching and evaluating emerging GenAI technologies, frameworks, and best practices to maintain competitive advantage.
  • Troubleshooting and debugging GenAI models and agentic systems in production, including rapid identification and resolution of issues in real-world deployments.
  • Communicating complex AI/ML concepts clearly to non-technical stakeholders, translating technical jargon into actionable business terms.
  • Participating in and leading team meetings, design reviews, and architecture discussions.
  • Fulltime
Read More
Arrow Right

AI & Data Solution Architect

Carrier is seeking a highly skilled and forward‑thinking AI & Data Solution Arch...
Location
Location
United States , Atlanta
Salary
Salary:
96000.00 - 192000.00 USD / Year
berettaclima.it Logo
Beretta Clima Italia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in engineering or technical discipline
  • 8+ years hands‑on experience in data architecture, analytics solutions, and/or cloud data platforms
  • 3+ years of hands‑on experience delivering AI/ML and Generative AI solutions in production
  • 6+ years of experience designing and scaling enterprise data platforms on GCP, AWS, and Snowflake
  • Must have unrestricted authorization to work in the USA. No visa sponsoring available.
Job Responsibility
Job Responsibility
  • Define and evolve Carrier’s AI & Data architecture strategy and roadmap, aligned with business priorities and IT strategy
  • Serve as a thought leader for modern data, analytics, and AI architectures, including Generative AI and Agentic AI
  • Identify, evaluate, and recommend emerging technologies, platforms, and architectural patterns
  • Partner with business and digital leaders to identify and prioritize high‑impact AI and analytics use cases
  • Provide architectural guidance on ethical, responsible, and compliant AI adoption
  • Lead end‑to‑end architecture design for complex data, analytics, and AI initiatives, ensuring scalability, performance, security, and cost efficiency
  • Design and govern cloud‑based data platforms leveraging: Google Cloud Platform (BigQuery, Vertex AI, Dataflow, Dataproc, Looker), AWS (S3, Glue, EMR, Redshift, SageMaker, Lambda), Snowflake (data warehouse, data sharing, performance optimization)
  • Architect modern enterprise data architectures, including: Data Lake, Lakehouse, Data Mesh, and Data Fabric, Open table/file formats such as Parquet, Iceberg, Delta Lake, Medallion architectures (Bronze/Silver/Gold)
  • Define data ingestion and integration patterns across structured and semi‑structured sources (SAP, Oracle, Salesforce, JDE, Ariba, IoT, APIs, NoSQL)
  • Define and enforce data quality, metadata, lineage, and access control standards
What we offer
What we offer
  • Health Care Benefits: Medical, Dental, Vision
  • Wellness incentives
  • Retirement Benefits
  • Paid vacation days, up to 15 days
  • paid sick days, up to 5 days
  • paid personal leave, up to 5 days
  • paid holidays, up to 13 days
  • birth and adoption leave
  • parental leave
  • family and medical leave
  • Fulltime
Read More
Arrow Right