CrawlJobs Logo
Crusoe Logo Crusoe · IT - Software Development

Senior Software Engineer, Managed AI - AI model LifeCycle

United States, San Francisco 172425.00 - 209000.00 USD / Year · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

The Senior Software Engineer for the Model LifeCycle team will contribute to building a managed platform for the entire application development lifecycle, with a specific focus on leveraging Machine Learning models, including Large Language Models (LLMs).

Job Responsibility

  • Implement and maintain systems for fine-tuning large foundation models (SFT, PEFT, LoRA, adapters), including multi-node orchestration, checkpointing, failure recovery, and cost-efficient scaling
  • Implement and maintain end-to-end training pipelines for Large Language Models
  • Implement components for distillation and reinforcement learning pipelines (e.g., preference optimization, policy optimization, reward modeling)
  • Develop and maintain core agent execution infrastructure
  • Implement features for dataset, model, and experiment management, focusing on versioning, lineage, evaluation, and reproducible fine-tuning
  • Work closely with Senior Engineers and Principal Engineers, as well as product and platform teams, to implement system abstractions and APIs
  • Contribute to technical discussions on training runtimes, scheduling, storage, and model lifecycle management
  • Engage with the open-source LLM ecosystem

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Experience delivering production-ready features
  • Familiarity with essential cloud-based services (e.g., compute, storage, networking)
  • Familiarity with Generative AI (Large Language Models, Multimodal)
  • Experience with AI infrastructure components (training, inference)
  • 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function

Nice to have

  • Proficiency in Golang or Python for production services
  • Familiarity with PyTorch
  • Some experience with training and fine-tuning LLMs
  • Proactive and collaborative approach
  • Strong communication and interpersonal skills
  • Passion for building AI products and solving technical problems

What we offer

  • Restricted Stock Units
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Subscription to the Calm app
  • MetLife Legal
  • Company paid commuter benefit
  • $300/month
Crusoe - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Software Engineer, Managed AI - AI model LifeCycle

8 matching positions

Senior Software Engineer, Managed AI - AI Platform

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'...
Location
Location
United States , San Francisco, CA; Sunnyvale, CA
Salary
Salary:
172425.00 - 209000.00 USD / Year
crusoe.ai Logo
Crusoe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced degree in Computer Science/Engineering
  • 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
  • Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly
  • Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines)
  • Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD
Job Responsibility
Job Responsibility
  • Lead the design and implementation of core AI services, including: Resilient fault-tolerant queues for efficient task distribution
  • Model catalogs for managing and versioning AI models
  • Scheduling mechanisms optimized for cost and performance
  • Architect and scale infrastructure to handle millions of API requests per second
  • Implement robust monitoring and alerting to ensure system health and 24/7 availability
  • Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap
  • Influence the long-term vision and architectural decisions of the platform
  • Contribute to open-source AI frameworks and actively participate in the AI community
  • Prototype and rapidly iterate on emerging technologies and new features
What we offer
What we offer
  • Restricted Stock Units
  • Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
  • Employer contributions to HSA accounts
  • Paid Parental Leave
  • Paid life insurance, short-term and long-term disability
  • Teladoc
  • 401(k) with a 100% match up to 4% of salary
  • Generous paid time off and holiday schedule
  • Cell phone reimbursement
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, AI Enterprise Engineering

The AI Operations & Enablement team serves as the engine for Bentley Systems' in...
Location
Location
United States , Philadelphia
Salary
Salary:
Not provided
bentley.com Logo
Bentley Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in Computer Science, Engineering, or a related field
  • 8+ years of professional software development experience, with at least 2 years in a technical leadership or management role
  • Proven experience of leading hybrid software engineering teams, with a strong emphasis on managing external vendors to ensure accountability and value delivery
  • Prior experience of leading software teams in greenfield technology evaluations and successfully delivering proof-of-concept projects that influence long-term technical roadmaps
  • Proven experience in designing and building large-scale, distributed systems
  • Expertise in one or more object-oriented programming languages such as Python, Java, or C#
  • Extensive experience with cloud computing platforms (e.g., Azure, AWS, GCP)
  • A track record of influencing technology strategy beyond your immediate team, contributing to cross-functional architectural standards and best practices
  • Demonstrated experience in the commercial aspects of technology, including running RFPs, negotiating consultant SoWs or application licensing agreements, and managing vendor relationships
  • Experience in mentoring software engineers and helping to build a high-performing technical team, with a proven track record of contributing to their growth and development
Job Responsibility
Job Responsibility
  • Guide the engineering effort across a blended team, which includes our internal engineers, external consultants, and key third-party vendors, fostering a culture of innovation, collaboration, and continuous improvement
  • Own the architectural vision for our enterprise AI platforms. You will guide the design of the full solution, from sophisticated AI agents to the intuitive UIs that drive their adoption
  • Own the full lifecycle of our technology partnerships. This includes leading build-vs-buy analyses, running RFPs, negotiating contracts and SoWs with vendors, and evaluating greenfield technologies to shape the future of our enterprise AI stack
  • Ensure our platforms are scalable, reliable, secure, and agile in response to changing requirements. You will design an operating model that allows the team to maintain a high velocity by utilizing partner teams such as the IT Support Desk and NOC
  • You will champion practices like agent-driven development (ADD) to increase both velocity and quality. You champion continuous deployment practices and test-first approaches
  • You will partner with key internal teams (including AI Business Solutions, AI Digital Workplace, and Product & Technology “P&T”) to architect and build enterprise-scale platforms, lead the integration of 3rd party tools, and deliver agent deployment sandboxes for Bentley Copilot
  • You will lead technology strategy and vendor partnerships, engaging with external consultants and application vendors to conduct build-buy-wait evaluations for critical business use-cases
  • Requires sitting or standing at will while performing work on a computer (or any other physical requirements)
  • Around 25% travel is expected
What we offer
What we offer
  • A great Team and culture
  • An exciting career as an integral part of a world-leading software company providing solutions for architecture, engineering, and construction
  • An attractive salary and benefits package
  • A commitment to inclusion, belonging and colleague wellbeing through global initiatives and resource groups
  • A company committed to making a real difference by advancing the world’s infrastructure for better quality of life, where your contributions help build a more sustainable, connected, and resilient world
  • Fulltime
Read More
Arrow Right

Senior IT Software Engineer (AI / SAP ABAP)

Palo Alto Networks is seeking a visionary Senior AI & SAP Engineer to join our E...
Location
Location
United States , Santa Clara
Salary
Salary:
145000.00 - 235500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of total experience with a mandatory BE/B.Tech degree in Engineering or equivalent military experience
  • 6+ years of deep, hands-on experience developing scalable, resilient systems on the SAP S/4HANA platform
  • Proven track record of delivering multiple end-to-end projects in SAP SD and SAP FI, with a strong functional understanding of O2C and R2R processes
  • Experience in a multi-stack integration landscape using tools like Snaplogic, SAP PI, and SAP Integration
  • Hands-on experience building Model Context Protocol (MCP) tools to securely bridge the gap between LLMs and SAP metadata
  • Experience designing autonomous AI Agents and Retrieval-Augmented Generation (RAG) engines that ground AI reasoning in real-time enterprise data
  • Experience with the full SDLC and Agile methodologies, with a specific focus on embedding AI into development lifecycles to accelerate code refactoring, automated testing, and deployment
  • Proficient in Python, LangChain/LangGraph, and SAP AI Core for architecting autonomous agents
  • Proficient with Vector Databases and LLMOps to manage the lifecycle of RAG-based enterprise solutions
  • Proficient in Advanced programming skills in ABAP Cloud, RAP and CAP, utilizing CDS and AMDP to build high-performance "Clean Core" and SAP Fiori applications
Job Responsibility
Job Responsibility
  • Architect Autonomous AI Ecosystems: Lead the end-to-end design of intelligent AI agents and Agentic Workflows that autonomously optimize core SAP modules (O2C, R2R, MM, and RAR). You will bridge the gap between S/4HANA and the global AI landscape using Model Context Protocol (MCP) and RAG (Retrieval-Augmented Generation) to drive real-time, data-grounded decision-making
  • Modernize the SAP Digital Core: Own the evolution of the technical landscape by championing Clean Core principles. You will move beyond traditional RICEW by implementing high-performance extensions via ABAP Cloud and the RESTful ABAP Programming Model (RAP), ensuring the core remains upgrade-stable while delivering sophisticated, API-first integrations
  • Pioneer AI-Augmented Engineering: Revolutionize the software delivery lifecycle by embedding AI directly into the development process. You will drive engineering excellence by automating code refactoring, technical documentation, and unit testing, significantly accelerating velocity and enabling a high-agility, continuous product delivery model
  • Strategic Collaboration & Mentorship: Serve as the primary technical bridge between BSAs, architects, and business stakeholders to translate complex requirements into scalable AI-ERP strategies. You will foster a culture of innovation by mentoring junior engineers in the dual-disciplines of SAP architecture and full-stack AI development
  • System Integrity & Observability: Ensure the stability of the intelligent enterprise by implementing AI-driven monitoring and proactive performance tuning. You will conduct automated data integrity audits and govern the "Single Source of Truth" within S/4HANA to ensure AI models are consistently operating on high-quality, compliant enterprise data
What we offer
What we offer
  • restricted stock units
  • bonus
  • employee benefits (as per linked description)
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...
Location
Location
United States , San Francisco
Salary
Salary:
165000.00 - 220000.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 12+ years of professional software engineering/development experience
  • Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
  • Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
  • Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
Job Responsibility
Job Responsibility
  • Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust's AI Governance product
  • Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
  • Build features with RAG, agent workflows, and model orchestration
  • Own technical design for critical systems, ensuring scalability, security, and reliability
  • Maintain strong automated unit/integration test coverage and engineering standards
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team's discussions on system architecture and component design
  • Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
  • Lead architecture discussions and technical planning
  • Drive alignment across teams on platform design and priorities
  • Contribute to sprint planning and delivery
What we offer
What we offer
  • Comprehensive healthcare coverage
  • flexible PTO
  • equity RSUs
  • annual performance bonus opportunities
  • retirement account support
  • 14+ weeks of paid parental leave
  • career development opportunities
  • company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...
Location
Location
United States , Atlanta
Salary
Salary:
165000.00 - 220000.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 12+ years of professional software engineering/development experience
  • Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
  • Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
  • Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
Job Responsibility
Job Responsibility
  • Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust’s AI Governance product
  • Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
  • Build features with RAG, agent workflows, and model orchestration
  • Own technical design for critical systems, ensuring scalability, security, and reliability
  • Maintain strong automated unit/integration test coverage and engineering standards
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team’s discussions on system architecture and component design
  • Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
  • Lead architecture discussions and technical planning
  • Drive alignment across teams on platform design and priorities
  • Contribute to sprint planning and delivery
What we offer
What we offer
  • Comprehensive healthcare coverage
  • Flexible PTO
  • Equity RSUs
  • Annual performance bonus opportunities
  • Retirement account support
  • 14+ weeks of paid parental leave
  • Career development opportunities
  • Company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - AI-Powered Microservices

We are seeking an innovative and experienced Senior Software Engineer to join ou...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-7 years of professional experience in software development, with a significant focus on building and deploying microservices
  • Strong command of one or more backend programming languages such as Python, Java, C#, or Go
  • Proven experience with microservices architecture, including service discovery, API gateways, and inter-service communication
  • Hands-on experience with a major cloud platform (e.g., Azure, AWS, or GCP), including containerization (Docker) and orchestration (Kubernetes)
  • Solid experience in designing, building, and consuming RESTful or gRPC APIs
  • Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Design, build, and maintain efficient, reusable, and reliable microservices using modern best practices
  • Utilize AI-powered development tools, specifically Microsoft Copilot, to accelerate the software development lifecycle, from coding and testing to documentation
  • Develop and manage robust API integrations with a variety of Large Language Models (LLMs) to embed advanced AI capabilities into our applications
  • Collaborate with architects and product managers to design scalable and resilient systems that meet business and technical requirements
  • Write clean, scalable, and thoroughly tested code
  • Champion best practices in software development and mentor junior engineers
  • Work closely with cross-functional teams, including data science, product, and operations, to deliver high-quality, integrated solutions
  • Stay current with the latest advancements in AI, microservices, and cloud technologies, and actively look for opportunities to incorporate them into our platform
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Agentic AI)

Radancy is the global leader in talent acquisition software, helping enterprises...
Location
Location
Austria , Vienna
Salary
Salary:
Not provided
radancy.com Logo
Radancy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience building and operating production backend systems, with hands-on exposure to AI/ML-powered applications preferred
  • Strong proficiency in a strongly typed language such as Scala, Java, or similar strongly preferred
  • Experience integrating LLM APIs, embedding models, or ML inference services into distributed systems
  • Experience building or consuming agent frameworks (e.g., Google ADK, LangGraph, or AutoGen) to orchestrate multi-step, tool-using AI agents in production environments
  • Familiarity with Model Context Protocol (MCP) or similar tool-serving standards
  • Practical understanding of NLP, LLM behavior, prompt design, retrieval-augmented generation (RAG), and structured output patterns
  • Experience deploying and scaling AI-enabled services in AWS/GCP cloud environments
  • Hands-on experience with containerization and orchestration (Docker, Kubernetes)
  • Experience designing highly concurrent, fault-tolerant systems using async processing, queues, pub/sub, or event-driven architectures
  • Familiarity with CI/CD pipelines, infrastructure-as-code (Terraform or similar), and automated deployment workflows
Job Responsibility
Job Responsibility
  • Architect, build, and operate cloud-native backend services that power AI-driven recruiter workflows
  • Design and implement agentic AI systems using frameworks such as Google ADK, LangGraph, or similar, building multi-step reasoning loops, tool-use pipelines, and agent-to-agent (A2A) communication patterns for production recruiter automation
  • Build, deploy, and maintain MCP servers to expose backend capabilities as structured tool endpoints consumable by AI agents, ensuring schema correctness, session management, and tenant-safe execution
  • Design and deploy scalable AI/LLM services using containerization and orchestration technologies in cloud environments
  • Integrate LLM APIs, embedding services, and ML inference endpoints into distributed systems with strong API design, versioning, and fault tolerance
  • Implement asynchronous processing, event-driven architectures and durable state management for AI workflow orchestration
  • Build and maintain CI/CD pipelines to automate testing, deployment, and monitoring of AI-enabled services
  • Establish observability practices (metrics, tracing, logging, alerting) to monitor model performance, latency, cost, and reliability in production
  • Optimize inference workloads for performance, scalability, and cost efficiency, including autoscaling and concurrency management
  • Partner with Data Science to bring models to production, implement evaluation pipelines, and support model lifecycle management
Read More
Arrow Right

Senior AI Engineer - MSC AI Innovation

MSC AI Innovation is an AI-first team that incubates, builds, and accelerates so...
Location
Location
Israel , Tel Aviv, Herzliya
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years professional software development
  • 4+ years of software engineering experience in the AI space (e.g., building and shipping AI/ML or GenAI features in production)
  • Proven experience with building AI agents
  • Hands-on experience with evaluation methodologies and integrating quality standards/guardrails into delivery
  • Proficiency in Python and/or C#, with experience using REST APIs and SDKs
  • Deep understanding of AI system design, including ML fundamentals, Generative AI concepts, and cloud-native architectures
Job Responsibility
Job Responsibility
  • Design and build AI agents that plan, use tools/APIs, manage state/memory, and reliably complete multi-step workflows
  • Own AI features from design through production, including deployment, monitoring, and live‑site reliability, with an eval-first development lifecycle: define success criteria, build evaluation datasets and automated harnesses, and run human-in-the-loop reviews where needed
  • Develop and maintain prompt, retrieval, and memory strategies (system prompts, few-shot examples, tool schemas, retrieval context) with proper versioning and evaluation coverage
  • Debug AI behavior using prompt analysis, data inspection, and model/tool-call traces, and translate failure patterns into targeted improvements
  • Establish and track AI quality metrics (e.g., accuracy, groundedness, relevance, hallucination rate) and integrate them into CI/CD release gates
  • Optimize runtime performance and economics (token usage, inference cost, latency, caching, model selection/routing, batching) and implement monitoring and continuous improvement loops (online signals, drift detection, structured user feedback)
  • Partner with product, design, and domain stakeholders to define use cases, acceptance criteria, and rollout plans for AI features
  • Live site responsibility
  • Fulltime
Read More
Arrow Right