CrawlJobs Logo
Abridge Logo Abridge · IT - Software Development

Software Engineer, Gen AI Platform

United States, San Francisco 221000.00 - 300000.00 USD / Year · Job Posted January 20, 2026
Apply Position
Job Link Share

Job Description

Our generative AI-powered products are making a huge impact in the Healthcare industry. As an AI Platform Engineer, you will collaborate closely with a cross-functional team of researchers, clinical scientists, and product engineers. You will design and build the runtime, orchestration engine, and evaluation platform for agentic orchestration and LLM-driven workflows.

Job Responsibility

  • Design and build GenAI systems that turn LLMs into composable, dependable tools—leveraging retrieval, tool use, agentic reasoning, and structured outputs
  • Design and implement a highly reliable and scalable agent runtime: orchestration, shared state and memory, tool-calling interfaces, and scheduling for cost, latency, and quality
  • Build secure, sandboxed execution for agent actions and code
  • optimize cold start, isolation, and observability
  • Ship unified interfaces for multiple model sizes and providers
  • integrate with open tool ecosystems such as MCP-style connectors for data and actions
  • Develop an evaluation platform for online and offline assessments, A/B tests, safety checks, and regression gates that improve agent reliability over time
  • Partner with Research to deliver new agent capabilities end to end—from prototype to production

Requirements

  • Experience building agent applications with tool-calling, context engineering, or open connector integrations
  • Fluency with LLM APIs, prompting strategies, and orchestration patterns (e.g., LangChain, LlamaIndex, or custom pipelines)
  • Experience with retrieval systems (e.g., semantic and lexical retrieval, vector DBs, efficient kNN), function calling, tool use, or agentic workflows
  • Strong coding skills in one or more of: Python, Java, Go
  • Comfortable with service design, APIs, and data models for high-throughput systems
  • Working knowledge of containers and kubernetes concepts
  • Familiarity with metrics, tracing, on-call rotations, and incident response practices
  • Self-motivated with a willingness to take ownership
  • Strong communication skills and ability to work collaboratively in a team environment

Nice to have

  • Prior work on agent orchestration pipelines: task routing, planning, memory graphs, vector search, or browser automation
  • Experience with evaluations, preference optimization, or RL to improve LLM reliability

What we offer

  • Generous Time Off: 14 paid holidays, flexible PTO for salaried employees, and accrued time off for hourly employees
  • Comprehensive Health Plans: Medical, Dental, and Vision coverage for all full-time employees and their families
  • Generous HSA Contribution: If you choose a High Deductible Health Plan, Abridge makes monthly contributions to your HSA
  • Paid Parental Leave: Generous paid parental leave for all full-time employees
  • Family Forming Benefits: Resources and financial support to help you build your family
  • 401(k) Matching: Contribution matching to help invest in your future
  • Personal Device Allowance: Tax free funds for personal device usage
  • Pre-tax Benefits: Access to Flexible Spending Accounts (FSA) and Commuter Benefits
  • Lifestyle Wallet: Monthly contributions for fitness, professional development, coworking, and more
  • Mental Health Support: Dedicated access to therapy and coaching to help you reach your goals
  • Sabbatical Leave: Paid Sabbatical Leave after 5 years of employment
  • Compensation and Equity: Competitive compensation and equity grants for full time employees
Abridge - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Software Engineer, Gen AI Platform

8 matching positions

Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services)

Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services)
Location
Location
United States , New York; San Francisco; San Jose; Cambridge; McLean
Salary
Salary:
197300.00 - 245600.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 2 years of experience developing AI and ML algorithms or technologies
  • At least 4 years of experience programming with Python, Go, Scala, or Java
Job Responsibility
Job Responsibility
  • Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One
  • Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc
  • Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
  • Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
  • Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
What we offer
What we offer
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Senior Lead AI Engineer (Gen AI Platform Services)

At Capital One, we are creating responsible and reliable AI systems, changing ba...
Location
Location
United States , San Jose, California; New York, New York
Salary
Salary:
250800.00 - 286200.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
  • At least 6 years of experience programming with Python, Go, Scala, or Java
Job Responsibility
Job Responsibility
  • Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One
  • Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
  • Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
  • Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
  • Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Senior Lead AI Engineer (Gen AI Platform Services)

At Capital One, we are creating responsible and reliable AI systems, changing ba...
Location
Location
United States , San Jose; San Francisco; New York; Cambridge; McLean
Salary
Salary:
229900.00 - 286200.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
  • At least 6 years of experience programming with Python, Go, Scala, or Java
Job Responsibility
Job Responsibility
  • Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One
  • Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
  • Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
  • Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
  • Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
What we offer
What we offer
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • Fulltime
Read More
Arrow Right

Senior Software Engineer – Gen AI Platforms

We are Citi's Application, Platform and Engineering group, a start-up with the e...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 9+ Years of Hands-on experience
  • Go microservices
  • React 19+/TypeScript
  • OpenShift/Kubernetes
  • MongoDB/Redis/S3
  • REST/gRPC/WebSockets
  • Claude/Gemini/proprietary LLMs
  • OAuth/JWT/Vault
  • GitOps CI/CD
  • Prometheus/Grafana/ELK
Job Responsibility
Job Responsibility
  • Build scaled, robust services and platforms centred around generative AI, including developing CLIs, SDKs, runtimes and more
  • Drive architectural vision and lead the 0-1 build of foundational, enterprise-grade AI platforms and products
  • Design and build high-quality, highly reliable, and secure distributed systems with developer and user experience at the center
  • Create 'firsts' in the Generative AI space for Citi, acting as a core member of the team that defines the strategic technical direction for the entire bank
  • Continually iterate and scale Generative AI products to handle massive throughput, whilst anticipating and listening to the complex needs of internal customers
  • Drive technical alignment across multiple engineering organizations, breaking down silos to deliver cohesive AI capabilities
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Gen AI

Wells Fargo is seeking a Senior Software Engineer - Gen AI
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
Job Responsibility
Job Responsibility
  • Lead moderately complex initiatives and deliverables within technical domain environments
  • Contribute to large scale planning of strategies
  • Design, code, test, debug, and document for projects and programs associated with technology domain, including upgrades and deployments
  • Review moderately complex technical challenges that require an in-depth evaluation of technologies and procedures
  • Resolve moderately complex issues and lead a team to meet existing client needs or potential new clients needs while leveraging solid understanding of the function, policies, procedures, or compliance requirements
  • Collaborate and consult with peers, colleagues, and mid-level managers to resolve technical challenges and achieve goals
  • Lead projects and act as an escalation point, provide guidance and direction to less experienced staff
  • Fulltime
Read More
Arrow Right

Principal Software Engineer – Gen AI Platforms

We are Citi’s Application, Platform and Engineering group, a start-up with the e...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 14+ Years of Hands on experience is a must have
  • Expert-level fluency in Golang is a must-have
  • Deep experience building concurrent, high-throughput systems
  • Deep expertise in the Kubernetes ecosystem, container orchestration, and modern security paradigms
  • Understanding of language models, fine-tuning methodologies, and RAG architectures, JIT context retrieval strategies
  • Proven experience designing control planes, sandboxing systems for AI experimentation, and managing large-scale vector stores and search algorithms
  • Extensive experience in large-scale ETL development and data pipeline architecture
  • Experience maintaining and/or contributing to bug bounty, responsible disclosure programs, and AI safety/guardrail implementations
  • Experience leading technical initiatives within fast-paced startup environments or driving startup-like agility within a large enterprise
Job Responsibility
Job Responsibility
  • Engineering at scale: You will build scaled, robust services and platforms centred around generative AI. This may also include developing CLIs, SDKs, runtimes and more
  • Thought Leadership: Drive architectural vision and lead the 0-1 build of foundational, enterprise-grade AI platforms and products
  • System Design: Design and build high-quality, highly reliable, and secure distributed systems with developer and user experience at the center
  • Strategic Direction: Create "firsts" in the Generative AI space for Citi, acting as a core member of the team that defines the strategic technical direction for the entire bank
  • Scale & Iterate: Continually iterate and scale Generative AI products to handle massive throughput, whilst anticipating and listening to the complex needs of internal customers
  • Cross-Org Influence: You must be able to drive technical alignment across multiple engineering organizations, breaking down silos to deliver cohesive AI capabilities
  • Fulltime
Read More
Arrow Right

Full Stack Principal Software Engineer, Gen AI

This role leads the design, architecture, and delivery of agentic AI platforms a...
Location
Location
United States , Bellevue; Frisco
Salary
Salary:
133500.00 - 240700.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree plus 7 years of related work experience OR Advanced degree with 5 years of related experience
  • Acceptable areas of study include Computer Science or Engineering
  • 7-10 years Technical engineering experience
  • Communication
  • Customer Service
  • Analytics
  • Technical Writing
  • At least 18 years of age
  • Legally authorized to work in the United States
Job Responsibility
Job Responsibility
  • Drive architecture and engineering delivery of agentic AI platforms, including LLM-integrated backend systems, microservices, APIs, and distributed cloud-native infrastructure to meet scalability, security, and reliability standards
  • Provide technical leadership across AI initiatives by mentoring engineers, defining engineering standards for AI systems, and influencing architectural and technology decisions at the organizational level
  • Define and evaluate AI platform strategies, including microservices architecture, model orchestration patterns, distributed systems design, and cloud deployment models aligned with business objectives
  • Develop innovative AI-enabled software designs and improvements that enhance existing systems and processes
  • Produce clear architectural documentation for AI systems and distributed platforms
  • Also responsible for other duties/projects as assigned by business management as needed
What we offer
What we offer
  • Annual stock grant
  • Employee stock purchase plan
  • 401(k)
  • Access to free, year-round money coaches
  • Medical, dental and vision insurance
  • Flexible spending account
  • Employee stock grants
  • Employee stock purchase plan
  • Paid time off
  • Up to 12 paid holidays
  • Fulltime
Read More
Arrow Right

Staff Software Engineer - Backend Gen Ai

The Media Platform team builds Uber's unified, scalable infrastructure for inges...
Location
Location
United States , Sunnyvale
Salary
Salary:
232000.00 - 258000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of backend engineering experience, with deep expertise in distributed systems and large-scale service architecture
  • Strong backend engineering experience (Go, Java, C++, or similar) with expertise in system design, performance optimization, and reliability
  • Experience building high-throughput, low-latency services handling large data volumes (streaming, storage, or media systems)
Job Responsibility
Job Responsibility
  • Architect and scale distributed backend systems that support media ingestion, processing, intelligence, and delivery across global regions
  • Improve performance, reliability, and cost efficiency of high-throughput media pipelines
  • Design infrastructure that enables efficient integration and execution of ML inference workloads within media systems
  • Drive technical strategy and long-term architectural decisions across the Media Platform
  • Mentor engineers and raise the bar for engineering excellence, operational rigor, and system design
What we offer
What we offer
  • Bonus program
  • Equity award
  • 401(k) plan
  • Various benefits
  • Fulltime
Read More
Arrow Right