CrawlJobs Logo

Software Engineer, Gen AI Platform

abridge.com Logo

Abridge

Location Icon

Location:
United States , San Francisco

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

221000.00 - 300000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

Our generative AI-powered products are making a huge impact in the Healthcare industry. As an AI Platform Engineer, you will collaborate closely with a cross-functional team of researchers, clinical scientists, and product engineers. You will design and build the runtime, orchestration engine, and evaluation platform for agentic orchestration and LLM-driven workflows.

Job Responsibility:

  • Design and build GenAI systems that turn LLMs into composable, dependable tools—leveraging retrieval, tool use, agentic reasoning, and structured outputs
  • Design and implement a highly reliable and scalable agent runtime: orchestration, shared state and memory, tool-calling interfaces, and scheduling for cost, latency, and quality
  • Build secure, sandboxed execution for agent actions and code
  • optimize cold start, isolation, and observability
  • Ship unified interfaces for multiple model sizes and providers
  • integrate with open tool ecosystems such as MCP-style connectors for data and actions
  • Develop an evaluation platform for online and offline assessments, A/B tests, safety checks, and regression gates that improve agent reliability over time
  • Partner with Research to deliver new agent capabilities end to end—from prototype to production

Requirements:

  • Experience building agent applications with tool-calling, context engineering, or open connector integrations
  • Fluency with LLM APIs, prompting strategies, and orchestration patterns (e.g., LangChain, LlamaIndex, or custom pipelines)
  • Experience with retrieval systems (e.g., semantic and lexical retrieval, vector DBs, efficient kNN), function calling, tool use, or agentic workflows
  • Strong coding skills in one or more of: Python, Java, Go
  • Comfortable with service design, APIs, and data models for high-throughput systems
  • Working knowledge of containers and kubernetes concepts
  • Familiarity with metrics, tracing, on-call rotations, and incident response practices
  • Self-motivated with a willingness to take ownership
  • Strong communication skills and ability to work collaboratively in a team environment

Nice to have:

  • Prior work on agent orchestration pipelines: task routing, planning, memory graphs, vector search, or browser automation
  • Experience with evaluations, preference optimization, or RL to improve LLM reliability
What we offer:
  • Generous Time Off: 14 paid holidays, flexible PTO for salaried employees, and accrued time off for hourly employees
  • Comprehensive Health Plans: Medical, Dental, and Vision coverage for all full-time employees and their families
  • Generous HSA Contribution: If you choose a High Deductible Health Plan, Abridge makes monthly contributions to your HSA
  • Paid Parental Leave: Generous paid parental leave for all full-time employees
  • Family Forming Benefits: Resources and financial support to help you build your family
  • 401(k) Matching: Contribution matching to help invest in your future
  • Personal Device Allowance: Tax free funds for personal device usage
  • Pre-tax Benefits: Access to Flexible Spending Accounts (FSA) and Commuter Benefits
  • Lifestyle Wallet: Monthly contributions for fitness, professional development, coworking, and more
  • Mental Health Support: Dedicated access to therapy and coaching to help you reach your goals
  • Sabbatical Leave: Paid Sabbatical Leave after 5 years of employment
  • Compensation and Equity: Competitive compensation and equity grants for full time employees

Additional Information:

Job Posted:
January 20, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Abridge - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer, Gen AI Platform

Applied AI Engineer - AI Solutions

As an Applied AI Engineer, you’ll research and utilize state-of-the-art Gen AI a...
Location
Location
United States , Redwood City; San Francisco
Salary
Salary:
172000.00 - 300000.00 USD / Year
snorkel.ai Logo
Snorkel AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • B.S. degree in a quantitative field such as Computer Science, Engineering, Mathematics, Statistics, or comparable degree/experience
  • 3+ years of customer-facing experience in the design and implementation of AI/ML solutions
  • Proficiency in Python, including strong grounding in software engineering fundamentals (e.g., modular design, testing, profiling, packaging) and experience with modern Python constructs and libraries for type validation and typed data modeling (e.g., pydantic), building type-safe systems (e.g., mypy), testing (e.g., pytest), packaging and environment configuration (e.g., poetry), API and service frameworks (e.g., FastAPI), serialization and structured data handling (e.g., msgspec), and orchestration tooling relevant to ML deployment (e.g., Ray, Airflow)
  • Expertise across the Applied AI stack, spanning classical ML libraries (e.g., scikit-learn), deep learning frameworks (e.g., PyTorch), foundation-model ecosystems (e.g., Hugging Face Transformers), vector/embedding tooling (e.g., FAISS), data processing frameworks (e.g., pandas, Spark), retrieval/RAG tooling (e.g., Chroma, Weaviate), synthetic dataset curation, evaluation workflows, and LLM orchestration, workflow, agent authoring tools (e.g., LlamaIndex, LangGraph, CrewAI)
  • Experience leading strategic, customer-facing initiatives and collaborating with business stakeholders to ensure ML solutions drive successful business outcomes, with a strong focus on teaching and enablement
  • Outstanding presentation skills to technical and executive audiences, whether impromptu on a whiteboard or using presentations and demos
  • Ability to work in a fast-paced environment and balance priorities across multiple projects at once
Job Responsibility
Job Responsibility
  • Partner with customers to build and deploy impactful Gen AI and machine learning solutions, from use case scoping and data exploration to model development and deployment. This may involve leveraging Snorkel Flow or designing custom approaches using state-of-the-art tools, with the goal of delivering real business value and informing the evolution of the Snorkel platform
  • Develop and implement state of the art AI systems such as retrieval-augmented generation (RAG), fine-tuning pipelines, prompt engineering recipes and agentic workflows
  • Create augmented real-world datasets and comprehensive evaluation workflows to ensure model reliability, transparency, and stakeholder trust. A data- and evaluation-first mindset is essential for success in this role
  • Forge and manage relationships with our customers’ leadership and stakeholders to ensure successful development and deployment of AI projects with Snorkel Flow
  • Collaborate closely with pre-sales Solutions and Product teams to map customer needs to existing capabilities, prioritize roadmap gaps, and guide successful project setup
  • Work with other Applied AI Engineers to standardize solutions and contribute to internal tooling and best practices
  • Lead stakeholder education on quantitative capabilities, helping them to understand the strengths and weaknesses of different approaches and what problems are best-suited for Snorkel AI
  • Serve as the voice of our customers for new AI paradigms, data science workflows, and share customer feedback to product teams
  • Conduct one-to-few and one-to-many enablement workshops to transfer knowledge to customers considering or already using Snorkel AI
  • Annual travel up to 25%
What we offer
What we offer
  • equity in the form of employee stock options
  • Fulltime
Read More
Arrow Right

Software Engineer, Ad Serving

Roku is hiring a Software Engineer for the Ad Engineering Team to build a highly...
Location
Location
United States , New York
Salary
Salary:
126000.00 - 318000.00 USD / Year
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4 - 8 years of experience building large scale and low latency distributed systems
  • B.S. or M.S. degree in Computer Science, Engineering, or equivalent
  • Command of Java or C++
  • Solid understanding of algorithms, data structures, performance optimization techniques, object-oriented programming, multi-threading, and real-time programming
  • Self-motivated individual with a high level of accountability and ownership
  • Critical thinking and practical decision making
  • Can do, results-oriented mindset
  • Nonpolitical, collaborative, and team oriented
  • Desire to win in a highly competitive industry
  • AI literacy and curiosity. You have either 1) tried Gen AI in your previous work or outside of work or 2) are curious about Gen AI and have explored it
Job Responsibility
Job Responsibility
  • Work alongside a highly skilled engineering team to design, develop, and maintain large scale, highly performing, real-time applications
  • Own building features, driving directly with product and other engineering teams
  • Demonstrate excellent communication skills in working with technical and non-technical audiences
  • Be an evangelist for best practices across all functions – developers, QA, and infrastructure/ops
  • Be an evangelist for platform innovation and reuse
  • Deliver top-quality software in a timely fashion
What we offer
What we offer
  • Health insurance
  • Equity awards
  • Life insurance
  • Disability benefits
  • Parental leave
  • Wellness benefits
  • Paid time off
  • Global access to mental health and financial wellness support and resources
  • Commuter benefits
  • Retirement options (401(k)/pension)
  • Fulltime
Read More
Arrow Right

Principal Product Manager, Gen AI Developer Tools

Anaconda is seeking a talented Principal Product Manager, GenAI Developer Tools ...
Location
Location
United States
Salary
Salary:
162500.00 - 282000.00 USD / Year
anaconda.com Logo
Anaconda
Expiration Date
July 01, 2026
Flip Icon
Requirements
Requirements
  • 7+ years of product management experience
  • at least 3 years focused on developer tools, infrastructure, or platform products
  • deep, hands-on experience with AI coding tools (Cursor, GitHub Copilot, Claude, etc.)
  • proven expertise in MCP (Model Context Protocol) development, A2A protocol, agentic systems, or similar AI-to-application integration technologies
  • ability to work closely with engineering teams on API design, system architecture, and implementation trade-offs
  • experience building and managing strategic technology partnerships, particularly with developer tool companies
  • track record of driving product adoption in developer communities
  • excellent written and verbal communication skills
  • deep understanding of Python ecosystem, package management, and enterprise software development workflows
  • Bachelor's degree in Computer Science, Engineering, or related field
Job Responsibility
Job Responsibility
  • Lead product strategy and roadmap for Anaconda's Agentic Environment & Package Management initiatives, including MCP (Model Context Protocol) server development and AI tool integrations
  • conduct strategic research with enterprise customers, AI tool vendors, and the open-source community
  • drive the development and launch of tools and agents that improve the quality of Python vibe-coding
  • support strategic partnerships with top AI-enabled IDEs (Cursor, VS Code, Windsurf, etc.)
  • define and execute on integration strategies that make Anaconda indispensable to AI coding workflows
  • collaborate with engineering teams to build robust APIs, SDKs, and developer tools
  • work closely with our enterprise customers in regulated industries (finance, healthcare, government) to ensure our AI infrastructure meets their security and compliance requirements
  • partner with marketing and developer relations to drive adoption among the 50+ million Python developers globally
  • measure and optimize key metrics including developer adoption, enterprise package downloads, and AI tool integration usage
  • represent Anaconda at industry conferences, with partners, and in the broader AI/ML community
What we offer
What we offer
  • Flexible Vacation Policy
  • Medical, Dental, and Vision Insurance
  • Short Term and Long Term Disability
  • Paid Parental Leave
  • Monthly Wellness Stipend
  • Employee Assistance Program and Mental Health Resources
  • annual bonus potential
  • equity participation
  • Fulltime
Read More
Arrow Right

AI/ML Engineer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-9 years of experience with Python, Machine Learning & exposure to Gen AI
  • Knowledge on Java will be added advantage
  • Proficiency in coding Python in building Machine Learning and developing LLM based application in a professional environment
  • Knowledge in Kofax will be a plus
  • SQL skills able to perform data interrogations is must
  • Professional experience developing Java applications
  • Develop LLM solutions for querying structured data with natural language, including RAG architectures on enterprise knowledge bases
  • Build, scale, and optimize data science workloads, applying best MLOps practices for production
  • Lead the design and development of LLM-based tools to increase data accessibility, focusing on text-to-SQL platforms
  • Train and fine-tune LLM models to accurately interpret natural language queries and generate SQL queries
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Senior Lead AI Engineer (Gen AI Platform Services)

At Capital One, we are creating responsible and reliable AI systems, changing ba...
Location
Location
United States , San Jose; San Francisco; New York; Cambridge; McLean
Salary
Salary:
229900.00 - 286200.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
  • At least 6 years of experience programming with Python, Go, Scala, or Java
Job Responsibility
Job Responsibility
  • Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One
  • Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
  • Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more
  • Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems
  • Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One
What we offer
What we offer
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, Gen AI

We’re looking for a Principal Software Engineer to help lead the design and impl...
Location
Location
United States of America
Salary
Salary:
133700.00 - 173800.00 USD / Year
blackbaud.com Logo
Blackbaud
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in software engineering on the Microsoft stack, including leadership in AI-related projects
  • Deep understanding of .NET Core, C#, and modern web technologies
  • Proficiency in Angular, JavaScript/TypeScript, CSS, and HTML
  • Proven success building and deploying Generative AI features
  • Experience with prompt engineering and optimizing LLM behavior
  • Familiarity with SQL Server, Cosmos DB, and RESTful API development
  • Experience with cloud-based AI infrastructure (Azure, AWS, GCP)
  • Excellent communication and collaboration skills
  • Strong grasp of Agile methodology and continuous delivery practices
Job Responsibility
Job Responsibility
  • Implement complex software systems integrating Generative AI capabilities
  • Design, build, and maintain efficient, scalable code
  • Lead cross-functional collaboration on technical solutioning and project delivery
  • Ensure performance, reliability, and security of AI-enabled features
  • Evaluate and improve prompt performance and AI-driven workflows
  • Collaborate with product and UX teams to deliver accessible, user-friendly experiences
  • Serve as a subject matter expert for LLM deployment, operation, and monitoring
  • Actively mentor and support the growth of other engineers
  • Maintain high quality development standards and practices
  • Contribute to the evolution of Blackbaud’s AI platform strategy
What we offer
What we offer
  • Medical, dental, and vision insurance
  • Remote-first workforce
  • 401(k) program with employer match
  • Flexible paid time off
  • Generous Parental Leave
  • Volunteer for vacation
  • Opportunities to connect to build community and belonging
  • Pet insurance, legal and identity protection
  • Tuition reimbursement program
  • Fulltime
Read More
Arrow Right

Senior AI Engineer

At 3Pillar, we leverage cutting-edge technologies to drive innovation and delive...
Location
Location
India , Noida
Salary
Salary:
Not provided
3pillarglobal.com Logo
3Pillar Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelors or Masters degree in Computer Science, Engineering, Mathematics, or related fields
  • A minimum of 4+ years of experience in building AI applications with NLP and deep learning, with around 2 years of experience in building production grade Gen AI applications
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud
  • Advance Programming skills in Python
  • Solid understanding of Gen AI, LLMs, LLM fine tuning, RAG, MCP, Agentic AI, and prompt engineering
  • Ability to work with different LLM models and choose one over another based on a use case
  • Experience with LLM based application development using frameworks such as LangChain, LangGraph, LangSmith, and Google GenAI SDK
  • Understanding of data privacy, AI Ethics, Responsible AI, and model governance
  • Strong analytical and problem-solving skills, with attention to detail
  • Excellent communication skills, with the ability to present complex technical concepts to both technical and non-technical audiences
Job Responsibility
Job Responsibility
  • Collaborate with stakeholders, including product managers, architects, and software engineers to identify business problems that can be solved using AI and develop innovative AI solutions using Gen AI, Agentic AI and similar technologies and frameworks
  • Understanding the business requirement to implement, integrate and deploy Generative AI product & features into production environments
  • Fine-tune and deploy generative AI models for tasks like text, image, video or audio generation
  • Integrate generative models into scalable applications and ensure optimal production grade performance
  • Stay updated with advancements in Gen and Agentic AI and implement best practices
  • Deploy AI agents into production environments, ensuring performance, scalability, security, and reliability
  • Agent Chaining: Implement solutions that enable multiple AI agents to collaborate and solve complex tasks
  • Develop and refine prompts to maximize performance and accuracy of language models
  • Maintain clear and comprehensive technical documentation
  • Mentor and provide technical guidance to junior Python engineers and team members
  • Fulltime
Read More
Arrow Right
New

Ai engineer

JFS is seeking an experienced Artificial Intelligence (AI) Engineer, who possess...
Location
Location
United States , Columbus
Salary
Salary:
Not provided
dashtechinc.com Logo
Dash Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, Information systems or related discipline or equivalent and extensive related project experience
  • Master’s degree preferred
  • Five years of experience in IT
  • 2 years Microsoft Chatbot Developer experience
  • five years .NET Developer experience
  • AI Chatbot Developer Experience using Microsoft Bot Framework is mandatory
  • Google CCAI Services is preferred
  • Minimum of five years of hands-on design & implementation experience in IT, with knowledge in a minimum of two of the following technical disciplines: Application development
  • Network design
  • Middleware
Job Responsibility
Job Responsibility
  • Developing and maintaining Microsoft and Google AI applications including but not limited to Conversational Agents and Generative AI solutions that interact with web services, APIs, and other software applications
  • Building new M365 solutions to replace existing On-Prem SharePoint applications
  • Designing and architecting AI/Gen AI chatbot solutions, including determining the necessary features, user flow, API development and integration with other systems
  • Developing and maintaining Generative AI solutions using AWS Bedrock and other AWS services as needed for specific AI solutions
  • Implementing and tuning NLP techniques to improve chatbot’s understanding and response accuracy
  • Training and deploying AI models
  • Creating and utilizing Dashboards to monitor chatbot performance
  • Creating custom indexes, managing data sources, and tuning intent matches to improve accuracy and relevance of results within the chatbot context
  • Designing conversational flows that provide a seamless and intuitive user experience
  • Analyzing chatbot interaction data to identify patterns, trends, and areas for improvement
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy