Senior Backend Software Engineer, Agents Job at Cohere

Senior Software Engineer, Backend (AI Agent)

At Cresta, the AI Agent team is on a mission to create state-of-the-art AI Agent...

Location

Canada , Toronto

Salary:

Not provided

Cresta

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Computer Science or a related field
5+ years of experience in backend system architecture, cloud services, or related technology fields
Proficient in designing and maintaining clear and robust APIs with a strong understanding of protocols including gRPC, REST
Previous experience working with Virtual Agent or AI Agent systems
Experience in high-performance database schema design and query optimization, including knowledge of SQL and NoSQL databases
Experience in containerized application deployment using Kubernetes and Docker in microservices architectures
Experience with cloud environments such as AWS, Azure, or Google Cloud, with a strong understanding of cloud security and compliance standards

Job Responsibility

Design, develop, and maintain scalable and robust backend architectures for Cresta’s AI Agent solutions and proprietary models
Collaborate with cross-functional teams including frontend engineers, machine learning engineers to ensure seamless integration of AI Agents into Cresta’s customer solutions
Lead initiatives to enhance system scalability and reliability in production environments, focusing on backend services that support AI functionalities
Drive efforts to optimize server response times, process large volumes of data efficiently, and maintain high system availability
Innovate and implement security measures, cost-reduction strategies, and performance improvements in backend systems supporting AI Agents

What we offer

We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs
Paid parental leave to support you and your family
Monthly Health & Wellness allowance
Work from home office stipend to help you succeed in a remote environment
Lunch reimbursement for in-office employees
PTO: 3 weeks in Canada

Senior Backend Software Engineer

The Coaching team builds Highspot’s personalized, AI-enhanced coaching capabilit...

Location

Canada , Vancouver

Salary:

146000.00 - 178000.00 CAD / Year

Highspot

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Computer Science or equivalent practical experience
5+ years of experience in back-end software development building and maintaining large-scale web applications
At least 3 years of experience working with object-oriented programming languages
Ruby and Python preferred
Experience architecting, building, and deploying mid-to-large scale web applications in a distributed environment
Strong understanding of API design, data modeling, and backend scalability
Experience integrating or working with AI/LLM platforms such as OpenAI, Anthropic (Claude), or Azure OpenAI
Familiarity with AI-powered development tools (e.g., Cursor, GitHub Copilot, Cody, etc.) and a demonstrated ability to incorporate them effectively into day-to-day workflows
Deep expertise in web performance, security, and reliability best practices
Proven ability to deconstruct complex technical problems and deliver elegant, maintainable solutions

Job Responsibility

Design, develop, and maintain high-quality, scalable, and user-centric backend systems using modern technologies
Architect and optimize backend infrastructure to power intelligent, AI-driven workflows and Agentic AI integrations
Build and maintain integrations with multiple large language models (LLMs) including ChatGPT, Claude, and other OpenAI and Microsoft models
Collaborate closely with AI/ML engineers to productionize agentic workflows and autonomous reasoning systems
Partner effectively with Product Management and UX Design to translate ideas and research into production-ready, AI-enhanced features
Leverage AI-assisted development tools such as Cursor, GitHub Copilot, and other code generation frameworks to accelerate development and improve code quality
Lead and mentor engineers through complex projects, emphasizing clean architecture, testing, and software craftsmanship
Drive backend infrastructure improvements that enhance reliability, observability, and performance
Collaborate cross-functionally to deliver differentiated customer value through AI and data-driven solutions
Troubleshoot and resolve critical production issues while contributing to internal documentation and best practices

What we offer

Comprehensive medical, dental, vision, disability, and life benefits
Group Retirement Savings Plan (RRSP) and matching employer contributions (DPSP) with immediate vesting
Flexible PTO
Generous Holiday Schedule + 5 Days for Annual Holiday Week
Quarterly Recharge Fridays (paid days off for mental health recharge)
Flexible work schedules
Access to Coaches and Therapists through Modern Health
2 Volunteer days per year
Monthly transportation allowance for employees that work in our Vancouver Hub location
Employees are eligible to receive stock options

Fulltime

Senior Software Engineer, AI Runtime

We’re seeking a Senior Software Engineer to help power the future of agentic AI ...

Location

United States

Salary:

157000.00 - 198900.00 USD / Year

Apollo GraphQL

Expiration Date

Until further notice

Requirements

Expertise in agent-to-tool orchestration, routing, and coordination in scalable, fault-tolerant systems
Deep expertise in Rust programming language
Strong background in distributed systems, server architecture, and high-performance backend development
Proven experience with protocol design, message routing, and server-side orchestration frameworks
Experience building and maintaining robust runtime infrastructure that supports AI-driven workflows and enables reliable agent-to-tool interactions
Proven experience with protocol design, message routing, and building server-side frameworks that enable scalable, reliable multi-tool agent workflows
Hands-on experience with observability, monitoring, and debugging frameworks for complex systems
Passion for clean, maintainable code, high system reliability, and scalable architecture
Experience in strategic system design, making architectural trade-offs, and planning for long-term scalability and maintainability
Strong technical leadership and mentorship, including guiding junior engineers and driving engineering best practices across teams

Job Responsibility

Scale an enterprise AI/MCP Server and Gateway that powers multi-agent workflows across Apollo, including routing, orchestration, and integration boundaries
Implement robust server infrastructure to ensure reliability, performance, and security at scale
Build and maintain tools for agent discovery, communication, and coordination
Define deployment strategies and runtime optimizations to maximize efficiency and minimize operational overhead
Develop frameworks and patterns that enable seamless multi-agent collaboration and AI-driven orchestration
Integrate observability, logging, and monitoring for full visibility into server and agent behavior
Explore and implement AI-enhanced developer workflows to optimize orchestration and agent interactions
Collaborate with teams within our org to ensure the MCP Server meets evolving product and developer needs

Senior Software Engineer, AI

As a Senior AI Engineer on our Core AI team, you will be a cornerstone of FloQas...

Location

India , Pune

Salary:

Not provided

FloQast

Expiration Date

Until further notice

Requirements

6+ years of professional software engineering experience
3+ years focused on building backend for production applications
Mastery of Python
Familiarity with some AI application frameworks, context engineering, and scalable system design for AI products
Expertise in designing products that integrate with multiple technologies, APIs, and data sources in cloud-native environments (AWS preferred)
Strong desire to develop deep hands-on experience with LLM APIs, retrieval-augmented generation (RAG), conversational AI, document processing, and MCP integrations
Proven ability to lead tech product initiatives, establish technical standards and communicate complex system designs to both technical and business stakeholders

Job Responsibility

Architect and lead development of production AI products including intelligent chatbots, document processing systems, and agentic workflows using Python and modern AI frameworks
Design and implement our centralized AI platform including model routing, provider management, vector search, and AI application frameworks with seamless MCP (Model Context Protocol) integrations
Build scalable AI products that integrate with diverse technologies including accounting systems, document repositories, and external APIs while maintaining robust monitoring and observability
Master context engineering and system design for AI applications, ensuring optimal information retrieval, context assembly, and multi-turn conversation management
Collaborate with Product, Engineering, and Security teams to ensure AI products are robust, compliant, and aligned with business objectives in the regulated accounting space
Provide technical leadership and mentorship to the growing AI team, establishing best practices for AI product development, deployment, and governance

Fulltime

Senior Python Software Engineer

Senior Python Software Engineer position at Inetum Polska, focusing on developin...

Location

Poland , Warsaw

Salary:

Not provided

Inetum

Expiration Date

Until further notice

Requirements

Python
Docker
FastAPI
SQL/RDBMS Experience - PostgreSQL used on project
English and Polish - C1
Hybrid work model (at least 3 days per week in the office - MUST)

Job Responsibility

Develop and maintain Python-based microservices for AI-driven applications
Design and build frameworks around AI agents within Azure cloud infrastructure
Focus on backend development, ensuring scalability, reliability, and high performance
Optimize and troubleshoot performance issues, particularly in chatbot applications
Work with Python frameworks to enhance efficiency and maintainability
Manage and optimize SQL databases for AI-driven applications
Implement best practices in prompt engineering and work with Large Language Models (LLMs)
Collaborate with AI/ML teams to integrate AI models into production systems
Ensure security, compliance, and best coding practices in AI application development
Stay up to date with emerging AI technologies and contribute to technical innovation

What we offer

Flexible working hours
Hybrid work model
Cafeteria system
Generous referral bonuses
Additional revenue sharing opportunities
Ongoing guidance from a dedicated Team Manager
Tailored technical mentoring
Dedicated team-building budget
Opportunities to participate in charitable initiatives and local sports programs
A supportive and inclusive work culture

Fulltime

Senior JVM Software Engineer

Join as Full Stack Developer (70% BE / 30% FE) to contribute to feature developm...

Location

Poland , Warsaw

Salary:

Not provided

Inetum

Expiration Date

Until further notice

Requirements

Minimum 4 years of experience as a Full Stack Developer
Backend: Java, Spring Boot, PostgreSQL
Frontend: React, TypeScript, HTML, CSS
Experience in designing inter-service communication (REST, WebSocket, Message Broker)
Proficiency in Docker
Ability to write unit and integration tests (JUnit, Mockito)
English and Polish at B2 level
Independent and team-oriented work approach

Job Responsibility

Backend development and frontend feature implementation (70% BE / 30% FE)
Rate limit gateway
Frontend for agents
Customer complaints management

What we offer

Flexible working hours
Hybrid work model
Cafeteria system
Generous referral bonuses
Additional revenue sharing opportunities
Ongoing guidance from a dedicated Team Manager
Tailored technical mentoring
Dedicated team-building budget
Opportunities to participate in charitable initiatives and local sports programs
Supportive and inclusive work culture

Fulltime

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...

Location

Canada; United States

Salary:

160000.00 - 260000.00 USD / Year

Apollo.io

Expiration Date

Until further notice

Requirements

8+ years of software engineering experience with a focus on production systems
1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
Production LLM Applications: Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
Agent Development: Experience building multi-step AI agents, LLM chaining, and complex workflow automation
Prompt Engineering Expertise: Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
Python Proficiency: Expert-level Python skills for production AI systems
Backend Engineering: Strong experience building scalable backend systems, APIs, and distributed architectures
LangChain or Similar Frameworks: Experience with LangChain, LlamaIndex, or other LLM application frameworks
API Integration: Proven ability to integrate multiple APIs and services to create advanced AI capabilities
Production Deployment: Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)

Job Responsibility

Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions

What we offer

equity
company bonus or sales commissions/bonuses
401(k) plan
at least 10 paid holidays per year, flex PTO, and parental leave
employee assistance program and wellbeing benefits
global travel coverage
life/AD&D/STD/LTD insurance
FSA/HSA and medical, dental, and vision benefits

Fulltime

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...

Location

India

Salary:

Not provided

Apollo.io

Expiration Date

Until further notice

Requirements

7+ years of software engineering experience with a focus on production systems
1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
Experience building multi-step AI agents, LLM chaining, and complex workflow automation
Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
Expert-level Python skills for production AI systems
Strong experience building scalable backend systems, APIs, and distributed architectures
Experience with LangChain, LlamaIndex, or other LLM application frameworks
Proven ability to integrate multiple APIs and services to create advanced AI capabilities
Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)

Job Responsibility

Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions

What we offer

Invest deeply in your growth, ensuring you have the resources, support, and autonomy to own your role and make a real impact
Collaboration is at our core—we’re all for one, meaning you’ll have a team across departments ready to help you succeed
We encourage bold ideas and courageous action, giving you the freedom to experiment, take smart risks, and drive big wins

Senior Backend Software Engineer, Agents

Cohere

Location:

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:
February 20, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Backend Software Engineer, Agents