Backend AI Engineer Job at Randstad (Tokyo)

Senior AI Product Engineer, Backend

Our Backend Engineering team builds all of the highly scalable distributed servi...

Location

United States

Salary:

125000.00 - 225000.00 USD / Year

Arize

Expiration Date

Until further notice

Requirements

5+ years of experience working with high-performance backend systems
Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages
Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies
Previous work building and operating highly complex SaaS platforms/systems
Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.

Job Responsibility

Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript
Build high-volume and highly available analytics systems
Design and build APIs specific to our customers’ Machine Learning and LLM workflows
Prototype, optimize, and maintain scalable backend services that power the Arize core platform
Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks
Develop and integrate collection tools for robust monitoring of ML and LLM pipelines
Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment
Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings
Contribute to the build our own in-house AI Agents

What we offer

competitive equity package
comprehensive benefits package, including medical, dental, vision
a 401(k) plan
unlimited paid time off
a generous parental leave plan
additional support for mental health and wellness
WFH monthly stipend to pay for co-working spaces

Fulltime

Senior Software Engineer, Backend (AI Agent)

At Cresta, the AI Agent team is on a mission to create state-of-the-art AI Agent...

Location

Canada , Toronto

Salary:

Not provided

Cresta

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Computer Science or a related field
5+ years of experience in backend system architecture, cloud services, or related technology fields
Proficient in designing and maintaining clear and robust APIs with a strong understanding of protocols including gRPC, REST
Previous experience working with Virtual Agent or AI Agent systems
Experience in high-performance database schema design and query optimization, including knowledge of SQL and NoSQL databases
Experience in containerized application deployment using Kubernetes and Docker in microservices architectures
Experience with cloud environments such as AWS, Azure, or Google Cloud, with a strong understanding of cloud security and compliance standards

Job Responsibility

Design, develop, and maintain scalable and robust backend architectures for Cresta’s AI Agent solutions and proprietary models
Collaborate with cross-functional teams including frontend engineers, machine learning engineers to ensure seamless integration of AI Agents into Cresta’s customer solutions
Lead initiatives to enhance system scalability and reliability in production environments, focusing on backend services that support AI functionalities
Drive efforts to optimize server response times, process large volumes of data efficiently, and maintain high system availability
Innovate and implement security measures, cost-reduction strategies, and performance improvements in backend systems supporting AI Agents

What we offer

We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs
Paid parental leave to support you and your family
Monthly Health & Wellness allowance
Work from home office stipend to help you succeed in a remote environment
Lunch reimbursement for in-office employees
PTO: 3 weeks in Canada

Software Engineer, Backend (AI Agent)

At Cresta, the AI Agent team is on a mission to create state-of-the-art AI Agent...

Location

Canada , Toronto

Salary:

Not provided

Cresta

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Computer Science or a related field
2+ years of experience in backend system architecture, cloud services, or related technology fields
Knowledge in designing and maintaining clear and robust APIs with a strong understanding of protocols including gRPC, REST
Experience in high-performance database schema design and query optimization, including knowledge of SQL and NoSQL databases
Experience in containerized application deployment using Kubernetes and Docker in microservices architectures
Experience with cloud environments such as AWS, Azure, or Google Cloud, with a strong understanding of cloud security and compliance standards

Job Responsibility

Design, develop, and maintain scalable and robust backend architectures for Cresta’s AI Agent solutions and proprietary models
Collaborate with cross-functional teams including frontend engineers, machine learning engineers to ensure seamless integration of AI Agents into Cresta’s customer solutions
Lead initiatives to enhance system scalability and reliability in production environments, focusing on backend services that support AI functionalities
Drive efforts to optimize server response times, process large volumes of data efficiently, and maintain high system availability
Innovate and implement security measures, cost-reduction strategies, and performance improvements in backend systems supporting AI Agents

What we offer

We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs
Paid parental leave to support you and your family
Monthly Health & Wellness allowance
Work from home office stipend to help you succeed in a remote environment
Lunch reimbursement for in-office employees
PTO: 3 weeks in Canada

Fulltime

AI Backend Engineer

AI Backend Engineer position at a smart construction solutions startup in Tokyo,...

Location

Japan , Tokyo

Salary:

6000000.00 - 12000000.00 JPY / Year

Randstad

Expiration Date

November 11, 2026

Requirements

Master’s in Deep Learning, Machine Learning, Data Science, Artificial Intelligence, Computer Science or similar field, and at least 2 years experience building Machine Learning Models
Thorough understanding of modern ML technologies, models, methods and its fundamentals
Good grasp of data analytics
Experience working with Python, Pytorch and related modern popular ML libraries
Ability to understand research papers and translate insights into action
Technical communication skills in English

Job Responsibility

Work collaboratively with the rest of the AI team, as well as other teams and departments within the company, to identify, propose, explore and create ways to tackle the challenges using AI, ML or optimization algorithms as per your professional expertise
Help disseminate AI literacy throughout the organization
Be involved in the whole lifecycle of an AI solution

What we offer

健康保険
厚生年金保険
雇用保険
休憩室
土曜日
日曜日
祝日
賞与

Fulltime

Staff Backend Engineer, Speech AI

Our intelligent runtime must seamlessly connect to foundational models to power ...

Location

United States , Mountain View

Salary:

200000.00 - 300000.00 USD / Year

Inworld AI

Expiration Date

Until further notice

Requirements

A BA/BS degree in Computer Science or a related technical field, or equivalent practical experience
5+ years of professional experience in software development, with a proven track record of shipping high-quality, user-facing products
Strong product sense and an ability to think critically about user experience and business impact
Demonstrated experience in building and scaling production-grade backend APIs and distributed systems
Strong proficiency in Python and professional experience with one or more of the following: Java/Kotlin, or Go
Hands-on experience with containerization (Docker) and deploying services on orchestration platforms like Kubernetes
A solid foundation in data structures, algorithms, and system design

Job Responsibility

Own features end-to-end, from collaborating on the initial concept with product managers to shipping and monitoring the final product
Translate product requirements and user needs into robust, scalable, and maintainable backend services and APIs
Design, build, and launch user-facing APIs and backend systems in Python, Java/Kotlin, and Go that deliver seamless voice experiences
Partner closely with Product Managers and ML engineers to define scope, identify technical trade-offs, and drive the product roadmap forward
Write high-quality, production-grade code that powers real-time audio processing, model inference, and complex data pipelines
Champion engineering and product excellence, with a focus on delivering tangible value to our users quickly and iteratively

What we offer

bonus
equity
benefits
relocation assistance

Fulltime

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...

Location

Canada; United States

Salary:

160000.00 - 260000.00 USD / Year

Apollo.io

Expiration Date

Until further notice

Requirements

8+ years of software engineering experience with a focus on production systems
1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
Production LLM Applications: Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
Agent Development: Experience building multi-step AI agents, LLM chaining, and complex workflow automation
Prompt Engineering Expertise: Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
Python Proficiency: Expert-level Python skills for production AI systems
Backend Engineering: Strong experience building scalable backend systems, APIs, and distributed architectures
LangChain or Similar Frameworks: Experience with LangChain, LlamaIndex, or other LLM application frameworks
API Integration: Proven ability to integrate multiple APIs and services to create advanced AI capabilities
Production Deployment: Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)

Job Responsibility

Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions

What we offer

equity
company bonus or sales commissions/bonuses
401(k) plan
at least 10 paid holidays per year, flex PTO, and parental leave
employee assistance program and wellbeing benefits
global travel coverage
life/AD&D/STD/LTD insurance
FSA/HSA and medical, dental, and vision benefits

Fulltime

Senior LLM Backend Engineer

We are looking for a Senior Backend Engineer with a strong focus on Large Langua...

Location

Spain

Salary:

Not provided

Bark

Expiration Date

Until further notice

Requirements

Extensive production experience with Python in backend engineering
Proven experience integrating LLMs into applications via APIs or SDKs
Strong experience building and maintaining APIs for LLM-based features
Strong experience building and maintaining event-driven workflows
Strong experience building and maintaining business logic that consumes AI outputs
Strong experience building and maintaining integrations with 3rd party AI/ML platforms
Solid SQL and NoSQL experience (especially in AI data pipelines)
Production experience with Docker, ideally with Kubernetes or AWS Fargate/ECS/EKS
Experience deploying and maintaining AI services in cloud environments
Strong organisational skills and ability to deliver in a fast-paced, product-focused environment

Job Responsibility

Work with product managers to understand user needs and translate them into AI-powered functionality
Design and build APIs, services, and workflows that integrate LLMs (both proprietary and open-source)
Implement prompt engineering, RAG pipelines, and model fine-tuning where required
Optimise AI inference performance, scalability, and cost-effectiveness
Ensure AI features meet high standards for security, reliability, and maintainability
Collaborate with other engineers to integrate AI features seamlessly into the wider system
Stay on top of emerging LLM technologies and best practices, running experiments and sharing knowledge across the team

What we offer

Fully remote working
Personal annual L&D Budgets with 600€ to spend on your development
Being at the forefront of an industry with new and exciting problems to solve

Fulltime

Senior AI Engineer

As a Senior AI Engineer on our AI Engineering team, you will be responsible for ...

Location

India

Salary:

Not provided

Apollo.io

Expiration Date

Until further notice

Requirements

7+ years of software engineering experience with a focus on production systems
1.5+ years of hands-on LLM experience (2023-present) building real applications with GPT, Claude, Llama, or other modern LLMs
Demonstrated experience building customer-facing, scalable LLM-powered products with real user usage (not just POCs or internal tools)
Experience building multi-step AI agents, LLM chaining, and complex workflow automation
Deep understanding of prompting strategies, few-shot learning, chain-of-thought reasoning, and prompt optimization techniques
Expert-level Python skills for production AI systems
Strong experience building scalable backend systems, APIs, and distributed architectures
Experience with LangChain, LlamaIndex, or other LLM application frameworks
Proven ability to integrate multiple APIs and services to create advanced AI capabilities
Experience deploying and managing AI models in cloud environments (AWS, GCP, Azure)

Job Responsibility

Design and Deploy Production LLM Systems: Build scalable, reliable AI systems that serve millions of users with high availability and performance requirements
Agent Development: Create sophisticated AI agents that can chain multiple LLM calls, integrate with external APIs, and maintain state across complex workflows
Prompt Engineering Excellence: Develop and optimize prompting strategies, understand trade-offs between prompt engineering vs fine-tuning, and implement advanced prompting techniques
System Integration: Build robust APIs and integrate AI capabilities with existing Apollo infrastructure and external services
Evaluation & Quality Assurance: Implement comprehensive evaluation frameworks, A/B testing, and monitoring systems to ensure AI systems meet accuracy, safety, and reliability standards
Performance Optimization: Optimize for cost, latency, and scalability across different LLM providers and deployment scenarios
Cross-functional Collaboration: Work closely with product teams, backend engineers, and stakeholders to translate business requirements into technical AI solutions

What we offer

Invest deeply in your growth, ensuring you have the resources, support, and autonomy to own your role and make a real impact
Collaboration is at our core—we’re all for one, meaning you’ll have a team across departments ready to help you succeed
We encourage bold ideas and courageous action, giving you the freedom to experiment, take smart risks, and drive big wins

Backend AI Engineer

Randstad

Location:
Japan , Tokyo

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:
February 04, 2026

Expiration:
October 01, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Backend AI Engineer

Senior AI Product Engineer, Backend

Senior Software Engineer, Backend (AI Agent)

Software Engineer, Backend (AI Agent)

AI Backend Engineer

Staff Backend Engineer, Speech AI

Senior AI Engineer

Senior LLM Backend Engineer

Senior AI Engineer

Backend AI Engineer

Randstad

Location:Japan , Tokyo

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:February 04, 2026

Expiration:October 01, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Backend AI Engineer

Senior AI Product Engineer, Backend

Senior Software Engineer, Backend (AI Agent)

Software Engineer, Backend (AI Agent)

AI Backend Engineer

Staff Backend Engineer, Speech AI

Senior AI Engineer

Senior LLM Backend Engineer

Senior AI Engineer

Location:
Japan , Tokyo

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
February 04, 2026

Expiration:
October 01, 2026