CrawlJobs Logo
Randstad Logo Randstad · IT - Software Development

Senior Software Engineer — AI/LLM Products

Japan, Tokyo 8000000.00 - 10000000.00 JPY / Year · Job Posted May 16, 2026
Apply Position
Job Link Share

Job Description

This role is focused on building AI-powered tools that support sales enablement. As a Software Engineer, you will work on designing and developing product features that leverage AI technologies to improve how sales teams operate and create value for users. This is a high-impact position for engineers who are excited to work at the intersection of product development and applied AI.

Job Responsibility

  • Design, build, and operate AI-powered systems leveraging large language models (LLMs), including prompt engineering, output parsing, and evaluation pipelines
  • Architect event-driven workflows (Lambda, webhooks, queues) that enable AI-powered features to operate reliably at scale
  • Collaborate closely with product, sales, and CS teams to translate business needs into effective AI-driven product features
  • Own the full lifecycle of AI-powered products — from prototyping and prompt tuning to production deployment and monitoring
  • Evaluate and integrate emerging AI capabilities (models, APIs, tooling) to continuously improve product and model performance
  • Contribute to engineering best practices through code reviews, documentation, and knowledge sharing

Requirements

  • 4+ years of software engineering experience in product development
  • Hands-on experience building applications that integrate LLMs (e.g., Claude, GPT) — including prompt design, tuning, and output evaluation
  • End-to-end engineering experience from design and development through to production operation
  • Solid backend engineering skills
  • Experience with event-driven or serverless architectures (Lambda, webhooks, message queues)
  • Strong communication skills
  • Business-level proficiency in both Japanese and English (JLPT N2 or higher certification is required)
  • Experience designing, building, and operating architectures on AWS
  • Familiarity with RAG (Retrieval-Augmented Generation) patterns, vector databases, or embedding-based search
  • Experience building multi-step AI workflows (e.g., tool use, chain-of-thought, planning)
  • Knowledge of SOLID principles, Clean Architecture, or Domain-Driven Design (DDD)
  • Test-Driven Development (TDD) experience

Nice to have

  • Experience designing, building, and operating architectures on AWS
  • Familiarity with RAG (Retrieval-Augmented Generation) patterns, vector databases, or embedding-based search
  • Experience building multi-step AI workflows (e.g., tool use, chain-of-thought, planning)
  • Knowledge of SOLID principles, Clean Architecture, or Domain-Driven Design (DDD)
  • Test-Driven Development (TDD) experience

What we offer

  • 健康保険
  • 厚生年金保険
  • 雇用保険
  • 土曜日
  • 日曜日
  • 祝日
Randstad - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Software Engineer — AI/LLM Products

8 matching positions

Senior Software Engineer

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
United States , Multiple Locations
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 4+ years of experience in cloud development principles and patterns, particularly loosely coupled architectures, micro-services and DevOps model
  • 4+ years of experience coding in C#, and .Net
  • 4+ years of experience in Database development in Azure SQL, Cosmos DB, or Azure Data Factory (ADF)
  • 4+ years of experience in one of the modern front-end frameworks such as React, Type Script, and Experience with Python, AI/LLM-based tools and frameworks, particularly for analyzing test failures and predicting root causes
  • Experience in developing applications using RESTful APIs, microservices architecture, ASP.NET, Web API, and Azure AI Foundry, with a focus on scalable and intelligent enterprise solutions
  • Knowledge of data structures, algorithms, and software design principles
  • Effective communication and a track record of sharing knowledge with others through training and knowledge sharing sessions
  • Experience optimizing cloud infrastructure for cost savings and operational efficiency
Job Responsibility
Job Responsibility
  • Develop software features for Skilling platforms, including requirement gathering, architecture, application and database design, development, testing, and deployment, while enforcing engineering proficient practices to ensure high-quality, scalable, and secure solutions
  • Leverage AI and develop Copilot features within the application to enhance user experience and productivity
  • Establish and enforce proficient practices in coding, testing, and documentation to ensure high standards for code quality, performance, and service reliability
  • Support and maintain existing services & integrations with Line of Business (LOB) applications across the enterprise
  • Design, develop and maintain engineering infrastructure, tools, and services that power the Continuous Integration and Continuous Delivery/Deployment (CI/CD) for Microsoft Learning (Skilling) platform and services
  • Improve the reliability and debuggability of test frameworks by integrating automation and gates
  • Develop and utilize AI/LLM models to analyze test failures, identifying root causes such as test flakiness or infrastructure issues
  • Transition manual testing efforts currently handled by vendor Directly Responsible Individuals (DRIs) into automated processes
  • Lead early in career Software Engineers, and collaborates with Product Managers, Designers and cross-functional teams to deliver high quality security solutions across platforms that ship to hundreds of millions of learners around the world
  • Leads by example within the team by producing extensible and maintainable
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Full-Stack)

This ambitious Series B-funded start-up challenger are currently looking for Sof...
Location
Location
United States
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Startup Energy: thrive in fast-paced environments, manage ambiguity well, and focus on what moves the needle
  • No fixed specialization → pedigree and trajectory matter most
  • Pedigree: top-tier university + strong brand-name tech company or elite startup
  • Good trajectory / progression
  • Full-stack or backend preferred (not pure front-end)
  • AI/LLM exposure not required — most of the team is learning on the job
Job Responsibility
Job Responsibility
  • Be engaged in software development tasks, from design, coding, code review, etc
  • Work closely with the rest of engineering and other stakeholders from their growth, marketing, and product teams to plan features and build a high-quality product that elevates the productivity of all developers
  • Improve their performance and reliability by building new features or polishing existing product parts
  • Trial ideas and concepts to get quick feedback from internal and external users
  • Work across the entire technical stack to make sure users have the most efficient and delightful experience
  • Be a mentor and provide thoughtful feedback to your peers, and build strong personal connections with your teammates
What we offer
What we offer
  • Competitive Salary + Equity
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Agentic AI)

Radancy is the global leader in talent acquisition software, helping enterprises...
Location
Location
Austria , Vienna
Salary
Salary:
Not provided
radancy.com Logo
Radancy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience building and operating production backend systems, with hands-on exposure to AI/ML-powered applications preferred
  • Strong proficiency in a strongly typed language such as Scala, Java, or similar strongly preferred
  • Experience integrating LLM APIs, embedding models, or ML inference services into distributed systems
  • Experience building or consuming agent frameworks (e.g., Google ADK, LangGraph, or AutoGen) to orchestrate multi-step, tool-using AI agents in production environments
  • Familiarity with Model Context Protocol (MCP) or similar tool-serving standards
  • Practical understanding of NLP, LLM behavior, prompt design, retrieval-augmented generation (RAG), and structured output patterns
  • Experience deploying and scaling AI-enabled services in AWS/GCP cloud environments
  • Hands-on experience with containerization and orchestration (Docker, Kubernetes)
  • Experience designing highly concurrent, fault-tolerant systems using async processing, queues, pub/sub, or event-driven architectures
  • Familiarity with CI/CD pipelines, infrastructure-as-code (Terraform or similar), and automated deployment workflows
Job Responsibility
Job Responsibility
  • Architect, build, and operate cloud-native backend services that power AI-driven recruiter workflows
  • Design and implement agentic AI systems using frameworks such as Google ADK, LangGraph, or similar, building multi-step reasoning loops, tool-use pipelines, and agent-to-agent (A2A) communication patterns for production recruiter automation
  • Build, deploy, and maintain MCP servers to expose backend capabilities as structured tool endpoints consumable by AI agents, ensuring schema correctness, session management, and tenant-safe execution
  • Design and deploy scalable AI/LLM services using containerization and orchestration technologies in cloud environments
  • Integrate LLM APIs, embedding services, and ML inference endpoints into distributed systems with strong API design, versioning, and fault tolerance
  • Implement asynchronous processing, event-driven architectures and durable state management for AI workflow orchestration
  • Build and maintain CI/CD pipelines to automate testing, deployment, and monitoring of AI-enabled services
  • Establish observability practices (metrics, tracing, logging, alerting) to monitor model performance, latency, cost, and reliability in production
  • Optimize inference workloads for performance, scalability, and cost efficiency, including autoscaling and concurrency management
  • Partner with Data Science to bring models to production, implement evaluation pipelines, and support model lifecycle management
Read More
Arrow Right

Senior Software Engineer, Frontend Platform

At Vanta, our mission is to help businesses earn and prove trust. We believe tha...
Location
Location
United States
Salary
Salary:
179000.00 - 211000.00 USD / Year
vanta.com Logo
Vanta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Have experience building and maintaining software services and infrastructure platforms
  • Have a deep understanding of TypeScript and React
  • Have a deep understanding of writing and testing performant web client code
  • Have experience scaling platform systems
  • Have experience writing codemods and migration automations
  • Demonstrate empathy for the developer experience (DX) and have a strong product sense for developer tooling
  • Open to using AI to amplify their skills and strengthen their work - demonstrating curiosity, a willingness to learn, and sound judgment in applying AI responsibly to improve efficiency and impact
Job Responsibility
Job Responsibility
  • Lead complex projects with multiple stakeholders and engineers to enable our business and team to scale
  • Evolve our frontend build system: bundlers, static analysis, caching, package management, and monorepo tooling
  • Develop and scale our frontend testing strategy (unit, integration, visual regression, and E2E)
  • Maintain and evolve GraphQL tooling: code patterns, developer tooling, scalability, and reliability
  • Improve web performance and observability: set SLOs, implement monitoring and alerting, and drive remediation
  • Plan and run modernization and migration initiatives leveraging codemods and AI/LLM tooling
  • Work with talented and kind engineers to make a significant impact on our customer base, enabling them to improve their security and prove it
  • Contribute to building Vanta’s engineering culture as we grow
What we offer
What we offer
  • Offers Equity
  • medical benefits
  • 401(k) plan
  • other company perk programs
  • Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans
  • 16 weeks fully-paid Parental Leave for all new parents
  • Health & wellness stipend
  • Remote workspace, internet, and cellphone stipend
  • Commuter benefits for team members who report to the SF and NYC office
  • Family planning benefits
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Applied AI)

As a Senior Software Engineer (Applied AI), you will play a critical hands-on ro...
Location
Location
United States , Seattle; New York City; Boston
Salary
Salary:
130000.00 - 200000.00 USD / Year
pearlhealth.com Logo
Pearl Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8+ years of professional experience in software engineering, with a strong foundation in service-oriented architectures and distributed systems
  • Hands-on experience building and productionizing Applied AI/LLM features, including working with RAG architectures, vector databases, embedding models, and/or Agentic workflows
  • Experience with observability and evaluation practices for production LLM systems (prompt tracking, quality metrics, cost monitoring)
  • Strong proficiency in Python, relational databases, and a major cloud platform (AWS preferred)
  • A deep understanding of modern service design principles, including RESTful and event-driven architectures
  • Proven experience designing, building, and optimizing data-intensive applications
  • A demonstrated history of mentoring engineers and driving technical best practices within a team
  • A strong background in performance optimization, reliability engineering, and security best practices
Job Responsibility
Job Responsibility
  • Design, build, and own production AI features powered by LLMs, including RAG architectures (chunking strategies, semantic search, vector databases) and Agentic workflows
  • Develop high-performance data pipelines, APIs, and microservices that process healthcare data at scale and securely integrate LLM outputs into user-facing experiences
  • Execute Proof-of-Concepts (POCs) and technical evaluations of new AI technologies to validate product viability and scalability
  • Build responsive web applications using modern frontend frameworks to deliver intuitive, user-facing intelligence and analytic features
  • Ensure observability, monitoring, and operational excellence for AI-powered services, championing security and regulatory compliance (HIPAA, SOC2)
  • Drive architectural decisions and system optimizations for AI features in close collaboration with product and engineering leadership
  • Own technical projects from discovery to delivery with autonomy, ensuring solutions align with business needs and long-term scalability
  • Mentor and upskill fellow engineers on Applied AI best practices, fostering a strong culture of technical excellence and collaborative growth
  • Contribute to the team's understanding of LLM capabilities, limitations, and best practices within the healthcare domain
  • Participate in thorough design and code reviews, raising the bar for technical quality across the team
What we offer
What we offer
  • discretionary performance bonus
  • equity options
  • competitive benefits package
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

Are you looking for an opportunity to work with the latest Azure offerings and p...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in Software Development
  • 2+ years of experience designing, developing, deploying, and monitoring cloud services/RESTful service/Distributed system
  • Exposure to AI/LLM integration, function calling, or semantic retrieval systems is highly desirable
  • Ability to write clean, working code using core algorithms, data structures, and analytics oriented problem solving
  • Extensive experience in implementing and optimizing data pipelines and distributed data systems (e.g., Azure Data Lake, Spark, Synapse, SQL databases)
  • Understanding of data governance, privacy, lineage, and security best practices, especially within highly regulated or enterprise environments
  • Excellent communication skills to convey complex technical concepts to both technical and non-technical audiences
  • Expertise with modern data engineering languages and frameworks (e.g., Azure Data Explorer, PySpark, SQL, etc)
  • Experience collaborating in cross-functional teams and building consensus among stakeholders with diverse backgrounds (engineering, analytics, product, business)
  • Track record of driving innovation in data engineering, including experience leading technical projects and mentoring others
Job Responsibility
Job Responsibility
  • Design, implement, monitor, and optimize large-scale, robust data pipelines and architectures that support products data analytics initiatives
  • Develop scalable ETL/ELT workflows, ensure reliable ingestion, transformation, and storage of high-volume, high-velocity data from diverse sources with different schemas
  • Data Governance & Trust: Enforce best practices for data quality, lineage, security, and compliance
  • Collaborate with stakeholders to define trustworthy data sets and implement rigorous data validation protocols, ensuring analytics are accurate and auditable
  • Cross-functional Collaboration: Work closely with product managers, software engineers, AI researchers, and business stakeholders to build data solutions that accomplish business goals
  • Enable self-service analytics and empower teams by building data models, semantic layers, and tools that streamline access to trusted information
  • Translate ambitious vision into actionable roadmaps and measurable outcomes
  • Design, architect, and implement backend, and service components to support multi-step Copilot flows, including data orchestration, context management, and state persistence
  • Integrate LLMs and APIs to enable context-aware, human-in-the-loop experiences across customer scenarios
  • Evaluate AI/ML different models, and tune then to suit the product needs
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Satellite Fleet Automation

We are seeking a highly motivated Senior Software Engineer to join our Fleet Aut...
Location
Location
Finland , Espoo
Salary
Salary:
Not provided
iceye.com Logo
ICEYE
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software engineering experience with a focus on backend systems
  • Deep understanding of TCP/IP networking, socket programming, and network protocols
  • Strong proficiency in Python, Go & Rust (at least 2)
  • Proven track record of building and operating automated/distributed systems in production
  • Experience with AWS (or similar cloud providers), Docker, and Kubernetes
  • Experience with relational databases (PostgreSQL) and time-series databases (InfluxDB)
  • Problem-solving skills and ability to identify, research and resolve new problems
  • Keen interest and pragmatic experience in using AI/LLM tools assisting software development
  • Ability and willingness to learn new skills in a fast-paced environment
  • Fluency in English and a collaborative mindset
Job Responsibility
Job Responsibility
  • System Architecture: Design and implement scalable backend services that automate the command and control of our satellite fleet
  • Network Reliability: Develop robust communication layers for ground-to-space connectivity
  • Automation: Build orchestration engines to handle routine satellite operations, telemetry collection, anomaly detection, and automatic recovery procedures
  • Integration: Work with ground stations and internal systems to ensure seamless telemetry, tracking and command flow
  • Operational Excellence: Maintain high code quality through peer reviews, automated testing, and CI/CD best practices
  • Mentorship: Guide junior engineers and contribute to technical decision-making within the team
What we offer
What we offer
  • Occupational healthcare, occupational and private insurance
  • Yearly benefit budget to spend on sport, transport, wellness, lunch, etc
  • Phone subscription with iPhone of choice
  • Relocation support (flight tickets, accommodation, relocation agency support)
  • Time and resources for self-development, research, training, conferences, and certification schemes
  • Inspiring office environment with collaborative spaces and silent workspaces
  • Access to state-of-the-art labs and testing facilities
  • Opportunities to attend international space conferences
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Laravel), AI Solutions

PactFi is seeking a Senior Software Engineer with a strong focus on building and...
Location
Location
United States , New York
Salary
Salary:
150000.00 - 170000.00 USD / Year
fin.capital Logo
Fin Capital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive hands-on experience with Laravel building production-grade backend systems
  • Strong understanding of backend application architecture, data modeling, and scalable system design
  • Practical experience working with AI/LLM tooling, such as: LLM APIs and agent frameworks, Document parsing and extraction, Vector databases and embeddings, RAG pipelines and model orchestration
  • Ability to evaluate architectural trade-offs across performance, cost, security, and business value
  • Strong problem-solving skills and comfort working with ambiguous requirements
  • Excellent communication skills and a collaborative, ownership-driven mindset
Job Responsibility
Job Responsibility
  • Design, build, and maintain robust backend systems using Laravel, with a focus on reliability, scalability, and long-term maintainability
  • Develop and evolve internal services, core platform components, and shared libraries that power PactFi’s products and operations
  • Collaborate with Product Managers, engineering leadership, and QA to shape technical solutions and support high-quality releases through thoughtful design, testing, debugging, and iteration
  • Contribute to architectural discussions, technical standards, and platform-level improvements that support PactFi’s long-term growth
  • Take initiative on internal projects and exploratory work aimed at improving developer productivity, system reliability, and operational efficiency
  • Identify high-value AI use cases across the PactFi platform, focusing on real business impact
  • Design and implement AI-powered backend workflows, including: LLM-driven features and automations, Intelligent agents and decision-support systems, Automated document ingestion and extraction pipelines for large, unstructured, and semi-structured documents (e.g., PDFs, contracts, financial statements)
  • Lead the integration of AI models and platforms such as OpenAI, AWS Bedrock, Azure AI, Google Gemini, or similar
  • Design and implement AI workflows for inference, orchestration, evaluation, and production readiness, with attention to reliability, observability, security, and cost
  • Partner with engineering and data teams to ensure AI solutions integrate cleanly with existing systems, APIs, and data pipelines
What we offer
What we offer
  • Offers Equity
  • Healthcare coverage
  • 401k
  • Fulltime
Read More
Arrow Right