CrawlJobs Logo

Senior Software Engineer — AI/LLM Products

https://www.randstad.com Logo

Randstad

Location Icon

Location:
Japan , Tokyo

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

8000000.00 - 10000000.00 JPY / Year
Save Job
Save Icon
Apply Position

Job Description:

This role is focused on building AI-powered tools that support sales enablement. As a Software Engineer, you will work on designing and developing product features that leverage AI technologies to improve how sales teams operate and create value for users. This is a high-impact position for engineers who are excited to work at the intersection of product development and applied AI.

Job Responsibility:

  • Design, build, and operate AI-powered systems leveraging large language models (LLMs), including prompt engineering, output parsing, and evaluation pipelines
  • Architect event-driven workflows (Lambda, webhooks, queues) that enable AI-powered features to operate reliably at scale
  • Collaborate closely with product, sales, and CS teams to translate business needs into effective AI-driven product features
  • Own the full lifecycle of AI-powered products — from prototyping and prompt tuning to production deployment and monitoring
  • Evaluate and integrate emerging AI capabilities (models, APIs, tooling) to continuously improve product and model performance
  • Contribute to engineering best practices through code reviews, documentation, and knowledge sharing

Requirements:

  • 4+ years of software engineering experience in product development
  • Hands-on experience building applications that integrate LLMs (e.g., Claude, GPT) — including prompt design, tuning, and output evaluation
  • End-to-end engineering experience from design and development through to production operation
  • Solid backend engineering skills
  • Experience with event-driven or serverless architectures (Lambda, webhooks, message queues)
  • Strong communication skills
  • Business-level proficiency in both Japanese and English (JLPT N2 or higher certification is required)
  • Experience designing, building, and operating architectures on AWS
  • Familiarity with RAG (Retrieval-Augmented Generation) patterns, vector databases, or embedding-based search
  • Experience building multi-step AI workflows (e.g., tool use, chain-of-thought, planning)
  • Knowledge of SOLID principles, Clean Architecture, or Domain-Driven Design (DDD)
  • Test-Driven Development (TDD) experience

Nice to have:

  • Experience designing, building, and operating architectures on AWS
  • Familiarity with RAG (Retrieval-Augmented Generation) patterns, vector databases, or embedding-based search
  • Experience building multi-step AI workflows (e.g., tool use, chain-of-thought, planning)
  • Knowledge of SOLID principles, Clean Architecture, or Domain-Driven Design (DDD)
  • Test-Driven Development (TDD) experience
What we offer:
  • 健康保険
  • 厚生年金保険
  • 雇用保険
  • 土曜日
  • 日曜日
  • 祝日

Additional Information:

Job Posted:
May 16, 2026

Expiration:
April 14, 2027

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Randstad - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Software Engineer — AI/LLM Products

Senior Software Engineer, Observability

The Observability team at Airtable ensures that engineers have the tools they ne...
Location
Location
United States , San Francisco; New York; Seattle
Salary
Salary:
196000.00 - 270000.00 USD / Year
airtable.com Logo
Airtable
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of software engineering experience
  • 3+ years focused on observability or infrastructure at scale
  • Demonstrated success implementing and running production-grade logging, metrics, or tracing systems
  • Proficiency in distributed systems concepts, data streaming pipelines, and container orchestration (Kubernetes)
  • Deep hands-on knowledge of tools such as Prometheus, Grafana, Datadog, OpenTelemetry, ELK Stack, Loki, or ClickHouse
  • Comfort with at least one programming language (e.g., Go, Python, Java) to build and maintain observability tooling
  • Experience mentoring engineers and collaborating across multiple teams
  • Strong communication skills
  • Eagerness to own high-impact initiatives
  • Proven ability to balance short-term fixes with long-term strategic vision
Job Responsibility
Job Responsibility
  • Architect and scale core observability systems
  • Lead the design and evolution of logging, metrics, and tracing pipelines
  • Evaluate and integrate new technologies (e.g., OpenTelemetry, ClickHouse, ELK stack)
  • Guide and mentor a growing team of infrastructure engineers
  • Define and uphold coding standards and operational excellence
  • Partner with Deploy Infrastructure, Service Orchestration, and Product teams
  • Align infrastructure decisions with business goals
  • Own end-to-end reliability for observability tools and establish SLAs, SLOs, and error budgets
  • Optimize performance and cost of large-scale data pipelines
  • Shape the observability roadmap
What we offer
What we offer
  • Opportunity to receive benefits
  • Restricted stock units
  • May include incentive compensation
  • Comprehensive benefit offerings
  • Fulltime
Read More
Arrow Right

Senior Software Engineer

This ambitious Series B-funded start-up challenger are currently looking for Sof...
Location
Location
United States
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Startup Energy: You thrive in fast-paced environments, manage ambiguity well, and focus on what moves the needle
  • No fixed specialization → pedigree and trajectory matter most
  • Pedigree: top-tier university + strong brand-name tech company or elite startup
  • Good trajectory / progression
  • Full-stack or backend preferred (not pure front-end)
  • AI/LLM exposure not required — most of the team is learning on the job
Job Responsibility
Job Responsibility
  • Be engaged in software development tasks, from design, coding, code review, etc
  • Work closely with the rest of engineering and other stakeholders from their growth, marketing, and product teams to plan features and build a high-quality product that elevates the productivity of all developers
  • Improve their performance and reliability by building new features or polishing existing product parts
  • Trial ideas and concepts to get quick feedback from internal and external users
  • Work across the entire technical stack to make sure users have the most efficient and delightful experience. The features you develop will span all aspects of the user experience, making you an expert on their needs
  • Be a mentor and provide thoughtful feedback to your peers, and build strong personal connections with your teammates
What we offer
What we offer
  • Equity
  • Opportunity to work with an Ambitious, Rapidly-Growing Start-Up
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Full-Stack)

This ambitious Series B-funded start-up challenger are currently looking for Sof...
Location
Location
United States
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Startup Energy: You thrive in fast-paced environments, manage ambiguity well, and focus on what moves the needle
  • No fixed specialization → pedigree and trajectory matter most
  • Pedigree: top-tier university + strong brand-name tech company or elite startup
  • Good trajectory / progression
  • Full-stack or backend preferred (not pure front-end)
  • AI/LLM exposure not required — most of the team is learning on the job
Job Responsibility
Job Responsibility
  • Be engaged in software development tasks, from design, coding, code review, etc
  • Work closely with the rest of engineering and other stakeholders from their growth, marketing, and product teams to plan features and build a high-quality product that elevates the productivity of all developers
  • Improve their performance and reliability by building new features or polishing existing product parts
  • Trial ideas and concepts to get quick feedback from internal and external users
  • Work across the entire technical stack to make sure users have the most efficient and delightful experience
  • Be a mentor and provide thoughtful feedback to your peers, and build strong personal connections with your teammates
What we offer
What we offer
  • Competitive Salary + Equity
  • Fulltime
Read More
Arrow Right

Senior Software Engineer (Full-Stack)

This ambitious Series B-funded start-up challenger are currently looking for Sof...
Location
Location
United States; Canada
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Startup Energy: You thrive in fast-paced environments, manage ambiguity well, and focus on what moves the needle
  • No fixed specialization → pedigree and trajectory matter most
  • Pedigree: top-tier university + strong brand-name tech company or elite startup
  • Good trajectory / progression
  • Full-stack or backend preferred (not pure front-end)
  • AI/LLM exposure not required — most of the team is learning on the job
Job Responsibility
Job Responsibility
  • Be engaged in software development tasks, from design, coding, code review, etc
  • Work closely with the rest of engineering and other stakeholders from their growth, marketing, and product teams to plan features and build a high-quality product that elevates the productivity of all developers
  • Improve their performance and reliability by building new features or polishing existing product parts
  • Trial ideas and concepts to get quick feedback from internal and external users
  • Work across the entire technical stack to make sure users have the most efficient and delightful experience
  • Be a mentor and provide thoughtful feedback to your peers, and build strong personal connections with your teammates
What we offer
What we offer
  • Competitive Salary + Equity
  • Fulltime
Read More
Arrow Right

Senior Backend Software Engineer

The Coaching team builds Highspot’s personalized, AI-enhanced coaching capabilit...
Location
Location
Canada , Vancouver
Salary
Salary:
146000.00 - 178000.00 CAD / Year
highspot.com Logo
Highspot
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or equivalent practical experience
  • 5+ years of experience in back-end software development building and maintaining large-scale web applications
  • At least 3 years of experience working with object-oriented programming languages
  • Ruby and Python preferred
  • Experience architecting, building, and deploying mid-to-large scale web applications in a distributed environment
  • Strong understanding of API design, data modeling, and backend scalability
  • Experience integrating or working with AI/LLM platforms such as OpenAI, Anthropic (Claude), or Azure OpenAI
  • Familiarity with AI-powered development tools (e.g., Cursor, GitHub Copilot, Cody, etc.) and a demonstrated ability to incorporate them effectively into day-to-day workflows
  • Deep expertise in web performance, security, and reliability best practices
  • Proven ability to deconstruct complex technical problems and deliver elegant, maintainable solutions
Job Responsibility
Job Responsibility
  • Design, develop, and maintain high-quality, scalable, and user-centric backend systems using modern technologies
  • Architect and optimize backend infrastructure to power intelligent, AI-driven workflows and Agentic AI integrations
  • Build and maintain integrations with multiple large language models (LLMs) including ChatGPT, Claude, and other OpenAI and Microsoft models
  • Collaborate closely with AI/ML engineers to productionize agentic workflows and autonomous reasoning systems
  • Partner effectively with Product Management and UX Design to translate ideas and research into production-ready, AI-enhanced features
  • Leverage AI-assisted development tools such as Cursor, GitHub Copilot, and other code generation frameworks to accelerate development and improve code quality
  • Lead and mentor engineers through complex projects, emphasizing clean architecture, testing, and software craftsmanship
  • Drive backend infrastructure improvements that enhance reliability, observability, and performance
  • Collaborate cross-functionally to deliver differentiated customer value through AI and data-driven solutions
  • Troubleshoot and resolve critical production issues while contributing to internal documentation and best practices
What we offer
What we offer
  • Comprehensive medical, dental, vision, disability, and life benefits
  • Group Retirement Savings Plan (RRSP) and matching employer contributions (DPSP) with immediate vesting
  • Flexible PTO
  • Generous Holiday Schedule + 5 Days for Annual Holiday Week
  • Quarterly Recharge Fridays (paid days off for mental health recharge)
  • Flexible work schedules
  • Access to Coaches and Therapists through Modern Health
  • 2 Volunteer days per year
  • Monthly transportation allowance for employees that work in our Vancouver Hub location
  • Employees are eligible to receive stock options
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Radix is building the most trusted data and analytics platform in multifamily. J...
Location
Location
United States , Scottsdale
Salary
Salary:
Not provided
radix.com Logo
Radix (AZ)
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering or backend systems, with 2+ years collaborating closely with analytical or scientific practitioners
  • Experience designing at least one end-to-end data application (visualization, model pipeline, etc.) for production use
  • Strong understanding of data modeling, batch processing, and streaming systems
  • Hands-on experience with SQL/NoSQL databases, cloud storage, file-based datasets, and Infrastructure-as-code
  • Experience building or operating data pipelines on AWS cloud services (Lambda, S3, RDS, ECS)
  • Understanding of AI/LLM integration and prompt engineering fundamentals
  • Proficiency with Git/GitHub, and familiarity with Spark and Kubernetes
  • Strong problem-solving skills, ownership, and ability to identify root causes of technical debt and recurring problems
  • Demonstrated ability to translate Product/Science requirements into technical plans and hold teams accountable to delivery timelines
  • Undergraduate degree in computer science, computer engineering, software engineering, or equivalent
Job Responsibility
Job Responsibility
  • Build scalable ETL/ELT pipelines for ingesting structured and unstructured data (Excel, JSON, PDFs, APIs)
  • Design and maintain data pipelines using SQL, Python, Node.js, or TypeScript
  • Work with distributed compute systems (Spark, Kubernetes), message queues, and streaming data
  • Manage and optimize data storage in MongoDB, PostgreSQL, Redis, Snowflake, and S3
  • Develop clean, standardized data schemas and event-driven transformations
  • Integrate AI-assisted parsers, mappers, and LLM-supported transformations
  • Collaborate with backend, analytics, product, and AI teams to break down requirements into well-defined engineering problems
  • Implement monitoring, data validation, and reliability checks (DQ rules, freshness, duplication)
  • Own production readiness, including on-call responsibilities and incident follow-ups
  • Mentor engineers, conduct thorough code reviews, and introduce patterns that raise the team's technical bar
What we offer
What we offer
  • Medical, dental and vision coverage designed to support your wellbeing
  • Pre-IPO Equity
  • Performance Bonus
  • Learn From the Best
  • Build Category-Defining Products
Read More
Arrow Right

Senior Full Stack Engineer

Kiddom is a groundbreaking educational platform that promotes student equity and...
Location
Location
United States , San Francisco Or New York
Salary
Salary:
150000.00 - 185000.00 USD / Year
kiddom.co Logo
Kiddom
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional software development experience
  • Strong GoLang and Python expertise with ability to design, build, and maintain backend services
  • Modern React and TypeScript proficiency with understanding of current patterns and best practices
  • Experience with various state management patterns and knowing when to apply different approaches
  • Database experience with PostgreSQL, MySQL, and Redis
  • Full-stack mindset with willingness to work across the entire technology stack
Job Responsibility
Job Responsibility
  • Build end-to-end solutions from React/TypeScript frontends to GoLang and Python backend services
  • Turn vision into reality by taking ambitious product concepts and engineering them into robust, scalable solutions
  • Dive into hard problems across the full technology stack without hesitation
  • Lead project initiatives as the technical owner of one or more high-impact user-facing features
  • Work with advanced technologies including AI/LLM integrations in regular development work
  • Collaborate closely with small, focused teams to deliver features that directly impact end users
  • Contribute to technical decisions around architecture, tooling, and implementation approaches
What we offer
What we offer
  • Competitive salary
  • Meaningful equity
  • Health insurance benefits: medical (various PPO/HMO/HSA plans), dental, vision, disability and life insurance
  • One Medical membership (in participating locations)
  • Flexible vacation time policy (subject to internal approval). Average use 4 weeks off per year.
  • 10 paid sick days per year (pro rated depending on start date)
  • Paid holidays
  • Paid bereavement leave
  • Paid family leave after birth/adoption. Minimum of 16 paid weeks for birthing parents, 10 weeks for caretaker parents. Meant to supplement benefits offered by State.
  • Commuter and FSA plans
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, AI Developer Tools

At Docker, we make app development easier so developers can focus on what matter...
Location
Location
United States , Seattle
Salary
Salary:
232000.00 - 319000.00 USD / Year
docker.com Logo
Docker
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years software engineering experience with 3+ years in Staff or Principal Engineer roles
  • Deep expertise in AI/ML technologies with hands-on production experience building LLM-powered applications, AI agents, or AI-assisted developer tools
  • Strong understanding of LLM APIs (OpenAI, Anthropic, etc.), prompt engineering, agent orchestration frameworks, and practical applications of AI in software development workflows
  • Proven track record of architecting and building highly scalable distributed systems and developer-facing platforms
  • Production experience with modern cloud-native infrastructure including Kubernetes, GitOps deployment patterns, observability systems, and CI/CD pipelines
  • Proficiency in Go (preferred), Rust, Java, or Python with strong software engineering fundamentals
  • Experience designing developer tools, platform engineering systems, or internal tools that enable other teams
  • Exceptional product and platform mindset considering business outcomes, developer experience, and technical trade-offs
  • Strong communication skills with ability to influence technical and non-technical stakeholders across the organization
  • Track record of technical mentorship and elevating engineering teams' capabilities
Job Responsibility
Job Responsibility
  • Define the long-term technical vision and architecture for AI-powered developer tools and the self-service platform that enables teams to build their own AI agents
  • Establish architectural patterns, technical standards, and best practices for LLM integration, AI agent development, and production AI systems serving developers
  • Lead technical strategy for platform capabilities including deployment frameworks (ArgoCD/GitOps), observability integration (Grafana), security controls, and operational tooling for AI developer tools
  • Design highly available, scalable infrastructure for hosting AI agents and developer tools with predictable performance and intelligent resource management
  • Drive technical decisions on AI technology choices, LLM provider strategies, prompt engineering approaches, and agent orchestration frameworks
  • Partner with Senior Manager and product leadership to align technical architecture with business objectives and productization opportunities
  • Architect and build production-ready AI agents for developer productivity including code review assistants, test generators, deployment diagnostics, and incident response automation
  • Design and implement the self-service platform infrastructure that reduces time-to-production for new AI tools from weeks to days
  • Build systems that accelerate adoption of AI-native development tools (Claude Code, Cursor, Warp) across Docker's engineering organization
  • Establish reliability, security, and performance standards for AI systems including SLOs, monitoring, incident response, and cost management
What we offer
What we offer
  • Freedom & flexibility
  • fit your work around your life
  • Designated quarterly Whaleness Days plus end of year Whaleness break
  • Home office setup
  • we want you comfortable while you work
  • 16 weeks of paid Parental leave
  • Technology stipend equivalent to $100 net/month
  • PTO plan that encourages you to take time to do the things you enjoy
  • Training stipend for conferences, courses and classes
  • Equity
  • Fulltime
Read More
Arrow Right