CrawlJobs Logo

Sdet Ai Qa / Evaluation Engineer – Agentic Applications

Japan, 東京23区 7000000.00 - 12000000.00 JPY / Year · Job Posted July 09, 2026
Apply Position
Job Link Share

Job Description

職種: 品質管理・テスト・評価 業務内容: WFH flexibility! Global Environment! Competitive salary!

Requirements

  • Min of 4-5 years of work experience
  • Core experience in Software QA, test automation, data validation, or AI/ML application quality engineering
  • Solid conceptual understanding of LLMs, prompt engineering, RAG, OCR, tool calling, and agentic system behaviors
  • Hands-on automation scripting experience using Python or JavaScript/TypeScript
  • Working familiarity with modern CI/CD pipelines, Azure DevOps, and GitHub Enterprise
  • Business-level Japanese (or above) is mandatory for this role

Nice to have

Familiarity with testing frameworks, observability tools, or dashboarding software (e.g., pytest, Playwright, LangSmith, PromptFlow, MLflow, Power BI, Grafana)

What we offer

  • WFH flexibility
  • Global Environment
  • Competitive salary
  • 健康保険
  • 厚生年金保険
  • 雇用保険

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Sdet Ai Qa / Evaluation Engineer – Agentic Applications

8 matching positions

Software Development Engineer in Test

As a SDET focused on Agentic AI, you are a strong software engineer with deep te...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
dialpad.com Logo
Dialpad
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience as an SDET, Software Engineer, or Test Automation Engineer in SaaS environments
  • Strong programming experience in Python (preferred) and familiarity with JavaScript/TypeScript
  • Hands-on experience with Playwright (preferred) or modern UI automation frameworks
  • Solid experience testing API-first and microservices-based architectures
  • Practical understanding of AI/ML or LLM-based systems, including: Agentic AI concepts (agents, tools, planners, memory, orchestration), Deterministic vs non-deterministic testing strategies, Prompt-based systems and response evaluation
  • Experience with mocking, stubbing, and simulation to test complex integrations
  • Strong knowledge of REST APIs, server-side testing, and integration testing
  • Experience working with CI/CD pipelines, preferably GitHub Actions
  • Familiarity with Cloud technologies and containerized environments (Docker)
  • Excellent written and verbal communication skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable automation frameworks using Playwright and Python for UI, API, and end-to-end testing
  • Build automated tests for Agentic AI workflows, including multi-step reasoning, tool invocation, and autonomous decision flows
  • Validate AI-driven systems using deterministic testing approaches, mocks, simulators, and contract testing where applicable
  • Develop test strategies for LLM-based features, including prompt validation, response evaluation, guardrails, and failure modes
  • Implement API, integration, and system-level tests across microservices and AI orchestration layers
  • Collaborate with AI/ML engineers to test model integrations, inference pipelines, and agent execution frameworks
  • Set up and maintain CI/CD pipelines using GitHub Actions, enabling fast feedback and reliable releases
  • Analyze test results, derive quality KPIs, and clearly communicate risks and release readiness
  • Provide detailed root-cause and failure analysis to accelerate defect resolution
  • Participate in design and architecture reviews, advocating for testability, observability, and quality-first design
What we offer
What we offer
  • Competitive benefits and perks
  • Robust training program
  • Inclusive office environment
  • Vibrant environment to cultivate collaboration and connection
  • Exceptional culture, recognized repeatedly as a certified Great Place to Work
Read More
Arrow Right

Assistant Food and Beverage Operations Manager

Assists with supervising food and beverage/culinary daily operations. Responsibi...
Location
Location
United States , Sarasota
Salary
Salary:
25.77 - 31.73 USD / Hour
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High school diploma or GED
  • 3 years experience in the food and beverage, culinary, or related professional area. OR 2-year degree from an accredited university in Food Service Management, Hotel and Restaurant Management, Hospitality, Business Administration, or related major
  • 1 year experience in the food and beverage, culinary, or related professional area.
Job Responsibility
Job Responsibility
  • Assists in the ordering of F&B supplies, cleaning supplies and uniforms
  • Supervises daily F&B shift operation and ensures compliance with all F&B policies, standards and procedures
  • Supports and supervises an effective monthly self inspection program
  • Operates all department equipment as necessary and reports malfunction
  • Supervises staffing levels to ensure that guest service, operational needs, and financial objective are met
  • Encourages and builds mutual trust, respect, and cooperation among team members
  • Develops specific goals and plans to prioritize, organize, and accomplish your work
  • Celebrates and fosters decisions that result in successes as well as failures
  • Communicates areas that need attention to staff and follows up to ensure understanding
  • Coordinates cleaning program in all F&B areas (including General clean), identifying trends and making recommendation for improvements
What we offer
What we offer
  • Bonus Eligible
  • Fulltime
Read More
Arrow Right

Procurement and Sourcing Specialist

The Procurement and Sourcing Specialist is responsible for managing the full con...
Location
Location
United States , Spring
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Business, Supply Chain, Procurement, or a related field preferred
  • Experience in contract administration, contract management, sourcing, procurement, or supply chain operations
  • Strong understanding of contract lifecycle management processes
  • Knowledge of procurement practices, supplier management, and sourcing strategies
  • Familiarity with compliance requirements, risk assessment, and vendor documentation processes
  • Experience supporting RFP, RFQ, and bidding processes preferred
  • Excellent written and verbal communication skills
  • Strong negotiation and relationship management abilities
  • High attention to detail and strong organizational skills
  • Analytical mindset with effective problem-solving capabilities
Job Responsibility
Job Responsibility
  • Draft, review, and revise contracts, amendments, renewals, and terminations
  • Support negotiations with internal and external stakeholders
  • Manage the contract lifecycle from initiation through closeout
  • Ensure compliance with legal, regulatory, and company requirements
  • Maintain accurate contract records and documentation
  • Identify contract risks and support issue resolution
  • Track contract milestones, performance, and deadlines
  • Prepare reports on contract status and key issues
  • Identify and evaluate suppliers based on business and procurement needs
  • Support supplier vetting, onboarding, and compliance checks
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • Enroll in company 401(k) plan
  • Fulltime
Read More
Arrow Right

Specialist Cleaner

Do you have a passion for delivering excellence? Do you take pride in your work?...
Location
Location
United Kingdom , Gateshead
Salary
Salary:
12.71 GBP / Hour
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A proven track record in routine cleaning work
  • Good knowledge of cleaning materials
  • Excellent attention to detail within your role
  • Happy to carry out the physical aspects of your role
  • Great at working with others and provide support whenever you can
Job Responsibility
Job Responsibility
  • Undertake the full range of cleaning duties on a day-to-day basis as directed by Club management
  • Adhere to COSHH regulations in relation to the use of chemicals
  • Use cleaning equipment, both manual and electric, responsibly and within Health and Safety guidelines
  • Maintain a professional relationship with Customers and Colleagues
  • Ensuring you create a Safer Gambling Environment for all our Customers and Colleagues across all of our channels
  • online, in club and live
What we offer
What we offer
  • Help@Hand – a physical and mental wellbeing app for you and your family giving you fast remote access to a GP for advice and more
  • Thrive App – for your mental wellbeing approved by the NHS
  • Buzz Brights Apprenticeships
  • Buzz Brilliance Awards – Employee Recognition Scheme
  • Buzz Learning, our digital learning platform with access to 100s of online courses
  • In-house Training – Fire safety, Food safety 1 & 2, COSHH and more
  • Access to Trained Mental Health Advocates for advice on your mental wellbeing
  • 4 weeks Annual Leave plus Public Holidays (Prorated accordingly for part time Colleagues)
  • Buy Holidays Salary Sacrifice Scheme – opportunity to buy an extra week’s holiday (if eligible)
  • Staff discount 50% off bingo tickets, food & soft drinks
  • Parttime
Read More
Arrow Right

Legal Intern - Intellectual Property and Commercial Law

At Orient Express, you will join and assist the legal team comprised of 2 person...
Location
Location
France , Issy-les-Moulineaux
Salary
Salary:
Not provided
fairmont-manoir-richelieu.com Logo
Fairmont Le Manoir Richelieu
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Graduate degree in intellectual property law and/or commercial law (Master 2 / DJCE)
  • Initial internship experience of at least 6 months in a company/law firm
  • The internship must be officially recognized and approved by your educational institution
  • Excellent level of English, both spoken and written
  • Agility and autonomy
  • Intellectual curiosity
  • Sense of priorities
  • Collaborative spirit
  • Good communication skills.
Job Responsibility
Job Responsibility
  • Participation in the strategy for the protection and defense of IP assets in France and internationally, including analysis of prior art searches, instructions to correspondents, review of wording, analysis of objections from offices, review of the relevance of renewals, collection of evidence of use, etc.
  • Assisting in the management of pre-litigation and litigation matters relating to trademarks and domain names worldwide in conjunction with our consulting firms
  • Drafting, reviewing, and monitoring all types of contracts relating to intellectual property rights/personality rights
  • Supporting operational and legal teams on intellectual property issues
  • Drafting, reviewing, and monitoring various commercial contracts in French and English
  • Participation in the implementation of a tool enabling the collection of evidence of trademark use by operational staff
  • Legal research, translations.
  • Fulltime
Read More
Arrow Right
New

Material Handler (Assembly)

Are you a true pioneer who doesn't just wait around but takes immediate action? ...
Location
Location
Netherlands , Bunschoten Spakenburg
Salary
Salary:
18.46 EUR / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
July 02, 2027
Flip Icon
Requirements
Requirements
  • You are available from Monday to Friday
  • You can work in the day shift from 07:00 to 15:30
  • You are willing to work in shifts in the future
  • You speak English to understand the work instructions properly
  • You have your own transport (car, scooter or bike)
  • You have at least 1 year of experience in production or assembly work.
Job Responsibility
Job Responsibility
  • Gathering, checking, and delivering production materials on time
  • Continuously monitoring material needs and looking ahead in the planning
  • Identifying and immediately reporting quality deviations, damages, or shortages
  • Replenishing consumables and operationally supporting the team
  • Actively contributing to an orderly and clean working environment via the 5S methodology.
What we offer
What we offer
  • Gross starting salary of € 18.46 per hour
  • Fixed working hours in the pleasant day shift
  • Travel allowance of € 0.23 per kilometer
  • A proper and reliable pension scheme
  • Full-time job from Monday to Friday
  • Opportunities to grow into technical positions
  • Fulltime
Read More
Arrow Right

Accounting Specialist

We are seeking a detail-oriented Accounting Specialist to support day-to-day acc...
Location
Location
United States , Spring
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2–5+ years of experience in AP, AR, or general accounting
  • Experience in a manufacturing environment preferred
  • Hands-on experience with NetSuite required or strongly preferred
  • Strong understanding of cash applications and reconciliation processes
  • High attention to detail and strong organizational skills
  • Ability to manage multiple priorities in a deadline-driven environment
  • Strong communication skills and ability to work cross-functionally
Job Responsibility
Job Responsibility
  • Manage full-cycle Accounts Payable including invoice processing, 3-way matching, coding, and payment execution
  • Oversee Accounts Receivable including invoicing, collections, and customer account maintenance
  • Handle cash applications, including posting daily cash receipts, wire/ACH transactions, and resolving discrepancies
  • Perform account reconciliations for AP, AR, and cash accounts
  • Partner with operations and supply chain teams to resolve invoice and billing issues
  • Monitor aging reports and proactively follow up on outstanding balances
  • Support month-end close activities, including journal entries and reporting
  • Maintain accurate records within NetSuite and ensure data integrity
  • Identify opportunities to improve processes and drive efficiencies across AP/AR workflows
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Residential Counsellor

Join Our Team as a Residential Counsellor! Are you passionate about making a rea...
Location
Location
United Kingdom , Stroud
Salary
Salary:
28000.00 GBP / Year
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Level 4 or above approved counselling qualification
  • Experience working with individuals affected by substance misuse issues
  • Excellent verbal and written communication skills
  • Strong organisational skills and attention to detail
  • Ability to build and maintain effective working relationships
  • Membership of the professional body Addiction Professionals and BACP
Job Responsibility
Job Responsibility
  • Provide comprehensive trauma-informed one-to-one counselling, facilitate dynamic group therapy sessions, and lead psychoeducational workshops
  • Collaborate with the clinical team to ensure successful treatment outcomes
  • Utilise recognised theoretical frameworks such as Motivational Interviewing, Cognitive Behavioural Approaches, and Trauma-Informed Approaches
  • Liaise with clients' families and support networks
  • Undertake clinical assessments and co-create therapeutic care plans
  • Ensure safeguarding concerns are raised appropriately
  • Participate in reflective practice sessions, team meetings, and clinical supervision
What we offer
What we offer
  • Supportive and collaborative work environment
  • Opportunities for professional development and training
  • Chance to make a real impact in the lives of our clients
  • 33 days holiday including statutory public holidays
  • Auto enrolment pension (6% employer contribution)
  • Fulltime
Read More
Arrow Right