CrawlJobs Logo

Senior Quality Assurance / SDET Engineer, GenAI/AI Platform

logicmonitor.com Logo

LogicMonitor

Location Icon

Location:
India , Pune

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

LogicMonitor is looking for a highly skilled Senior QA/SDET with 4 to 5 years of experience to build and scale automated test frameworks for Generative AI features across our observability platform. In this role, you will ensure the quality, reliability, safety, and performance of LLM-based workflows, including AI assistants, Retrieval-Augmented Generation (RAG) pipelines, AI-generated incident summaries, auto-remediation agents, tool calling, and AI-driven insights. You will work closely with engineering, product, and applied AI teams to validate AI experiences in production.

Job Responsibility:

  • Test Strategy for GenAI Features: Define end-to-end test strategies for GenAI-driven product features
  • Establish quality standards for AI output
  • Automation Framework & End-to-End Testing: Build scalable automation test frameworks for API and UI experiences
  • Automate validation of AI endpoints, workflows, and behaviors
  • Develop regression test packs
  • AI Evaluation (LLM Testing): Create and maintain LLM evaluation test suites
  • Build automated pipelines for drift testing and regression testing
  • Reliability, Performance & Scale Testing: Design and implement performance and load tests for AI systems
  • Ensure AI systems meet SLOs and performance targets
  • Safety, Security & Compliance Testing: Validate AI system robustness against attacks and risks
  • Build guardrail validation tests
  • Observability & Debuggability for AI Testing: Collaborate with engineering teams to enhance AI observability
  • Use monitoring and telemetry to detect regressions

Requirements:

  • 4 to 5 years of experience as an SDET / QA Automation Engineer
  • Strong programming skills in Python or Java
  • Strong hands-on automation experience with: API testing frameworks (PyTest, Requests, RestAssured, etc.), UI testing frameworks (Playwright / Cypress / Selenium), CI/CD automation (GitHub Actions / Jenkins)
  • Strong understanding of: Microservices and distributed systems testing, Asynchronous workflows and queues, Cloud-native architecture and reliability testing
  • Proven ability to build test strategies for: Functional, regression, integration, contract, and performance testing
  • Experience testing LLM-based systems, such as: AI assistants (multi-turn chat), RAG pipelines, Agentic workflows (tool calling, orchestration)
  • Strong understanding of common GenAI failure patterns: Hallucinations, Prompt injection, Retrieval failures, Toxicity and unsafe responses
  • Ability to create evaluation datasets and rubrics for AI correctness

Additional Information:

Job Posted:
February 14, 2026

Icon
LogicMonitor - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Quality Assurance / SDET Engineer, GenAI/AI Platform

New

Administrative Coordinator

We are looking for an Administrative Coordinator to work for a National transpor...
Location
Location
Canada , Winnipeg
Salary
Salary:
18.00 CAD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
April 08, 2026
Flip Icon
Requirements
Requirements
  • 1-2 years of experience in a customer service or administration position
  • Good English communication skills, both written and verbal
  • Computer skills – MS products and to ability to learn new software's with ease
  • Demonstrated customer relationship skills
  • Strong conflict resolution skills and to ability to work in fast paced environments
Job Responsibility
Job Responsibility
  • Receive Drivers at the window
  • Assist drivers with preliminary paperwork information such a bill of lading, trip envelopes and border crossing procedures
  • Greet and verify Drivers documents during picks up
  • Track and update system information on shipments for agent delivery
  • Audit rates to ensure billing is accurately invoiced
  • Extract various report and validate information for accuracy
What we offer
What we offer
  • Weekly pay
  • 3 days off
  • Beautiful dynamic working environment
  • Diversity of tasks
  • Fulltime
Read More
Arrow Right
New

Bilingual hybrid claims examiner

Are you passionate about helping others and looking for an exciting career oppor...
Location
Location
Canada , Winnipeg
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
April 09, 2026
Flip Icon
Requirements
Requirements
  • Fluency in both French and English (written and spoken) is essential
  • Strong analytical skills with the ability to make clear, accurate decisions
  • Attention to detail and the ability to handle high volumes of work with accuracy
  • Excellent communication skills – both written and verbal
  • Strong organizational skills and the ability to work independently and as part of a team
  • Customer service-oriented with a focus on providing the best support possible
  • A reliable and dependable team member with good attendance
Job Responsibility
Job Responsibility
  • Review, investigate, and adjudicate Canadian Health and Dental claims according to Group policy contracts
  • Communicate with health and dental service providers to gather missing claims information
  • Make accurate payment decisions based on adjudication guidelines
  • Live by our core values: Customer View, Integrity, Partnership, and Community
What we offer
What we offer
  • Hybrid work model – start with in-office training for 12 weeks in Winnipeg, then enjoy a flexible work-from-home arrangement: 2 days in the office, 3 days from home!
  • Employee recognition program that celebrates exceptional performance
  • Opportunities for career growth – initial contract with a strong potential to become a permanent team member!
  • Work-life balance with no weekend shifts!
  • Fulltime
Read More
Arrow Right
New

Ar accountant/senior (us working hours)

Do you have simiar professional experience (in AR/OtC area) and communicate Engl...
Location
Location
Poland , Poznań
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
March 30, 2026
Flip Icon
Requirements
Requirements
  • min. 1-3 years of experience from a similar job position (in AR/OtC area)
  • experience in using ERP systems (e.g. JDE or SAP) or other financial systems
  • speak and write English fluently (min. B2/C1 level)
  • demonstrable Advanced Excel skills including pivot tables, VLOOKUP, graphs/tables, filters and sorting
  • strong analytical ability
  • readiness to work between 14:00-22:00
Job Responsibility
Job Responsibility
  • ensure proper account management and handling of creditors in close collaboration with your colleagues
  • provide accounting services for the company and maintain its financial records in compliance with local laws and corporate requirements
  • ensure that all invoices are booked
  • ensure follow-up on outstanding payments from customers
  • book records for credit cards
  • make timely payments to customers, including payment runs and statements
  • treat and check invoices and credit from suppliers
  • provide customer service to our customers and answer queries per email and telephone
  • service business areas' internal customers generally
  • prepare clearing account to HQ
What we offer
What we offer
  • attractive salary that matches your skills and experience
  • contract of employment
  • a comprehensive benefits package including health insurance, lunch card, annual bonus, group insurance and more
  • continuous learning and development opportunities, including training programs and workshops
  • work between 14:00-22:00 for US market
  • a hybrid model of work in the modern office in the center of Poznań (only few hours per week to know the team better)
  • Fulltime
Read More
Arrow Right
New

Gl/rtr team leader

Are you looking for a new job? Do you enjoy working as a team player in an inter...
Location
Location
Poland , Poznań
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
March 11, 2026
Flip Icon
Requirements
Requirements
  • University graduate with a few years of work experience in the Accounting/Finance area
  • Professional experience in a similar job position
  • Very good English (min. B2 level)
  • Broad understanding of Finance processes
  • Computer literacy and experience in MS Office applications
  • Pragmatic & logical thinker with an eye for detail and an analytical mind
  • Excellent communication skills and you feel comfortable challenging and interact with all parts of the organization
  • See problem-solving as an opportunity for development and you have been acknowledged for your out-of-the-box thinking
  • As a team player enjoy working in an open-minded environment where you together with others focus on solutions rather than problems
  • You are confident in leading employees and inspiring them to grow and develop the business
Job Responsibility
Job Responsibility
  • Accountable for the legal reporting for one or several legal entities served by the sub-region
  • Ensure compliance from a legal and corporate governance perspective
  • Responsible for coordinating the external audit of the legal entities
  • Coordinating month-end closing and reporting
  • Drive the performance of one or several legal entities and responsible that these fulfills all the regulatory and internal requirement relative
  • Close cooperation with Finance Manager of the legal entity
  • Manage and motivate Record to Report team
  • Drive standardization and continuous improvement
What we offer
What we offer
  • Very attractive salary with a package of benefits and an annual bonus
  • A chance to be a part of a diverse workforce where you get to face exciting challenges and varied tasks
  • Fulltime
Read More
Arrow Right
New

VAT Senior Accountant

Our client - Finance Shared Service Center organization supports all units globa...
Location
Location
Poland , Poznań
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
March 13, 2026
Flip Icon
Requirements
Requirements
  • Years of working experience as a TAX/VAT Specialist, Chief Accountant/Senior Accountant in an international company or accounting firm dealing with corporate taxes
  • Professional interest in taxes, deep, practical knowledge in the scope of the expected tasks, good knowledge/experience in accounting allowing to prepare the reconciliations, extract data for tax reporting
  • Good working knowledge of MS Office Programs (Excel and Outlook)
  • Language skills: Polish - fluent, English very good in speaking and writing (min. B2 level)
  • Strong organizational, analytical, and multi-tasking skills
  • Close attention to detail
  • Keen to show initiative and eager to learn
  • Good oral and written communication skills
Job Responsibility
Job Responsibility
  • Responsibility for tax reporting
  • Following and updating tax-related policies and guidelines
  • Supporting responsible departments and any local business stakeholders in any tax-related issues
  • Design of internal controls referring to tax risks (i.a. split payment, VAT codes on the posted documents, date of tax obligation, etc.)
  • Cooperation with Accounting departments (P2P, O2C, R2R) referring to tax obligation to optimize the process and minimize the risks of errors
  • Cooperation with tax controllers/specialists from other countries and tax advisors (local and international)
  • Supporting the annual statutory audit processes
  • Answering inquiries from tax authorities, handling tax controls
  • Monitoring of changes in tax law, tax interpretations, rulings published by the Ministry of Finance
  • Finding and developing the common tax solutions within companies in the Central EMEA region to initiate efficiency and pooling work/resources attitude allowing to develop of the tax practice within the Central EMEA Finance Operations Centre
What we offer
What we offer
  • A job in an international environment, SSC (a historical Swedish company with a lot of opportunities in the future)
  • Very attractive salary
  • A hybrid model of work (2/3 days in the office per week)
  • A chance to be a part of a diverse workforce where you get to face exciting challenges and varied tasks
  • Fulltime
Read More
Arrow Right
New

Chief Accountant

Are you looking for a new job? Do you enjoy working as a team player in an inter...
Location
Location
Poland , Poznań
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
March 16, 2026
Flip Icon
Requirements
Requirements
  • Master’s degree in Finance and Accounting or Economic background
  • minimum 5 years of experience in Finance or accounting
  • extensive accounting knowledge and understanding of end-to-end processes
  • very good English (min. B2 level)
  • excellent communication and organizational skills
Job Responsibility
Job Responsibility
  • Ensure compliance from a legal and corporate governance perspective
  • responsible for coordinating the external audit of the legal entities
  • coordinating month-end/year-end closing and reporting
  • close cooperation with Finance Manager of the legal entity
  • drive standardization and continuous improvement
  • responsible for area of internal controls
  • responsible for group reporting (IFRS, central bank, Statistical reporting, taxes excluded)
  • participation in projects driven by Group or implemented due to legal requirements
What we offer
What we offer
  • Very attractive salary with a package of benefits and an annual bonus
  • Fulltime
Read More
Arrow Right
New

Management controller

Join a rapidly growing international company and take on a key role in its succe...
Location
Location
Canada , Montreal
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
April 09, 2026
Flip Icon
Requirements
Requirements
  • Degree in accounting, finance, or a related field (CPA is a plus)
  • 8 to 10 years of relevant accounting experience
  • Experience in a multinational environment or a high-growth company is a considerable asset
  • Experience managing a team of professionals
  • Proficiency with ERP systems (SAP, Oracle, D365, or equivalent) and reporting/BI tools
  • Excellent analytical skills, strong attention to detail, and thoroughness
  • Ability to work in a complex environment and manage multiple priorities
  • Good communication skills and ability to collaborate with various financial and accounting teams
Job Responsibility
Job Responsibility
  • Prepare, monitor, and analyze annual and multi-year budgets, forecasts, and financial plans
  • Oversee the preparation of monthly, quarterly, and annual closings according to IFRS standards
  • Participate in the preparation of consolidated financial statements and in communications with external auditors
  • Ensure the standardization of policies, controls, and reporting across all entities
  • Implement and monitor financial and operational performance indicators
  • Collaborate with operational teams to optimize profitability and cost control
  • Participate in financial modeling and scenario analysis to support decision-making
  • Participate in the implementation, optimization, and automation of financial tools (ERP, BI reporting, dashboards)
  • Work in coordination with international finance teams and operational management
  • Recruit and lead accounting and FP&A resources as the company grows
What we offer
What we offer
  • Competitive salary with performance-based bonus
  • Comprehensive group insurance and employer-contributed retirement plan
  • Flexible hours and option for partial remote work
  • Professional development and access to ongoing training
  • Competitive vacation and leave
  • Dynamic and collaborative work environment with real opportunities for international advancement
  • Participation in strategic and innovative projects that have a direct impact on the company
  • Employee recognition program and initiatives promoting workplace well-being
  • Fulltime
Read More
Arrow Right
New

Senior Accountant

Are you a Senior Accountant who wants to look beyond the spreadsheet and underst...
Location
Location
Canada , Mississauga
Salary
Salary:
85000.00 - 95000.00 CAD / Year
https://www.randstad.com Logo
Randstad
Expiration Date
April 08, 2026
Flip Icon
Requirements
Requirements
  • 3-7 years of accounting experience (Manufacturing or Inventory-heavy industries are a must)
  • Strong understanding of Cost Accounting (Standard costing, BOMs, variances)
  • Proficiency in Excel (Pivot tables, VLOOKUPs) and ERP systems (Microsoft Business Central is a massive plus)
  • CPA designation (or currently in progress)
  • A personality that thrives on collaboration—you aren't afraid to ask 'why' to the operations team
Job Responsibility
Job Responsibility
  • Own the G/L: Manage the day-to-day accounting cycle, including month-end close, GL accuracy, and balance sheet reconciliations
  • Analyze the Costs: Dive deep into standard costing, labor, overhead, and production variances to help the business understand where money is being made (or lost)
  • Manage Inventory: Lead inventory reconciliation and valuation, ensuring the numbers match the physical reality of the warehouse ...
  • Drive Decisions: Partner with the Operations and Supply Chain teams to provide gross margin analysis by product and channel
  • Improve Systems: act as a key user for the ERP system (Business Central) and champion process improvements
What we offer
What we offer
  • Competitive base salary
  • Annual bonus
  • Health and Dental program
  • Support for CPA annual dues
  • Free parking, on-site
  • Employee discount
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy