CrawlJobs Logo

QA Engineer, Automation and Evals

aciinfotech.com Logo

ACI Infotech

Location Icon

Location:

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

The QA Engineer, Automation and Evals will design, implement, and maintain automated test suites across APIs, UIs, and workflows to ensure product reliability and faster release cycles. This role involves building evaluation pipelines for AI and RAG systems, integrating tests into CI/CD pipelines, and driving higher test coverage in multi-tenant environments. The ideal candidate will combine strong technical testing skills with the ability to communicate risks and quality tradeoffs effectively.

Job Responsibility:

  • Design and maintain automated test suites across services and UI
  • Build evaluation pipelines for ML and RAG systems
  • Integrate quality gates into CI pipelines and monitor flake rate
  • Create and manage test data strategies for multi-tenant environments
  • Drive high automation coverage on APIs and UI
  • Reduce regression rates and improve release confidence

Requirements:

  • 3+ years of QA automation experience in SaaS environments
  • Strong skills with testing frameworks such as Playwright, Cypress, or PyTest
  • Familiarity with CI/CD test integration
  • Proven ability to design test strategies for APIs, UIs, and workflows
  • Experience building reliable test harnesses and CI integrations
  • Strong communication skills for articulating risk and quality tradeoffs
  • Ability to analyze logs and traces to triage failures quickly

Nice to have:

  • Knowledge of evals for AI and LLM applications
  • Experience in security or load testing
  • Background in regression testing for RAG pipelines
  • Test data management in multi-tenant environments

Additional Information:

Job Posted:
December 14, 2025

Employment Type:
Fulltime
Work Type:
Remote work
Icon
ACI Infotech - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for QA Engineer, Automation and Evals

New

Sales Associate

Build a high-impact career in medical device sales with a clear path to growth. ...
Location
Location
United States , Minneapolis
Salary
Salary:
60000.00 - 62000.00 USD / Year
karlstorz.com Logo
KARL STORZ
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 2 years of sales experience, preferably in the medical device industry, or 2 years as a KARL STORZ Onsite Specialist
  • Bachelor’s degree or equivalent work experience
  • Ability to travel to customer sites approximately 90% of the time
  • Ability to meet and maintain hospital credentialing requirements
  • Proficiency in Microsoft Office
  • Working knowledge of hospital environments, including the Operating Room, Bio-Med, and Central Processing
  • Demonstrated professionalism and adherence to hospital and company protocols
  • Ability to lift up to 35 lbs. of equipment
  • Valid driver’s license required
Job Responsibility
Job Responsibility
  • Contribute to achieving annual sales quotas within the assigned territory
  • Conduct product demonstrations, trials, and evaluations for capital equipment
  • Provide case coverage in support of existing products and upcoming trials
  • Participate in or lead capital equipment installations and related in-servicing
  • Support and lead trials and ongoing case coverage for single-use product initiatives
  • Present and differentiate product features, benefits, and clinical applications in compliance with product labeling
  • Establish and maintain compliant, professional relationships with physicians, nurses, sterile processing, materials management, and administrative personnel
  • Conduct comprehensive customer visits across departments, including addressing service and repair needs
  • Prepare sales quotes and service agreements
  • Support company-sponsored promotional initiatives
What we offer
What we offer
  • Medical / Dental / Vision including a state-of-the-art wellness program and pet insurance
  • 3 weeks vacation, 11 holidays plus paid sick time
  • Up to 8 weeks of 100% paid company parental leave
  • 401(k) retirement savings plan providing a match of 60% of the employee’s first 6% contribution
  • Section 125 Flexible Spending Accounts
  • Life, STD, LTD & LTC Insurance
  • Tuition pre-imbursement up to $5,250 per year
  • Fitness reimbursement of up to $200 annually
  • Fulltime
Read More
Arrow Right
New

Kitchen Assistant / Driver

We are looking for an enthusiastic, hardworking kitchen assistant / driver to jo...
Location
Location
United Kingdom , Bishop's Castle
Salary
Salary:
12.85 GBP / Hour
shropshire.gov.uk Logo
Shropshire Council
Expiration Date
February 15, 2026
Flip Icon
Requirements
Requirements
  • Full driving licence
  • Use of a car
  • Business use car insurance
Job Responsibility
Job Responsibility
  • Driving
  • Loading and food delivery
  • Food preparation
  • Dining room service
  • General kitchen housekeeping
What we offer
What we offer
  • 45p per mile in remuneration for costs associated with travel
  • Parttime
Read More
Arrow Right
New

Housekeeper

In the role of Housekeeper, you will be responsible for maintaining the Communit...
Location
Location
United States , Lenexa
Salary
Salary:
16.50 - 19.80 USD / Hour
atriaseniorliving.com Logo
Atria Senior Living
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Basic reading, writing, and mathematical skills
  • Communicate effectively in English with employees and residents
  • General knowledge of sanitation and safe food handling practices
  • Ability to retain orders (up to four at one time)
  • Strong organization and time management skills
  • Basic computer skills
Job Responsibility
Job Responsibility
  • Maintain the Community interior, including residents’ apartments, in a clean and sanitary fashion
  • Provide general housekeeping for both the Community as a whole and individual resident apartments (vacuuming, dusting, cleaning main entryway, common areas, dining room, hallways, patios, and resident apartments)
  • Clean and defrost refrigerators (as needed)
  • Clean and check heat system filters
  • Change the bed and linens
  • Ensure adequate linen supplies in each apartment
  • Turn mattress (with assistance) as necessary
  • Empty waste baskets
  • Provide deep cleaning of apartments as needed
  • Pay special attention to the main entry area (carpets, plants, pictures, railings, windows, and light fixtures)
What we offer
What we offer
  • Competitive Pay
  • Paid Holidays & PTO
  • Comprehensive Health Plans (medical, vision, dental, company paid short term and long term disability, voluntary benefits such as critical illness coverage)
  • Career Advancement Opportunities
  • Tuition Reimbursement (up to $5,250 a year)
  • Employee Loyalty Rewards Program
  • Retirement Savings Plan with Employer Match (50% match after one year of service)
  • Rewards & Recognition
  • Health & Safety
  • Fulltime
Read More
Arrow Right
New

Attorney

We are looking for a skilled (min 3 years) Attorney with a strong background in ...
Location
Location
United States , St. Petersburg
Salary
Salary:
100000.00 - 175000.00 USD / Year
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Must hold a valid license to practice law in the state of Florida
  • Minimum of three years of experience in defense litigation and insurance defense
  • Proficient knowledge of Florida Bar regulations and federal rules of civil procedure
  • Demonstrated ability to draft motions, briefs, and other legal documents with precision
  • Strong skills in managing discovery processes and handling evidence
  • Excellent verbal and written communication abilities
  • Proven track record of successfully representing clients in litigation
  • Ability to work on-site initially, with potential for flexibility after probationary period
Job Responsibility
Job Responsibility
  • Represent clients in defense litigation cases, including insurance-related matters
  • Prepare and draft legal motions, briefs, and other essential court documents
  • Conduct thorough legal research to support case strategies and arguments
  • Manage the discovery process, including collecting and reviewing evidence
  • Ensure compliance with Florida Bar regulations and federal civil procedure requirements
  • Collaborate with colleagues and clients to develop legal strategies tailored to specific cases
  • Attend court hearings, mediations, and depositions as required
  • Provide legal counsel and guidance to clients regarding case developments
  • Maintain detailed records and documentation for all case proceedings
  • Stay updated on changes to state and federal legal regulations relevant to practice areas
What we offer
What we offer
  • bonus
  • medical, vision, dental, and life and disability insurance
  • company 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Kitchen Utility Worker

In the role of Kitchen Utility Worker you will help serve meals and clear/wash d...
Location
Location
United States , Hilton Head
Salary
Salary:
17.00 - 20.40 USD / Hour
atriaseniorliving.com Logo
Atria Senior Living
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High School education or equivalent
  • General knowledge of cleaning and sanitation
  • General knowledge of safe food-handling practices
  • Effective communication skills in English
  • Ability and willing to follow standards and procedures, and accept direction & training and work as part of a team
Job Responsibility
Job Responsibility
  • Help serve meals and clear/wash dishes from residents’ tables following Holiday procedures
  • Prepare, wash and store dishes following Holiday procedures
  • Clean the dishwashing area, food-serving areas and equipment, dining room tables and chairs and vacuum and clean the dining room area
  • Complete dishwasher temperature log at required times
  • Assist in the setup of serving carts for each meal
  • Prepare water carafes and distribute to each table
  • Serve hot cereal at breakfast and bread at dinner
  • Help serve meals to residents tables
  • Deliver trays to residents’ rooms when necessary
  • Assist with food preparation as assigned
What we offer
What we offer
  • Competitive Pay
  • Paid Holidays & PTO
  • Comprehensive Health Plans (medical, vision, dental, company paid short term and long term disability, voluntary benefits such as critical illness coverage)
  • Career Advancement Opportunities
  • Tuition Reimbursement (up to $5,250 a year)
  • Employee Loyalty Rewards Program
  • Retirement Savings Plan with Employer Match (50% match after one year of service)
  • Rewards & Recognition
  • Health & Safety
  • Fulltime
Read More
Arrow Right
New

Senior Software Engineer

The Microsoft 365 Copilot Mobile team in India is looking for a passionate and t...
Location
Location
India , Noida
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 7+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Deep knowledge of Android platforms
  • Proven skill in postmortem debugging, performance analysis, and experimentation
  • Excellent interpersonal, verbal, and written communication skills
  • BS or MS in Computer Science or equivalent
  • Frameworks & SDK: Strong experience with Android SDK, Jetpack libraries (ViewModel, LiveData, Room, Navigation)
  • Performance Optimization: Understanding of memory management, battery optimization, and network efficiency
  • experience with profiling tools like Android Profiler
  • Testing: Familiarity with JUnit, Mockito for unit testing and Espresso for UI testing
  • Deployment: Knowledge of Google Play Store publishing, app signing, and release management
Job Responsibility
Job Responsibility
  • Lead feature areas: Design, implement, and lead a feature area with a team of 2–5 engineers
  • Engineer features with strong attention to performance, robustness, and resource efficiency
  • Work independently and collaboratively across global product teams to deliver end-to-end solutions
  • Design and implement end-to-end search experiences in the Copilot app, spanning query formulations with various treatments, ranking, and UX
  • Build high-performance, scalable search components optimized for mobile platforms
  • Collaborate across disciplines—partner with PMs, designers, and AI experts to deliver context-aware, personalized search
  • Be data-driven — leverage telemetry and experimentation to maintain high product quality and reach
  • Drive coherence across Android and iOS platforms, ensuring consistent design and experience
  • Champion engineering excellence — conduct postmortem debugging, performance analysis, and share best practices
What we offer
What we offer
  • Impact at Scale: Shape experiences for millions of users globally
  • Lead & Influence: Drive technical direction and mentor engineers while working on cutting-edge AI and mobile technologies
  • Cross-Platform Innovation: Build coherent experiences across Android and iOS
  • Inclusive Culture: Collaborate with world-class teams in an environment that values innovation, diversity, and growth
  • Fulltime
Read More
Arrow Right
New

Cafe Manager

Cafe Managers are central to the success of Blank Street and take full ownership...
Location
Location
United States , Boston
Salary
Salary:
Not provided
blankstreet.com Logo
Blank Street
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience managing and leading single-store unit operations in high growth hospitality or consumer brands
  • Full Time availability: 45 hours per week, 5 days of availability required and must be available to work 2 peak days (usually weekend days, weekend as described as Friday, Saturday, Sunday)
  • Experience hiring, developing and managing hospitality teams
  • Experience managing inventory and supply chain ordering
  • Love for coffee and customer service
  • Strong knowledge of specialty coffee, espresso and equipment is a must
  • Strong decision making and multi-taking skills
  • Strong interpersonal communication skills
Job Responsibility
Job Responsibility
  • Create a motivating and engaging team culture by consistently celebrating, training, coaching, and mentoring your team
  • Step in to cover scheduling gaps or time off in the store schedule
  • Create and publish staff schedules according to state and local labor laws
  • Review and approve timecards and paid time off requests in a timely manner ensuring your team is paid accurately and on time
  • Recruit super star talent in collaboration with the People Team
  • Oversee and validate the quality of training being executed by your Shift Leads, providing feedback and coaching where needed
  • Ensure coffee accreditations are handled on time for new employees in line with company standards
  • Work to maintain the very best team engagement scores
  • Maintain food and beverage quality standards across your store and ensure recipes are executed accurately and consistently by your team
  • Own all ordering, vendor relations, waste management, inventory counts and general compliance of our Inventory Management System
What we offer
What we offer
  • Bonus program
  • 15 days of paid annual leave (on top of company-observed holidays and sick time)
  • Three health plan options, with full coverage available for two employee-only tiers
  • Commuter benefits
  • Parental leave
  • Bereavement leave
  • Exclusive access to our coveted Regulars program – yes, that means free coffee, matcha and more! ☕️
  • Regular social outings with the team
  • Free Blank Street swag
  • Fulltime
Read More
Arrow Right
New

Account Manager

KARL STORZ Veterinary Endoscopy America (KSVEA) is seeking a driven, customer-fo...
Location
Location
United States , Seattle
Salary
Salary:
Not provided
karlstorz.com Logo
KARL STORZ
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in a scientific or business-related field
  • 4–5 years of successful direct sales experience, preferably in a medical or operating room environment or selling capital equipment
  • Proven, verifiable sales performance (history of meeting or exceeding quota)
  • Ability to lift up to 40 lbs
  • Flexibility to travel 50–80%, including some weekends
  • Valid driver’s license
Job Responsibility
Job Responsibility
  • Successfully complete comprehensive in-house and field training programs
  • Build and continuously improve selling skills, product knowledge, and territory management capabilities
  • Execute effective territory management strategies to drive sales growth, develop new leads, maintain and expand existing accounts, and increase overall market share
  • Serve as a trusted consultant to customers, including conducting product demonstrations, preparing quotations, and performing on-site equipment in-servicing after delivery
  • Collaborate effectively with Account Managers, Associate Account Managers, Sales & Marketing leadership, and back-office teams
  • Maintain accurate and up-to-date customer and territory records in Salesforce (CRM)
  • Track competitive activity and communicate insights to Sales and Marketing leadership
  • Manage territory expenses and inventory responsibly, including all related documentation
  • Complete all administrative reports accurately and on time
  • Attend required training courses, meetings, trade shows, and company events
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy