QA LLM Engineer Job at Talentica

Middle QA Automation Engineer

We are seeking a motivated QA Automation Engineer to join our team and contribut...

Location

Salary:

Not provided

Mad Devs

Expiration Date

Until further notice

Requirements

2+ years of hands-on manual testing experience
2+ years of proven experience as a QA engineer with strong skills in Python-based test automation
Proficient in testing web applications and AI-powered platforms on both real devices and emulators
Familiar with CI/CD workflows, monitoring tools, and version control systems such as Git
Comfortable working in fast-paced, distributed startup environments, demonstrating the ability to work independently without micromanagement
Clear and effective communicator, capable of collaborating across teams and time zones while maintaining thorough documentation
Language skills: English proficiency at B2-C1 level and Russian at B2 level

Job Responsibility

Test AI/LLM-based client-server applications, focusing on functionality, performance, and reliability
Develop and maintain automated test scripts in Python
perform manual testing when necessary
Utilize QA tools such as Playwright, Selenium, Postman, and TestRail to ensure thorough testing coverage
Guarantee quality across infrastructure components, CI/CD pipelines, and integrations
Prepare and update detailed test documentation, test scenarios, and defect reports
Collaborate closely with developers, DevOps engineers, and product managers to align priorities and deliver high-quality software releases

What we offer

Flexible working hours
Remote-first culture
Long-term projects
Salary in dollars
Professional communities
Onsite business trips
Training budget
Paid conferences

Senior AI Software Developer

The Senior AI Engineer owns end-to-end delivery of AI features—from design to pr...

Location

Salary:

Not provided

Hewlett Packard Enterprise

Expiration Date

Until further notice

Requirements

Bachelor's or master’s degree in computer science, engineering, data science, machine learning, artificial intelligence, or closely related quantitative discipline
Typically, 7-10 years’ experience
LLMs & Agents: Prompt engineering, function/tool calling, orchestration frameworks, RAG
ML/DS: Evaluation metrics (precision/recall, BLEU/ROUGE where relevant), error analysis
Data/RAG: Embeddings, similarity (cosine/IP), chunking, rerankers, vector DB operations
Backend: Python (FastAPI/Flask), microservices patterns
MLOps/Infra: Docker, Kubernetes, CI/CD, artifact management, GPU scheduling
Observability: Metrics/logging/tracing, dashboards, automated evaluation pipelines
Frameworks: PyTorch/TensorFlow, Hugging Face, LangChain/LlamaIndex
Data: Pandas, SQL/NoSQL, Parquet/Arrow, Kafka/queues

Job Responsibility

Translate high-level designs into clear component contracts, APIs, and service boundaries
Implement LLM integrations, RAG pipelines, agents, tool/function calling, and prompt strategies
Own feature delivery for sprints/releases
maintain high code quality and documentation
Fine-tune models when needed
design evaluation harnesses and metrics
Build A/B testing setups
track accuracy, latency, robustness, and task success rates
Conduct error analysis
iterate using feedback efficacy loops and prompt refinement

What we offer

Health & Wellbeing
Personal & Professional Development
Unconditional Inclusion

New

Senior QA Engineer with AI experience

N-iX is looking for a Senior QA Engineer with AI experience to join our team. We...

Location

Ukraine

Salary:

Not provided

N-iX

Expiration Date

Until further notice

Requirements

4+ years of experience in manual QA, with exposure to frontend, backend and AI testing
Solid experience with API testing using tools such as Postman, REST Client, or similar
Experience testing web UIs and understanding of cross-browser/cross-environment considerations
Ability to read and interpret API documentation, data schemas, and system architecture descriptions
Hands-on experience working on projects that included AI, ML, or NLP components — particularly validating outputs that are probabilistic or context-dependent
Familiarity with the concept of RAG (Retrieval-Augmented Generation) or LLM-based systems
Strong analytical thinking — especially the ability to assess whether an AI response is contextually correct, not just technically non-null
Good understanding of test documentation practices: test plans, test cases, bug reports, traceability
English level at least Upper-Intermediate

Job Responsibility

Follow a phased QA approach — begin with CMS and backend testing to establish a reliable baseline of expected system behavior, then apply those insights to validate AI agent outputs effectively
Design and execute test cases for REST APIs, covering functional correctness, edge cases, error handling, authentication, and data integrity
Perform UI testing across core user journeys, validating layout, behavior, and integration with backend services
Transition into AI output validation once the deterministic layers are stable — using your knowledge of business rules to identify inconsistencies, hallucinations, or degraded outputs in agent responses
Document and maintain test cases, test plans, and bug reports in a structured and traceable way
Participate in requirement reviews and technical discussions to identify testability gaps early
Collaborate with the Lead Big Data/AI Engineer and AI team to understand RAG pipeline behavior, document ingestion flows, and output quality expectations
Contribute to building reusable test assets and QA processes as the project scales

What we offer

Flexible working format - remote, office-based or flexible
A competitive salary and good compensation package
Personalized career growth
Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
Active tech communities with regular knowledge sharing
Education reimbursement
Memorable anniversary presents
Corporate events and team buildings
Other location-specific benefits

Prompt Engineer

Fullpath is a growing tech company in the automotive space with hubs across the ...

Location

Israel , Tel Aviv

Salary:

Not provided

Fullpath

Expiration Date

Until further notice

Requirements

Native level verbal and written English with excellent communication, presentation, and interpersonal skills
2+ years professional experience in product or R&D department
Strong product sense and empathy towards users, customers and their needs
Creative problem solver with a sense for business needs, while having some technical aptitude
Growth mindset
Strong analytical and troubleshooting skills with attention to detail

Job Responsibility

Design, prototype and iterate AI agents and LLM workflows from ideation to execution
Monitor live systems (dashboards, A/B tests, validation pipelines), triage issues, and implement fixes for hallucinations and regressions
Utilize prompt and Gen-AI engineering techniques and tools such as RAG, MCPs, prompt chaining, few-shot prompting
QA and evaluate end user-facing AI output
Collaborate with stakeholders across product, marketing, CX, and R&D teams
Generate and QA background and conversational agents

What we offer

Family-friendly environment and flexible working hours
An awesome global team of forward-thinking, innovative go-getters
Integrate with tech titans: work directly with APIs from Google, Facebook, Microsoft, and more
Be part of a rapidly scaling company poised for the future
Learning and growth opportunities within a fast-paced tech startup environment
Clear career advancement path for strong performers
We are committed to setting each other up for success. As a member of our team, you will work in an environment that encourages growth, initiative taking, and continuous mutual feedback in order to reach your full potential
Cibus and lots of yummy treats

Fulltime

Prompt Engineer

Fullpath is a growing tech company in the automotive space with hubs across the ...

Location

Israel , Tel Aviv

Salary:

Not provided

Fullpath

Expiration Date

Until further notice

Requirements

Native level verbal and written English with excellent communication, presentation, and interpersonal skills
2+ years professional experience in product or R&D department
Strong product sense and empathy towards users, customers and their needs
Creative problem solver with a sense for business needs, while having some technical aptitude
Growth mindset
Strong analytical and troubleshooting skills with attention to detail

Job Responsibility

Design, prototype and iterate AI agents and LLM workflows from ideation to execution
Monitor live systems (dashboards, A/B tests, validation pipelines), triage issues, and implement fixes for hallucinations and regressions
Utilize prompt and Gen-AI engineering techniques and tools such as RAG, MCPs, prompt chaining, few-shot prompting
QA and evaluate end user-facing AI output
Collaborate with stakeholders across product, marketing, CX, and R&D teams
Generate and QA background and conversational agents

What we offer

Family-friendly environment and flexible working hours
An awesome global team of forward-thinking, innovative go-getters
Integrate with tech titans: work directly with APIs from Google, Facebook, Microsoft, and more
Be part of a rapidly scaling company poised for the future
Learning and growth opportunities within a fast-paced tech startup environment
Clear career advancement path for strong performers
We are committed to setting each other up for success. As a member of our team, you will work in an environment that encourages growth, initiative taking, and continuous mutual feedback in order to reach your full potential
Cibus and lots of yummy treats

Fulltime

Lead Software Engineer, Front End

Location

United States , San Francisco; New York

Salary:

Not provided

Kiddom

Expiration Date

Until further notice

Requirements

Experience with modern FE Frameworks
Have used AI agents such as Cursor or Claude Code to build software
Have used markdown files within codebase to guide the behavior of the coding agent
Have built a system that uses large language models and/or RAG to solve a problem or answer a user query
Have lead a team of front end engineers previously
Have helped in task estimation, task assignment and ensuring the quality and timeliness of the teams output
Have lead teams developing user facing features
Have worked closely with Product managers, Designers and QA

Fulltime

Prompt Engineer

Fullpath is a growing tech company in the automotive space with hubs across the ...

Location

Israel , Tel Aviv; Jerusalem

Salary:

Not provided

Fullpath

Expiration Date

Until further notice

Requirements

Native level verbal and written English with excellent communication, presentation, and interpersonal skills
2+ years professional experience in product or R&D department
Strong product sense and empathy towards users, customers and their needs
Creative problem solver with a sense for business needs, while having some technical aptitude
Growth mindset
Strong analytical and troubleshooting skills with attention to detail

Job Responsibility

Design, prototype and iterate AI agents and LLM workflows from ideation to execution
Monitor live systems (dashboards, A/B tests, validation pipelines), triage issues, and implement fixes for hallucinations and regressions
Utilize prompt and Gen-AI engineering techniques and tools such as RAG, MCPs, prompt chaining, few-shot prompting
QA and evaluate end user-facing AI output
Collaborate with stakeholders across product, marketing, CX, and R&D teams
Generate and QA background and conversational agents

What we offer

Family-friendly environment and flexible working hours
An awesome global team of forward-thinking, innovative go-getters
Integrate with tech titans: work directly with APIs from Google, Facebook, Microsoft, and more
Be part of a rapidly scaling company poised for the future
Learning and growth opportunities within a fast-paced tech startup environment
Clear career advancement path for strong performers
We are committed to setting each other up for success. As a member of our team, you will work in an environment that encourages growth, initiative taking, and continuous mutual feedback in order to reach your full potential
Cibus and lots of yummy treats

Fulltime

Prompt Engineer

Fullpath is a growing tech company in the automotive space with hubs across the ...

Location

Israel , Tel Aviv or Jerusalem

Salary:

Not provided

Fullpath

Expiration Date

Until further notice

Requirements

Native level verbal and written English with excellent communication, presentation, and interpersonal skills
2+ years professional experience in product or R&D department
Strong product sense and empathy towards users, customers and their needs
Creative problem solver with a sense for business needs, while having some technical aptitude
Growth mindset
Strong analytical and troubleshooting skills with attention to detail

Job Responsibility

Design, prototype and iterate AI agents and LLM workflows from ideation to execution
Monitor live systems (dashboards, A/B tests, validation pipelines), triage issues, and implement fixes for hallucinations and regressions
Utilize prompt and Gen-AI engineering techniques and tools such as RAG, MCPs, prompt chaining, few-shot prompting
QA and evaluate end user-facing AI output
Collaborate with stakeholders across product, marketing, CX, and R&D teams
Generate and QA background and conversational agents

What we offer

Family-friendly environment and flexible working hours
An awesome global team of forward-thinking, innovative go-getters
Integrate with tech titans: work directly with APIs from Google, Facebook, Microsoft, and more
Be part of a rapidly scaling company poised for the future
Learning and growth opportunities within a fast-paced tech startup environment
Clear career advancement path for strong performers
We are committed to setting each other up for success. As a member of our team, you will work in an environment that encourages growth, initiative taking, and continuous mutual feedback in order to reach your full potential
Cibus and lots of yummy treats

QA LLM Engineer

Talentica

Location:

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:
January 02, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for QA LLM Engineer

Middle QA Automation Engineer

Senior AI Software Developer

Senior QA Engineer with AI experience

Prompt Engineer

Prompt Engineer

Lead Software Engineer, Front End

Prompt Engineer

Prompt Engineer

QA LLM Engineer

Talentica

Location:

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:January 02, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for QA LLM Engineer

Middle QA Automation Engineer

Senior AI Software Developer

Senior QA Engineer with AI experience

Prompt Engineer

Prompt Engineer

Lead Software Engineer, Front End

Prompt Engineer

Prompt Engineer

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
January 02, 2026