CrawlJobs Logo
C
Codvo AI · IT - Software Development

Qa Lead – Ai/Ml Systems

India, Pune · Job Posted June 03, 2026
Apply Position
Job Link Share

Job Description

We are looking for an experienced QA Lead – AI Systems to lead the validation and quality assurance of AI-powered products, including LLM/RAG systems, Software as a Medical Device (SaMD), and other AI-driven digital solutions. This is a key leadership role responsible for establishing end-to-end QA frameworks, validation strategies, and compliance processes for AI/ML models across development and deployment pipelines. The ideal candidate will bridge data science, software engineering, and regulatory QA to ensure AI systems meet performance, safety, and compliance standards.

Job Responsibility

  • Own and drive QA strategy for AI systems across the model, data, and product lifecycle
  • Lead AI model validation efforts, covering LLM/RAG testing, bias analysis, and performance evaluation
  • Define and implement AI Evaluation Metrics (accuracy, fairness, drift, explainability) aligned with business and regulatory expectations
  • Establish frameworks for Explainability Testing (SHAP, LIME, XAI) and ensure interpretability of AI outcomes
  • Collaborate with Data Science and MLOps teams to validate models within cloud environments (Azure ML, AWS Sagemaker, Vertex AI)
  • Drive verification and validation (V&V) for AI models and applications under FDA and SaMD compliance frameworks
  • Ensure test traceability, documentation, and audit readiness in line with ISO 13485, IEC 62304, and ISO 14971
  • Develop Python-based automation for AI testing, data validation, and model evaluation pipelines
  • Provide technical leadership to QA teams, ensuring alignment with AI/ML development best practices
  • Collaborate with cross-functional teams (Product, Data, Regulatory, Engineering) to identify risks, gaps, and opportunities for test optimization
  • Present validation findings, risks, and recommendations to senior stakeholders and regulatory reviewers

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Biomedical Engineering, or related field
  • 8–12 years of total QA experience, with 2–3 years directly in AI/ML or GenAI QA
  • Proven experience in AI Model Validation, LLM/RAG Testing, and AI Evaluation Metrics
  • Strong knowledge of MLOps concepts and cloud platforms (Azure ML, AWS Sagemaker, Vertex AI)
  • Understanding of FDA AI/ML Compliance, SaMD testing, and regulated software QA
  • Hands-on expertise in Python automation and testing AI/ML pipelines
  • Excellent documentation and communication skills with ability to produce traceable validation artifacts
Codvo AI - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Qa Lead – Ai/Ml Systems

8 matching positions

Principal Software Consultant - AI/ML Engineer

As an ML Team Lead, you will be responsible for leading the technical direction ...
Location
Location
Pakistan , Lahore, Karachi, Islamabad
Salary
Salary:
Not provided
10pearls.com Logo
10Pearls
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in computer science, Artificial Intelligence, Data Science, Software Engineering, or a related field
  • 7+ years of professional software engineering experience with at least 5 years of hands-on experience building and deploying ML systems into production
  • Prior experience as a Tech Lead, Staff Engineer, or hands-on lead for AI/ML engineering teams
  • Strong expertise in classical machine learning domains such as forecasting, ranking, classification, and optimization
  • Hands-on experience building modern LLM and agentic AI systems including RAG pipelines, tool-using agents, multi-step workflows, and evaluation systems
  • Strong proficiency in Python and backend system development
  • Experience with ML frameworks such as PyTorch or TensorFlow
  • Strong understanding of scalable distributed systems, APIs, system integration, architecture design, and production engineering practices
  • Experience operating ML services at scale, including SLO management, monitoring, on-call practices, and incident response
  • Experience working with Kubernetes-based deployments, CI/CD pipelines, and modern cloud-native engineering practices
Job Responsibility
Job Responsibility
  • Lead the technical direction for the team’s ML and LLM systems, including architecture patterns, platform choices, evaluation frameworks, and engineering standards
  • Stay hands-on by designing and implementing complex ML and agentic AI systems, writing production-grade code, and leading through technical execution
  • Design, develop, and deploy scalable ML and LLM-powered applications and services in production environments
  • Build and optimize AI-powered solutions such as RAG systems, multi-step agents, AI assistants, chatbots, forecasting systems, ranking models, classification models, and optimization systems
  • Drive architecture and design reviews to ensure scalability, reliability, security, and maintainability of AI/ML systems
  • Own the technical roadmap for ML/LLM initiatives and translate business objectives into execution plans and scalable solutions
  • Collaborate closely with Product Managers, Engineers, Data Engineers, MLOps Engineers, QA Engineers, and cross-functional stakeholders to deliver business-aligned AI solutions
  • Establish engineering best practices for prompt engineering, model evaluation, regression testing, observability, and production readiness
  • Define and implement quality standards, evaluation suites, acceptance metrics, and regression plans for all AI/ML features
  • Ensure high availability, scalability, and resilience of tier-1 ML services through SLOs, monitoring, incident response, failover strategies, circuit breakers, and multi-zone deployments
  • Fulltime
Read More
Arrow Right

Senior Manager Software Development

At Appian, we’re passionate about technology—we love making it, and we love usin...
Location
Location
India , Chennai
Salary
Salary:
Not provided
appian.com Logo
Appian Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field
  • 15+ years of experience in software engineering
  • Proven track record in building and scaling distributed systems, preferably in cloud-native environments and modernization of platforms
  • AI/ML adoption
  • Proven experience leading development teams
  • Strong knowledge of enterprise application architecture
  • Leading engineering teams and managers
  • Deep Understanding software engineering, Algorithms and Data Structures
  • Experience in AI Adoptability and usage and ML is highly desirable
  • Proficiency in any programming Language (Java, C++, Python, other programming languages)
Job Responsibility
Job Responsibility
  • Manage development teams, oversee architecture decisions, and ensure scalable, high-quality delivery aligned with business objectives
  • Guide software engineers through solving ambiguous and complex problems
  • Champion an AI-first approach
  • Bring deep experience in migrating and modernizing legacy applications using cloud-native, modular architectures and emerging technologies
  • Lead and mentor a team of developers, architects, and analysts
  • Set very high standards for the team and in hiring talent
  • Manage end-to-end project delivery
  • Establish development standards, governance, and best practices
  • Drive cross-functional teams
  • Collaborate with stakeholders, product owners, and cross-functional teams
What we offer
What we offer
  • Health coverage
  • Employee Assistance Program (EAP) with free mental health support
  • Life and disability insurance
  • Employee Stock Purchase Program (ESPP)
  • Retirement/pension plan
  • Wellness dollars
  • Tuition reimbursement
  • Family-forming benefits
Read More
Arrow Right

Audio/Video Specialist

The Video Conference Engineer will be a critical member of the Engineering & Del...
Location
Location
United States , San Jose
Salary
Salary:
94000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in AV/VC engineering, SaaS application deployment, or enterprise collaboration technology delivery
  • Expertise with Microsoft Teams, Microsoft Teams Room Pro, LogiSync, Appspace, BrightSign, and Windows OS environments
  • Strong hands-on experience with APIs, scripting (Python, PowerShell, etc.), and automation frameworks
  • Solid understanding of networking (QoS, firewalls, connectivity) for real-time collaboration systems
  • Knowledge of enterprise security practices, including RBAC, conditional access, and vulnerability management
  • Proven track record managing end-to-end deployments in a fast-paced, global enterprise environment
  • Strong communication, documentation, and cross-functional collaboration skills
Job Responsibility
Job Responsibility
  • Design, deploy, and improve AV/VC systems across conference rooms, events, and hybrid meeting spaces
  • Lead system upgrades, new room builds, and large-scale technology rollouts, ensuring alignment with corporate standards
  • Configure and integrate Microsoft Teams, Microsoft Teams Room Pro, LogiSync, Appspace, BrightSign, and Windows OS-based platforms
  • Develop automation and API-driven workflows to streamline system management and reduce manual effort
  • Plan and execute deployment projects end-to-end, from design through QA testing and documentation to handover
  • Define system topology, hardware/software requirements, and create standard room designs for multiple room types
  • Ensure interoperability across AV hardware, control systems, and SaaS platforms
  • Deploy and manage monitoring systems (Fusion, Ecostruxture, Netspeak, LogiSync) for proactive health management
  • Produce detailed engineering and support documentation for deployments and new technologies
  • Analyze Teams quality dashboards and system telemetry to ensure optimal performance
  • Fulltime
Read More
Arrow Right

MTR Engineer

The Video Conference Engineer will be a critical member of the Engineering & Del...
Location
Location
United States , San Jose
Salary
Salary:
130000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in AV/VC engineering, SaaS application deployment, or enterprise collaboration technology delivery
  • Expertise with Microsoft Teams, Microsoft Teams Room Pro, LogiSync, Appspace, BrightSign, and Windows OS environments
  • Strong hands-on experience with APIs, scripting (Python, PowerShell, etc.), and automation frameworks
  • Solid understanding of networking (QoS, firewalls, connectivity) for real-time collaboration systems
  • Knowledge of enterprise security practices, including RBAC, conditional access, and vulnerability management
  • Proven track record managing end-to-end deployments in a fast-paced, global enterprise environment
  • Strong communication, documentation, and cross-functional collaboration skills
Job Responsibility
Job Responsibility
  • Design, deploy, and improve AV/VC systems across conference rooms, events, and hybrid meeting spaces
  • Lead system upgrades, new room builds, and large-scale technology rollouts, ensuring alignment with corporate standards
  • Configure and integrate Microsoft Teams, Microsoft Teams Room Pro, LogiSync, Appspace, BrightSign, and Windows OS-based platforms
  • Develop automation and API-driven workflows to streamline system management and reduce manual effort
  • Plan and execute deployment projects end-to-end, from design through QA testing and documentation to handover
  • Define system topology, hardware/software requirements, and create standard room designs for multiple room types
  • Ensure interoperability across AV hardware, control systems, and SaaS platforms
  • Deploy and manage monitoring systems (Fusion, Ecostruxture, Netspeak, LogiSync) for proactive health management
  • Produce detailed engineering and support documentation for deployments and new technologies
  • Analyze Teams quality dashboards and system telemetry to ensure optimal performance
  • Fulltime
Read More
Arrow Right
New

Tech Lead – Full Stack (AI-First Mindset)

As a Tech Lead (AI-First), you will lead technical execution across full-stack a...
Location
Location
India
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7–12+ years of software development experience with strong full-stack expertise
  • Deep hands-on skills in React.js, Angular, Node.js, Express.js, NestJS
  • Strong understanding of microservices, API design, and distributed systems
  • Proven experience leading technical projects or small teams
  • Experience integrating AI/LLM-based features OR willingness + capability to adopt AI-first tools.
Job Responsibility
Job Responsibility
  • Lead technical design, architecture decisions, and development workflows across frontend and backend systems
  • Provide direction on frameworks, patterns, code quality, and performance optimization
  • Mentor engineers, perform code reviews, and ensure engineering best practices
  • Evaluate new AI tools, frameworks, and libraries for integration into the project
  • Apply AI tools and LLMs to improve developer productivity (code generation, testing, documentation, automation)
  • Design systems that can support future AI/ML capabilities (API orchestration, extensible data models, scalable services)
  • Partner with AI/ML engineers to embed models into full-stack applications
  • Build scalable applications using React.js, Angular, Node.js, Express.js, NestJS
  • Design and develop RESTful APIs, microservices, and backend logic
  • Build reusable UI components, dashboards, and interactive interfaces
  • Fulltime
Read More
Arrow Right

Senior Cloud Developer

The Cloud Developer builds quality products from the ground up through test plan...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field from a reputed institution
  • 10–15 years of hands‑on QA testing and automation experience, with a proven track record of delivering high‑quality software on schedule in both waterfall and agile methodologies
  • Demonstrated Cloud architect experience, architecting large-scale test and automation programs
  • Strong expertise in solution testing, including designing test topologies, deploying and validating systems, and debugging/troubleshooting across networking and cloud environments
  • Practical experience with greenfield deployments, brownfield migrations, and production considerations such as scale, performance, and latency for cloud environments
  • Direct experience diagnosing and resolving customer issues in live production environments
  • Solid background in Network Management System (NMS) and core networking technologies and protocols (routing, switching)
  • Advanced automation and programming skills (Python, Cypress preferred, or equivalent)
  • Advanced knowledge with at least one public cloud (AWS, Azure, Google Cloud) and common services used for testing and deployment
  • Experience with Kubernetes‑based test orchestration and CI/CD pipelines for networked/clouded systems
Job Responsibility
Job Responsibility
  • Lead and create test strategies for switch software and cloud deployment
  • Test cloud software systems across various platforms, execute cases covering functionality, compliance, negative, solution, integration, scale, interoperability and performance scenarios
  • Design, build and maintain automated test suites and test infrastructure for hyperscale, multi‑cloud environments
  • Implement test orchestration, environment provisioning and CI/CD integration
  • Review and validate test plans, test cases and QA artifacts against product architecture and quality objectives
  • identify implementation gaps early and collaborate with development teams to mitigate risks
  • Own quality reviews of team deliverables — defects, test reports and automation scripts — and provide timely, actionable feedback to improve test coverage and reliability
  • Establish guidelines and standards for testing programmable networks and APIs, including REST, GraphQL, YANG, gRPC, and AI‑driven test scenarios
  • Drive innovation and adoption of new tools, frameworks and automation technologies across the cloud QA organization to increase efficiency and reduce flakiness
  • Lead strategic QA initiatives that address real customer challenges (e.g., high‑availability failures, brownfield migrations, scale issues) and translate findings into improvements and preventive checks
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

AI Enablement Lead Engineer

At RediMinds, we build AI-enabled systems that help complex industries operate b...
Location
Location
India , Gurgaon
Salary
Salary:
Not provided
rediminds.com Logo
RediMinds
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–6 years of experience in software engineering, full-stack development, product engineering, or related technical roles
  • Strong technical background across modern web technologies, APIs, databases, cloud systems, and AI-enabled product development
  • Experience working in a startup environment or building something entrepreneurial—either as a founder, early team member, lead engineer, or technical product owner
  • Ability to lead engineering execution while staying hands-on
  • Strong understanding of product thinking: user needs, business goals, delivery timelines, and technical trade-offs
  • Comfortable working in a fast-moving environment where requirements evolve and ownership matters
  • Excellent communication skills and the ability to work closely with both technical and non-technical teammates
  • Based in Gurgaon/Delhi NCR, or willing to relocate to Gurgaon for an on-site role
Job Responsibility
Job Responsibility
  • Lead AI-enabled product development across frontend, backend, automation, data, and AI/ML integration workflows
  • Guide a growing engineering team with clarity, urgency, and compassion
  • Work closely with product, AI/ML, QA, and business teams to translate ideas into reliable, scalable systems
  • Own technical execution from requirement understanding to architecture, development, testing, deployment, and iteration
  • Support AI enablement initiatives across automation, document processing, workflow intelligence, retrieval systems, LLM-based tools, and applied AI solutions
  • Create structure in ambiguity—turn fast-moving ideas into clear tasks, working systems, and measurable outcomes
  • Mentor junior engineers and AI Enablers, helping them grow through high standards and hands-on guidance
  • Bring startup energy to the team: move fast, solve problems, learn quickly, and make things happen
What we offer
What we offer
  • Long-Term Growth: Join at a meaningful stage and grow into larger leadership responsibilities over time
  • Real Ownership: Work on products and systems that matter, not isolated tickets
  • Startup Energy with Serious Direction: Move fast, build deeply, and contribute to real business outcomes
  • Exceptional Team: Work with engineers, AI researchers, product leaders, clinicians, and strategists who care about building responsibly
  • AI at the Center: Be part of a company where AI enablement is not a side project—it is the core of what we do
  • Fulltime
Read More
Arrow Right

Engineering Director

We are seeking a seasoned Engineering Director who thrives in challenging and fa...
Location
Location
Puerto Rico , Aguadilla
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Significant work experience as a director or similar position working across multiple stakeholder organizations, with at least 10+ years of people leadership experience specific to SW and Cloud engineering
  • Solid experience leading SW development across storage, networking, on-prem, and SaaS is a must
  • Experience in setting up geographically distributed sites
  • Must have a strong background in software development lifecycle including cloud infrastructure
  • Familiarity with agile methodologies and tools like JIRA
  • Prior experience in cloud product development and deployments
  • end to end ownership and accountability
  • Solid understanding of fundamental AI and machine learning concepts, including supervised and unsupervised learning, deep learning, reinforcement learning, natural language processing, computer vision, and statistical modeling
  • Extensive business acumen, technical knowledge, and industry experience encompassing one or more engineering, technology, and product domains
  • Demonstrated abilities to drive transformation across a business with exceptional skills in the management of change
Job Responsibility
Job Responsibility
  • Oversee the Puerto Rico Site daily operations, strategic planning and cross-functional team leadership for Hybrid Cloud
  • Recruit, mentor, and manage teams of AI/ML engineers, QA Engineers, Design Engineers and innovation specialists to deliver cutting-edge solutions
  • Continuously evaluate new tools, platforms, and frameworks in AI/ML to drive competitive advantage and operational efficiency
  • Ensure alignment with corporate goals while fostering a high-performance culture, operational efficiency, and employee engagement
  • Lead the development and execution of AI/ML strategies that align with business goals and drive innovation across products, services, or operations
  • Create strategic and tactical operations and resource plans, goals, and priorities for assigned organization based on business and technology roadmap and functional objectives
  • Engage with various senior leaders across the organization, program managers, R&D, support, Quality, product managers, technical leaders and executives to communicate program status, escalate issues, and guide and influence strategic decision-making
  • Manage senior relationships and escalated issues with outsourced partners and suppliers, including setting expectations regarding deliverables, product quality, schedules, and costs
  • ensures that organization is effectively leveraging outsourced resources
  • Identify opportunities for and drive organizational initiatives and programs to support business process improvements and cost reductions
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right