CrawlJobs Logo

Delivery Quality Engineer, AI Business

prolific.com Logo

Prolific

Location Icon

Location:
Mexico , Mexico City

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

As a Delivery Quality Engineer within Prolific AI Data Services, you will be the quality guardian for our managed service studies. You will design and operationalise the measurement systems, automation, and launch gates that ensure the data we deliver is trustworthy, authentic, and scalable. This role sits at the intersection of data quality, automation, and integrity. You’ll work closely with Product, Engineering, Operations, and Client teams to embed quality and authenticity into study design and execution—enabling faster launches without compromising trust as task types and volumes evolve.

Job Responsibility:

  • Own end-to-end quality design for Prolific managed service studies, including rubrics, acceptance criteria, defect taxonomies, severity models, and clear definitions of done
  • Define, implement, and maintain quality measurement systems, including sampling plans, golden sets, calibration protocols, agreement targets, adjudication workflows, and drift detection
  • Build and deploy automated quality checks and launch gates using Python and SQL, such as schema and format validation, completeness checks, anomaly detection, consistency testing, and label distribution monitoring
  • Design and run launch readiness processes, including pre-launch checks, pilot calibration, ramp criteria, full-launch thresholds, and pause/rollback mechanisms
  • Partner with Product and Engineering to embed in-study quality controls and authenticity checks into workflows, tooling, and escalation paths
  • Write and continuously improve guidelines and training materials to keep participants, reviewers, and internal teams aligned on evolving quality standards
  • Investigate quality and integrity issues end to end, running root-cause analysis across guidelines, UX, screening, training, and operations, and driving corrective and preventive actions (CAPAs)
  • Build dashboards and operating cadences to track defect rates, rework, throughput versus quality trade-offs, integrity events, and SLA adherence
  • Lead calibration sessions and coach QA leads and reviewers to improve decision consistency, rubric application, and overall quality judgement
  • Translate one-off quality fixes into repeatable, scalable playbooks across customers, programs, and study types

Requirements:

  • 5+ years of experience in quality engineering, data or annotation quality, analytics engineering, trust and integrity, or ML/LLM evaluation operations
  • Strong proficiency in Python and SQL, with comfort applying statistical concepts such as sampling strategies, confidence levels, and agreement metrics
  • A proven track record of turning ambiguous or messy quality problems into clear metrics, automated checks, and durable process improvements
  • Strong quality systems thinking, with the ability to translate complex edge cases into clear rules, tests, rubrics, and governance mechanisms
  • Hands-on experience instrumenting workflows and implementing pragmatic automation that catches quality and integrity issues early
  • Demonstrated ability to influence cross-functional teams (Product, Engineering, Operations, Client teams) and drive change without direct authority
  • Strong customer empathy, with a clear understanding of what “useful, trustworthy data” means for research, AI training, and evaluation use cases

Nice to have:

  • Familiarity with data collection mechanics (screeners, quota/routing constraints, study design patterns)
  • LLM evals, red teaming, or policy-based annotation experience
  • Data/versioning discipline (dataset lineage, change control, reproducibility)
  • Experience with integrity/fraud detection systems and anti-abuse tooling
What we offer:
  • competitive salary
  • benefits
  • remote working
  • impactful, mission-driven culture
  • equity
  • opportunity to earn a cash variable element, such as a bonus or commission

Additional Information:

Job Posted:
January 07, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Prolific - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Delivery Quality Engineer, AI Business

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...
Location
Location
India , Chennai, Madurai, Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
  • Excellent Python programming skills with data engineering libraries and frameworks
  • Advanced SQL capabilities including window functions, CTEs, and performance tuning
  • Solid understanding of distributed processing using Spark/PySpark
  • Experience designing and implementing scalable ETL/ELT workflows
  • Good understanding of data modeling concepts (dimensional, star, snowflake)
  • Familiarity with GenAI/LLM-based integration for data workflows
  • Experience working with Git, CI/CD, and Agile delivery frameworks
  • Strong communication skills for interacting with clients, stakeholders, and internal teams
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
  • Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
  • Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
  • Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
  • Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
  • Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
  • Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
  • Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations
What we offer
What we offer
  • Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
  • Hands-on exposure to modern data stacks and emerging AI technologies
  • Collaboration with experts across Data, AI/ML, and cloud practices
  • Access to structured learning, certifications, and leadership mentoring
  • Competitive compensation with fast-track career growth and visibility
  • Fulltime
Read More
Arrow Right

Director of Quality Engineering

HMH is a learning technology company committed to delivering connected solutions...
Location
Location
India , Pune
Salary
Salary:
Not provided
edtechjobs.io Logo
EdTech Jobs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of experience in software quality engineering
  • At least 7+ years in leadership roles overseeing QA/QE or Platform Engineering
  • Proven experience managing large engineering teams across geographies, preferably 50+ team members
  • Demonstrated success leading AI/automation initiatives within engineering or quality organizations
  • Deep expertise in modern testing strategies, CI/CD pipelines, cloud-native architectures, and tooling
  • Strong understanding of SDLC, release governance, and large-scale program execution
  • Excellent communication, stakeholder management, and leadership presence
  • Ability to operate in a fast-paced, matrixed global environment
Job Responsibility
Job Responsibility
  • Provide on-the-ground leadership for all QE teams in Pune, ensuring strong engagement, alignment, and execution
  • Develop and execute a strategy to elevate engineering maturity, strengthen delivery discipline, and scale operational excellence
  • Serve as a key member of the global engineering leadership team, driving alignment across geographies and business units
  • Engage with cross-functional teams, including product managers and business leaders, to align technical efforts with company objectives
  • Lead adoption and integration of AI, autonomous testing solutions, and agentic workflows to improve efficiency, accuracy, and delivery velocity
  • Champion innovation in automation frameworks, intelligent observability, and predictive analytics across QE
  • Evaluate and drive implementation of advanced tooling and platforms to enhance productivity
  • Oversee roadmap delivery for Platform and Curriculum initiatives, ensuring commitments are met with speed, reliability, and quality
  • Establish strong governance, release management rigor, and continuous improvement practices
  • Partner closely with Product, Architecture, Engineering, and Program teams to ensure seamless end-to-end delivery
  • Fulltime
Read More
Arrow Right

Director of Engineering, Quality Assurance

Leads a large Engineering organization focused on Quality Assurance for new deve...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • First level university degree or equivalent experience required
  • 15 or more years of related work experience in Quality Assurance engineering
  • 10 years of people management experience
  • Strong software development skills, including automation and tooling related to systems under test
  • Ability to apply Artificial Intelligence (AI) to accelerate delivery of products while increasing quality
  • Strong leadership skills, including coaching, team-building, and conflict resolution
  • Organizational and strategic management skills, including budget and business planning and forecasting
  • Strong analytical and problem solving skills
  • Ability to manage human capital across multiple geographies and organizations
  • Advanced communication skills
Job Responsibility
Job Responsibility
  • Provides direct and ongoing strategic leadership for the Hybrid Cloud Quality Assurance organization
  • Creates strategic and tactical operations and resource plans, goals, and priorities
  • Manages headcount, deliverables, schedules, and costs for the organization
  • Engages with program managers, marketing, supply chain, technical leaders and executives to communicate program status
  • Manages senior relationships and escalated issues with outsourced partners and suppliers
  • Identifies opportunities for and drives organizational initiatives and programs to support business process improvements
  • Provides overall people-care management for direct reports
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

Principal Consulting AI / Data Engineer

As a Principal Consulting AI / Data Engineer, you will design, build, and optimi...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
dyflex.com.au Logo
DyFlex Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven expertise in delivering enterprise-grade data engineering and AI solutions in production environments
  • Strong proficiency in Python and SQL, plus experience with Spark, Airflow, dbt, Kafka, or Flink
  • Experience with cloud platforms (AWS, Azure, or GCP) and Databricks
  • Ability to confidently communicate and present at C-suite level, simplifying technical concepts into business impact
  • Track record of engaging senior executives and influencing strategic decisions
  • Strong consulting and stakeholder management skills with client-facing experience
  • Background in MLOps, ML pipelines, or AI solution delivery highly regarded
  • Degree in Computer Science, Engineering, Data Science, Mathematics, or a related field
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data and AI solutions using Databricks, cloud platforms, and modern frameworks
  • Lead solution architecture discussions with clients, ensuring alignment of technical delivery with business strategy
  • Present to and influence executive-level stakeholders, including boards, C-suite, and senior directors
  • Translate highly technical solutions into clear business value propositions for non-technical audiences
  • Mentor and guide teams of engineers and consultants to deliver high-quality solutions
  • Champion best practices across data engineering, MLOps, and cloud delivery
  • Build DyFlex’s reputation as a trusted partner in Data & AI through thought leadership and client advocacy
What we offer
What we offer
  • Work with SAP’s latest technologies on cloud as S/4HANA, BTP and Joule, plus Databricks, ML/AI tools and cloud platforms
  • A flexible and supportive work environment including work from home
  • Competitive remuneration and benefits including novated lease, birthday leave, salary packaging, wellbeing programme, additional purchased leave, and company-provided laptop
  • Comprehensive training budget and paid certifications (Databricks, SAP, cloud platforms)
  • Structured career advancement pathways with opportunities to lead large-scale client programs
  • Exposure to diverse industries and client environments, including executive-level engagement
  • Fulltime
Read More
Arrow Right

Senior Engineering Manager, AI

As a Senior Engineering Manager (Forward Deployed Engineering team) at Atlassian...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field
  • 5+ years of experience managing software engineering teams at scale
  • Experience delivering impactful AI/ML solutions in production environments, including experience as a founding or forward-deployed engineer in 0-to-1 product development
  • Deep expertise in applied AI/ML, including generative AI, LLMs, and agent-based frameworks
  • Proficiency in Python, JavaScript, or similar languages, and experience with APIs, microservices, and enterprise integration
  • Demonstrated ability to solve complex, ambiguous problems and thrive in rapidly changing environments
  • Strong communication and collaboration skills, with experience influencing cross-functional teams without formal authority
  • Experience with AI risk assessment, data privacy, and compliance (e.g., GDPR)
  • Strategic and innovative thinking, with a track record of aligning technical solutions to business goals
Job Responsibility
Job Responsibility
  • Hire, onboard, and retain top talent for your team and foster a culture of innovation, collaboration, and excellence
  • Mentor and coach your forward-deployed engineering team on best practices in AI/ML solution design, code quality, scalable architecture, testing, debugging, and documentation—ensuring rapid, high-quality delivery of customer-focused, production-ready solutions
  • Drive data-driven solution development by analyzing complex datasets to extract insights and inform product direction
  • Champion the adoption of AI-augmented workflow automation within customer environments, maximizing business value and operational efficiency
  • Oversee the end-to-end deployment of AI solutions into production, ensuring continuous evaluation, monitoring, and improvement
  • Navigate risk and compliance requirements, including AI risk assessment, data privacy (GDPR), and regulatory frameworks
  • Communicate complex technical concepts clearly to both technical and non-technical stakeholders, creating concise artifacts for peers, partners, and leadership
  • Align technical solutions with business objectives, setting a clear vision for technological progress and measurable results
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
Read More
Arrow Right

Sr. Manager, Insights Delivery

The Sr. Manager, Insights Delivery will be responsible for leading the design, d...
Location
Location
United States , Carmel
Salary
Salary:
130000.00 - 180000.00 USD / Year
belden.com Logo
Belden, Inc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelors or Masters degree in Computer Science, Artificial Intelligence, Data Science, or a related field
  • 7–10 years in analytics or BI delivery, including 5+ years leading teams or large-scale insights projects
  • Proven experience with Tableau (including Tableau AI), PowerBI, SAP Analytics, or similar platforms for enterprise-scale reporting
  • Strong grounding in data modeling, SQL, and modern analytics workflows
  • Understanding of data quality, metadata, and master data as foundations of trustworthy insights
  • Familiarity with how AI and machine learning can augment BI (forecasting, anomaly detection, natural-language insights)
  • Demonstrated success in leading cross-functional teams, managing stakeholders, and driving adoption of data tools
  • Ability to align insights delivery with business strategy—translating data into action and measurable outcomes
Job Responsibility
Job Responsibility
  • Lead the team responsible for building and maintaining dashboards, reports, and visualizations (Tableau, TableauAI, SAP Analytics, and other enterprise insights tools)
  • Deliver operational and analytical reporting that supports both daily execution and long-term strategic decision-making
  • Design and deliver integrated insights by combining multiple internal and external data sources to identify trends, correlations, and performance drivers across the business
  • Partner with Insights Strategy to evolve BI into AI-augmented analytics that anticipate needs and recommend actions
  • Evaluate and implement innovative insights tools and technologies to improve speed, usability, and depth of enterprise insights
  • Ensure data quality, governance, and integration across source systems by working closely with IT, data engineering, and governance teams
  • Go beyond business requirements to deliver comprehensive, enterprise-grade insights solutions—providing stakeholders not just with what they asked for, but with what they need to fully understand performance, root causes, and recommended actions
  • Monitor performance, adoption, and user satisfaction of insights tools, driving continuous improvement and value realization
  • Mentor and grow the insights delivery team in analytics methods, data storytelling, visualization standards, and emerging technologies
What we offer
What we offer
  • Health/dental/vision
  • Long term/short term disability
  • Life insurance
  • HSA/FSA
  • Matching retirement plans
  • Paid vacation
  • Parental leave
  • Employee stock purchase plan
  • Paid leave for volunteer work in your community
  • Training opportunities
  • Fulltime
Read More
Arrow Right

Staff Software Engineer – Forward Deployed

We are seeking a skilled Software Engineer who will design, build, and maintain ...
Location
Location
China , Shanghai; Dalian; Wuhan
Salary
Salary:
Not provided
pfizer.de Logo
Pfizer
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or related field with 8-12 years of relevant experience
  • AI-Augmented Development: optimize AI tool usage, train engineers on AI-augmented workflows, evaluate new AI development tools, establish practices that balance AI speed with verification rigor
  • Business Immersion: rapidly acquire domain expertise, translate between business and engineering, mentor engineers on immersion
  • Data Integration: navigate complex enterprise data landscapes, build relationships to gain data access, handle undocumented schemas, build robust integration solutions, mentor engineers on data integration
  • Full-Stack Development: build complete applications rapidly across any technology stack, select the right tools, balance technical debt with delivery speed, mentor engineers on full-stack development
  • Multi-Audience Communication: influence through communication at all levels, handle difficult conversations skillfully, train engineers on effective communication, represent teams across the function
  • Problem Discovery: seek out undefined problems, embed with users to discover latent needs, coach engineers on problem discovery techniques, turn ambiguity into clear problem statements
  • Rapid Prototyping & Validation: lead rapid delivery initiatives, coach on prototype-first approaches, establish trust through consistent fast delivery, define clear criteria for prototype-to-production transitions
  • Site Reliability Engineering: define reliability standards, drive post-incident improvements systematically, design capacity planning processes, mentor engineers on SRE practices
  • Stakeholder Management: influence senior stakeholders, manage complex stakeholder landscapes with competing agendas, build trust rapidly with new stakeholders, shield teams from organizational friction
Job Responsibility
Job Responsibility
  • Delivery: Lead technical delivery of complex projects across multiple teams, unblock others through hands-on contributions, ensure engineering quality
  • AI: Design AI-augmented engineering workflows for your area, evaluate new AI tools, train engineers on effective AI usage, balance speed with verification
  • People: Coach multiple engineers on career growth, lead hiring for technical roles across your area, shape team technical culture
  • Business: Drive business outcomes through technical solutions across your area, influence product roadmaps, partner effectively with business stakeholders
  • Process: Drive process efficiency within your team, coordinate cross-functional technical work, lead retrospectives
  • Documentation: Design documentation strategies for your projects, ensure knowledge persists beyond individuals, write specifications that enable effective collaboration
  • Fulltime
Read More
Arrow Right

Principal Project Manager

The Principal Project Manager (PjM) in Microsoft Industry Solutions Delivery (IS...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Engineering, Computer Science, Information Systems or equivalent experience
  • 12+ years of experience in complex project/program delivery
  • 5+ years leading large-scale enterprise transformation programs
  • Proven success delivering Cloud and AI-centric programs (Azure, Data, Security, Application Modernization)
  • Strong financial and commercial management experience (forecasting, margins, change control)
  • Executive-level communication and stakeholder management capability
  • Should have played technical engineering leadership roles on Gen AI
  • Experience delivering Azure AI, OpenAI, Copilot, and Data & Analytics solutions at scale
  • Ability to engage technically with Architects and Engineers on AI architecture trade-offs
  • Understanding of Responsible AI, enterprise AI risk, security, and compliance considerations
Job Responsibility
Job Responsibility
  • Lead end-to-end delivery of large, multi-workstream, global transformation programs (Cloud, Data, AI, Security, Application Modernization, Industry Solutions)
  • Define delivery strategy, governance model, financial structure, milestones, dependencies, and execution cadence
  • Act as the single accountable delivery leader for high-visibility programs, including executive steering committees and escalation management
  • Proactively identify, quantify, and mitigate delivery, commercial, technical, and organizational risks
  • Drive predictable outcomes across Microsoft internal teams, partners, and customer organizations
  • Should be able to lead /co-lead technical discussions with the customers
  • Lead AI-first delivery models including Generative AI, Azure AI, Copilot-enabled solutions, and AI-powered accelerators
  • Partner with Architects, Engineering, Data Science, Security, and Responsible AI stakeholders to drive safe, scalable AI deployments
  • Move solutions from PoC/pilot stages into production-grade enterprise deployments
  • Apply Responsible AI, security, privacy, and compliance guardrails throughout delivery execution
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy