CrawlJobs Logo

Delivery Quality Engineer, AI Business

prolific.com Logo

Prolific

Location Icon

Location:
Mexico , Mexico City

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

As a Delivery Quality Engineer within Prolific AI Data Services, you will be the quality guardian for our managed service studies. You will design and operationalise the measurement systems, automation, and launch gates that ensure the data we deliver is trustworthy, authentic, and scalable. This role sits at the intersection of data quality, automation, and integrity. You’ll work closely with Product, Engineering, Operations, and Client teams to embed quality and authenticity into study design and execution—enabling faster launches without compromising trust as task types and volumes evolve.

Job Responsibility:

  • Own end-to-end quality design for Prolific managed service studies, including rubrics, acceptance criteria, defect taxonomies, severity models, and clear definitions of done
  • Define, implement, and maintain quality measurement systems, including sampling plans, golden sets, calibration protocols, agreement targets, adjudication workflows, and drift detection
  • Build and deploy automated quality checks and launch gates using Python and SQL, such as schema and format validation, completeness checks, anomaly detection, consistency testing, and label distribution monitoring
  • Design and run launch readiness processes, including pre-launch checks, pilot calibration, ramp criteria, full-launch thresholds, and pause/rollback mechanisms
  • Partner with Product and Engineering to embed in-study quality controls and authenticity checks into workflows, tooling, and escalation paths
  • Write and continuously improve guidelines and training materials to keep participants, reviewers, and internal teams aligned on evolving quality standards
  • Investigate quality and integrity issues end to end, running root-cause analysis across guidelines, UX, screening, training, and operations, and driving corrective and preventive actions (CAPAs)
  • Build dashboards and operating cadences to track defect rates, rework, throughput versus quality trade-offs, integrity events, and SLA adherence
  • Lead calibration sessions and coach QA leads and reviewers to improve decision consistency, rubric application, and overall quality judgement
  • Translate one-off quality fixes into repeatable, scalable playbooks across customers, programs, and study types

Requirements:

  • 5+ years of experience in quality engineering, data or annotation quality, analytics engineering, trust and integrity, or ML/LLM evaluation operations
  • Strong proficiency in Python and SQL, with comfort applying statistical concepts such as sampling strategies, confidence levels, and agreement metrics
  • A proven track record of turning ambiguous or messy quality problems into clear metrics, automated checks, and durable process improvements
  • Strong quality systems thinking, with the ability to translate complex edge cases into clear rules, tests, rubrics, and governance mechanisms
  • Hands-on experience instrumenting workflows and implementing pragmatic automation that catches quality and integrity issues early
  • Demonstrated ability to influence cross-functional teams (Product, Engineering, Operations, Client teams) and drive change without direct authority
  • Strong customer empathy, with a clear understanding of what “useful, trustworthy data” means for research, AI training, and evaluation use cases

Nice to have:

  • Familiarity with data collection mechanics (screeners, quota/routing constraints, study design patterns)
  • LLM evals, red teaming, or policy-based annotation experience
  • Data/versioning discipline (dataset lineage, change control, reproducibility)
  • Experience with integrity/fraud detection systems and anti-abuse tooling
What we offer:
  • competitive salary
  • benefits
  • remote working
  • impactful, mission-driven culture
  • equity
  • opportunity to earn a cash variable element, such as a bonus or commission

Additional Information:

Job Posted:
January 07, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
Prolific - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Delivery Quality Engineer, AI Business

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...
Location
Location
India , Chennai, Madurai, Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
  • Excellent Python programming skills with data engineering libraries and frameworks
  • Advanced SQL capabilities including window functions, CTEs, and performance tuning
  • Solid understanding of distributed processing using Spark/PySpark
  • Experience designing and implementing scalable ETL/ELT workflows
  • Good understanding of data modeling concepts (dimensional, star, snowflake)
  • Familiarity with GenAI/LLM-based integration for data workflows
  • Experience working with Git, CI/CD, and Agile delivery frameworks
  • Strong communication skills for interacting with clients, stakeholders, and internal teams
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
  • Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
  • Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
  • Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
  • Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
  • Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
  • Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
  • Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations
What we offer
What we offer
  • Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
  • Hands-on exposure to modern data stacks and emerging AI technologies
  • Collaboration with experts across Data, AI/ML, and cloud practices
  • Access to structured learning, certifications, and leadership mentoring
  • Competitive compensation with fast-track career growth and visibility
  • Fulltime
Read More
Arrow Right

Director of Quality Engineering

HMH is a learning technology company committed to delivering connected solutions...
Location
Location
India , Pune
Salary
Salary:
Not provided
edtechjobs.io Logo
EdTech Jobs
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of experience in software quality engineering
  • At least 7+ years in leadership roles overseeing QA/QE or Platform Engineering
  • Proven experience managing large engineering teams across geographies, preferably 50+ team members
  • Demonstrated success leading AI/automation initiatives within engineering or quality organizations
  • Deep expertise in modern testing strategies, CI/CD pipelines, cloud-native architectures, and tooling
  • Strong understanding of SDLC, release governance, and large-scale program execution
  • Excellent communication, stakeholder management, and leadership presence
  • Ability to operate in a fast-paced, matrixed global environment
Job Responsibility
Job Responsibility
  • Provide on-the-ground leadership for all QE teams in Pune, ensuring strong engagement, alignment, and execution
  • Develop and execute a strategy to elevate engineering maturity, strengthen delivery discipline, and scale operational excellence
  • Serve as a key member of the global engineering leadership team, driving alignment across geographies and business units
  • Engage with cross-functional teams, including product managers and business leaders, to align technical efforts with company objectives
  • Lead adoption and integration of AI, autonomous testing solutions, and agentic workflows to improve efficiency, accuracy, and delivery velocity
  • Champion innovation in automation frameworks, intelligent observability, and predictive analytics across QE
  • Evaluate and drive implementation of advanced tooling and platforms to enhance productivity
  • Oversee roadmap delivery for Platform and Curriculum initiatives, ensuring commitments are met with speed, reliability, and quality
  • Establish strong governance, release management rigor, and continuous improvement practices
  • Partner closely with Product, Architecture, Engineering, and Program teams to ensure seamless end-to-end delivery
  • Fulltime
Read More
Arrow Right

Director of Engineering, Quality Assurance

Leads a large Engineering organization focused on Quality Assurance for new deve...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • First level university degree or equivalent experience required
  • 15 or more years of related work experience in Quality Assurance engineering
  • 10 years of people management experience
  • Strong software development skills, including automation and tooling related to systems under test
  • Ability to apply Artificial Intelligence (AI) to accelerate delivery of products while increasing quality
  • Strong leadership skills, including coaching, team-building, and conflict resolution
  • Organizational and strategic management skills, including budget and business planning and forecasting
  • Strong analytical and problem solving skills
  • Ability to manage human capital across multiple geographies and organizations
  • Advanced communication skills
Job Responsibility
Job Responsibility
  • Provides direct and ongoing strategic leadership for the Hybrid Cloud Quality Assurance organization
  • Creates strategic and tactical operations and resource plans, goals, and priorities
  • Manages headcount, deliverables, schedules, and costs for the organization
  • Engages with program managers, marketing, supply chain, technical leaders and executives to communicate program status
  • Manages senior relationships and escalated issues with outsourced partners and suppliers
  • Identifies opportunities for and drives organizational initiatives and programs to support business process improvements
  • Provides overall people-care management for direct reports
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

Principal Consulting AI / Data Engineer

As a Principal Consulting AI / Data Engineer, you will design, build, and optimi...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
dyflex.com.au Logo
DyFlex Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven expertise in delivering enterprise-grade data engineering and AI solutions in production environments
  • Strong proficiency in Python and SQL, plus experience with Spark, Airflow, dbt, Kafka, or Flink
  • Experience with cloud platforms (AWS, Azure, or GCP) and Databricks
  • Ability to confidently communicate and present at C-suite level, simplifying technical concepts into business impact
  • Track record of engaging senior executives and influencing strategic decisions
  • Strong consulting and stakeholder management skills with client-facing experience
  • Background in MLOps, ML pipelines, or AI solution delivery highly regarded
  • Degree in Computer Science, Engineering, Data Science, Mathematics, or a related field
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data and AI solutions using Databricks, cloud platforms, and modern frameworks
  • Lead solution architecture discussions with clients, ensuring alignment of technical delivery with business strategy
  • Present to and influence executive-level stakeholders, including boards, C-suite, and senior directors
  • Translate highly technical solutions into clear business value propositions for non-technical audiences
  • Mentor and guide teams of engineers and consultants to deliver high-quality solutions
  • Champion best practices across data engineering, MLOps, and cloud delivery
  • Build DyFlex’s reputation as a trusted partner in Data & AI through thought leadership and client advocacy
What we offer
What we offer
  • Work with SAP’s latest technologies on cloud as S/4HANA, BTP and Joule, plus Databricks, ML/AI tools and cloud platforms
  • A flexible and supportive work environment including work from home
  • Competitive remuneration and benefits including novated lease, birthday leave, salary packaging, wellbeing programme, additional purchased leave, and company-provided laptop
  • Comprehensive training budget and paid certifications (Databricks, SAP, cloud platforms)
  • Structured career advancement pathways with opportunities to lead large-scale client programs
  • Exposure to diverse industries and client environments, including executive-level engagement
  • Fulltime
Read More
Arrow Right

Senior Engineering Manager, AI

As a Senior Engineering Manager (Forward Deployed Engineering team) at Atlassian...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field
  • 5+ years of experience managing software engineering teams at scale
  • Experience delivering impactful AI/ML solutions in production environments, including experience as a founding or forward-deployed engineer in 0-to-1 product development
  • Deep expertise in applied AI/ML, including generative AI, LLMs, and agent-based frameworks
  • Proficiency in Python, JavaScript, or similar languages, and experience with APIs, microservices, and enterprise integration
  • Demonstrated ability to solve complex, ambiguous problems and thrive in rapidly changing environments
  • Strong communication and collaboration skills, with experience influencing cross-functional teams without formal authority
  • Experience with AI risk assessment, data privacy, and compliance (e.g., GDPR)
  • Strategic and innovative thinking, with a track record of aligning technical solutions to business goals
Job Responsibility
Job Responsibility
  • Hire, onboard, and retain top talent for your team and foster a culture of innovation, collaboration, and excellence
  • Mentor and coach your forward-deployed engineering team on best practices in AI/ML solution design, code quality, scalable architecture, testing, debugging, and documentation—ensuring rapid, high-quality delivery of customer-focused, production-ready solutions
  • Drive data-driven solution development by analyzing complex datasets to extract insights and inform product direction
  • Champion the adoption of AI-augmented workflow automation within customer environments, maximizing business value and operational efficiency
  • Oversee the end-to-end deployment of AI solutions into production, ensuring continuous evaluation, monitoring, and improvement
  • Navigate risk and compliance requirements, including AI risk assessment, data privacy (GDPR), and regulatory frameworks
  • Communicate complex technical concepts clearly to both technical and non-technical stakeholders, creating concise artifacts for peers, partners, and leadership
  • Align technical solutions with business objectives, setting a clear vision for technological progress and measurable results
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
Read More
Arrow Right

Quality Assurance Business Development Manager

About the role. You will: Own the market success of the QA Competency: Define an...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
sollers.eu Logo
Sollers Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven track record in QA leadership and consulting in an Agile environment
  • Experience with selling services to large organizations
  • At least 3 years of experience as a Business Development Manager or other position with the responsibility for sales results in IT
  • Both technical background with experience supported by excellent business knowledge of QA
  • Excellent interpersonal skills, both for business and technical audiences
  • Excellent verbal and written English skills (at least C1 level)
  • Proactive attitude and ability to operate in a fast-changing environment
  • Ability to work collaboratively as a part of a Product Team and as an individual
  • Strategic thinking, analytical mindset, problem-solving abilities, and can-do attitude
Job Responsibility
Job Responsibility
  • Own the market success of the QA Competency: Define and execute the strategic direction for QA services and solutions
  • Drive sales and business development: Identify client needs, shape compelling offerings, and convert opportunities into long-term engagements (both new and existing customers)
  • Act as a trusted advisor: Support clients in defining QA strategies, implementing modern testing tools, and building quality-driven cultures
  • Build and evolve the QA offering: Ensure alignment with market trends (e.g., AI in testing, data masking, performance engineering etc.)
  • Collaborate with internal teams: Work closely with competencies such as Cloud, AI, DevOps, and Data to deliver integrated solutions
  • Lead thought leadership initiatives: Shape Sollers’ perspective on quality engineering by contributing to white papers, events, and partnerships
  • Support agile delivery: Engage with agile project teams, support QA maturity in ongoing implementations, and ensure client satisfaction. Be part of an advisory team on an IT project for financial institutions
  • Coach and mentor: Act as a QA Guru, build QA talent internally, support knowledge sharing, and foster a high-performance QA community
  • Collaborate externally: Work with external third parties to assess partnerships and licensing opportunities
What we offer
What we offer
  • Flexible working hours and a hybrid home office model (2-3 times per week in the office)
  • A chance to be promoted twice a year and a clearly defined career path with salary forecast
  • Opportunities for growth with a training budget that you can use for courses and conferences
  • Access to an online training platform and co-fund language classes
  • An internal coach to guide you through the onboarding, further training and career opportunities, plus a budget to be used for your lunches together
  • A chance to #domore for the planet and the community as part of Sollers Change Makers – our volunteering program
  • Lots of teambuilding activities, trips, hobby groups and cultural events
Read More
Arrow Right

Quality Assurance Business Development Manager

About the role. You will: Own the market success of the QA Competency: Define an...
Location
Location
Germany , Cologne
Salary
Salary:
Not provided
sollers.eu Logo
Sollers Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven track record in QA leadership and consulting in an Agile environment
  • Experience with selling services to large organizations
  • At least 3 years of experience as a Business Development Manager or other position with the responsibility for sales results in IT
  • Both technical background with experience supported by excellent business knowledge of QA
  • Excellent interpersonal skills, both for business and technical audiences
  • Excellent verbal and written German and English skills (at least C1 level)
  • Proactive attitude and ability to operate in a fast-changing environment
  • Ability to work collaboratively as a part of a Product Team and as an individual
  • Strategic thinking, analytical mindset, problem-solving abilities, and can-do attitude
Job Responsibility
Job Responsibility
  • Own the market success of the QA Competency: Define and execute the strategic direction for QA services and solutions
  • Drive sales and business development: Identify client needs, shape compelling offerings, and convert opportunities into long-term engagements (both new and existing customers)
  • Act as a trusted advisor: Support clients in defining QA strategies, implementing modern testing tools, and building quality-driven cultures
  • Build and evolve the QA offering: Ensure alignment with market trends (e.g., AI in testing, data masking, performance engineering etc.)
  • Collaborate with internal teams: Work closely with competencies such as Cloud, AI, DevOps, and Data to deliver integrated solutions
  • Lead thought leadership initiatives: Shape Sollers’ perspective on quality engineering by contributing to white papers, events, and partnerships
  • Support agile delivery: Engage with agile project teams, support QA maturity in ongoing implementations, and ensure client satisfaction. Be part of an advisory team on an IT project for financial institutions
  • Coach and mentor: Act as a QA Guru, build QA talent internally, support knowledge sharing, and foster a high-performance QA community
  • Collaborate externally: Work with external third parties to assess partnerships and licensing opportunities
What we offer
What we offer
  • Flexible working hours and a hybrid home office model (2-3 times per week in the office)
  • A chance to be promoted twice a year and a clearly defined career path with salary forecast
  • Opportunities for growth with a training budget that you can use for courses and conferences
  • Access to an online training platform and co-fund language classes
  • An internal coach to guide you through the onboarding, further training and career opportunities, plus a budget to be used for your lunches together
  • A chance to #domore for the planet and the community as part of Sollers Change Makers – our volunteering program
  • Lots of teambuilding activities, trips, hobby groups and cultural events
  • Fulltime
Read More
Arrow Right

Quality Assurance Business Development Manager

About the role. You will: Own the market success of the QA Competency: Define an...
Location
Location
France , Paris
Salary
Salary:
Not provided
sollers.eu Logo
Sollers Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven track record in QA leadership and consulting in an Agile environment
  • Experience with selling services to large organizations
  • At least 3 years of experience as a Business Development Manager or other position with the responsibility for sales results in IT
  • Both technical background with experience supported by excellent business knowledge of QA
  • Excellent interpersonal skills, both for business and technical audiences
  • Excellent verbal and written French and English skills (at least C1 level)
  • Proactive attitude and ability to operate in a fast-changing environment
  • Ability to work collaboratively as a part of a Product Team and as an individual
  • Strategic thinking, analytical mindset, problem-solving abilities, and can-do attitude
Job Responsibility
Job Responsibility
  • Own the market success of the QA Competency: Define and execute the strategic direction for QA services and solutions
  • Drive sales and business development: Identify client needs, shape compelling offerings, and convert opportunities into long-term engagements (both new and existing customers)
  • Act as a trusted advisor: Support clients in defining QA strategies, implementing modern testing tools, and building quality-driven cultures
  • Build and evolve the QA offering: Ensure alignment with market trends (e.g., AI in testing, data masking, performance engineering etc.)
  • Collaborate with internal teams: Work closely with competencies such as Cloud, AI, DevOps, and Data to deliver integrated solutions
  • Lead thought leadership initiatives: Shape Sollers’ perspective on quality engineering by contributing to white papers, events, and partnerships
  • Support agile delivery: Engage with agile project teams, support QA maturity in ongoing implementations, and ensure client satisfaction. Be part of an advisory team on an IT project for financial institutions
  • Coach and mentor: Act as a QA Guru, build QA talent internally, support knowledge sharing, and foster a high-performance QA community
  • Collaborate externally: Work with external third parties to assess partnerships and licensing opportunities
What we offer
What we offer
  • Flexible working hours and a hybrid home office model (2-3 times per week in the office)
  • A chance to be promoted twice a year and a clearly defined career path with salary forecast
  • Opportunities for growth with a training budget that you can use for courses and conferences
  • Access to an online training platform and co-fund language classes
  • An internal coach to guide you through the onboarding, further training and career opportunities, plus a budget to be used for your lunches together
  • A chance to #domore for the planet and the community as part of Sollers Change Makers – our volunteering program
  • Lots of teambuilding activities, trips, hobby groups and cultural events
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Poland Jobs Ireland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy