CrawlJobs Logo
Prolific Logo Prolific · IT - Software Development

Data Quality Engineer, AI Business

· Job Posted January 13, 2026
Apply Position
Job Link Share

Job Description

As a Data Quality Engineer within Prolific AI Data Services, you will be the quality guardian for our managed service studies. You will design and operationalise the measurement systems, automation, and launch gates that ensure the data we deliver is trustworthy, authentic, and scalable. This role sits at the intersection of data quality, automation, and integrity. You’ll work closely with Product, Engineering, Operations, and Client teams to embed quality and authenticity into study design and execution—enabling faster launches without compromising trust as task types and volumes evolve.

Job Responsibility

  • Own end-to-end quality design for Prolific managed service studies, including rubrics, acceptance criteria, defect taxonomies, severity models, and clear definitions of done
  • Define, implement, and maintain quality measurement systems, including sampling plans, golden sets, calibration protocols, agreement targets, adjudication workflows, and drift detection
  • Build and deploy automated quality checks and launch gates using Python and SQL, such as schema and format validation, completeness checks, anomaly detection, consistency testing, and label distribution monitoring
  • Design and run launch readiness processes, including pre-launch checks, pilot calibration, ramp criteria, full-launch thresholds, and pause/rollback mechanisms
  • Partner with Product and Engineering to embed in-study quality controls and authenticity checks into workflows, tooling, and escalation paths
  • Write and continuously improve guidelines and training materials to keep participants, reviewers, and internal teams aligned on evolving quality standards
  • Investigate quality and integrity issues end to end, running root-cause analysis across guidelines, UX, screening, training, and operations, and driving corrective and preventive actions (CAPAs)
  • Build dashboards and operating cadences to track defect rates, rework, throughput versus quality trade-offs, integrity events, and SLA adherence
  • Lead calibration sessions and coach QA leads and reviewers to improve decision consistency, rubric application, and overall quality judgement
  • Translate one-off quality fixes into repeatable, scalable playbooks across customers, programs, and study types

Requirements

  • 5+ years of experience in quality engineering, data or annotation quality, analytics engineering, trust and integrity, or ML/LLM evaluation operations
  • Strong proficiency in Python and SQL, with comfort applying statistical concepts such as sampling strategies, confidence levels, and agreement metrics
  • A proven track record of turning ambiguous or messy quality problems into clear metrics, automated checks, and durable process improvements
  • Strong quality systems thinking, with the ability to translate complex edge cases into clear rules, tests, rubrics, and governance mechanisms
  • Hands-on experience instrumenting workflows and implementing pragmatic automation that catches quality and integrity issues early
  • Demonstrated ability to influence cross-functional teams (Product, Engineering, Operations, Client teams) and drive change without direct authority
  • Strong customer empathy, with a clear understanding of what “useful, trustworthy data” means for research, AI training, and evaluation use cases

Nice to have

  • Familiarity with data collection mechanics (screeners, quota/routing constraints, study design patterns)
  • LLM evals, red teaming, or policy-based annotation experience
  • Data/versioning discipline (dataset lineage, change control, reproducibility)
  • Experience with integrity/fraud detection systems and anti-abuse tooling
Prolific - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Quality Engineer, AI Business

8 matching positions

Delivery Quality Engineer, AI Business

As a Delivery Quality Engineer within Prolific AI Data Services, you will be the...
Location
Location
Mexico , Mexico City
Salary
Salary:
Not provided
prolific.com Logo
Prolific
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in quality engineering, data or annotation quality, analytics engineering, trust and integrity, or ML/LLM evaluation operations
  • Strong proficiency in Python and SQL, with comfort applying statistical concepts such as sampling strategies, confidence levels, and agreement metrics
  • A proven track record of turning ambiguous or messy quality problems into clear metrics, automated checks, and durable process improvements
  • Strong quality systems thinking, with the ability to translate complex edge cases into clear rules, tests, rubrics, and governance mechanisms
  • Hands-on experience instrumenting workflows and implementing pragmatic automation that catches quality and integrity issues early
  • Demonstrated ability to influence cross-functional teams (Product, Engineering, Operations, Client teams) and drive change without direct authority
  • Strong customer empathy, with a clear understanding of what “useful, trustworthy data” means for research, AI training, and evaluation use cases
Job Responsibility
Job Responsibility
  • Own end-to-end quality design for Prolific managed service studies, including rubrics, acceptance criteria, defect taxonomies, severity models, and clear definitions of done
  • Define, implement, and maintain quality measurement systems, including sampling plans, golden sets, calibration protocols, agreement targets, adjudication workflows, and drift detection
  • Build and deploy automated quality checks and launch gates using Python and SQL, such as schema and format validation, completeness checks, anomaly detection, consistency testing, and label distribution monitoring
  • Design and run launch readiness processes, including pre-launch checks, pilot calibration, ramp criteria, full-launch thresholds, and pause/rollback mechanisms
  • Partner with Product and Engineering to embed in-study quality controls and authenticity checks into workflows, tooling, and escalation paths
  • Write and continuously improve guidelines and training materials to keep participants, reviewers, and internal teams aligned on evolving quality standards
  • Investigate quality and integrity issues end to end, running root-cause analysis across guidelines, UX, screening, training, and operations, and driving corrective and preventive actions (CAPAs)
  • Build dashboards and operating cadences to track defect rates, rework, throughput versus quality trade-offs, integrity events, and SLA adherence
  • Lead calibration sessions and coach QA leads and reviewers to improve decision consistency, rubric application, and overall quality judgement
  • Translate one-off quality fixes into repeatable, scalable playbooks across customers, programs, and study types
What we offer
What we offer
  • competitive salary
  • benefits
  • remote working
  • impactful, mission-driven culture
  • equity
  • opportunity to earn a cash variable element, such as a bonus or commission
  • Fulltime
Read More
Arrow Right

Business Engineer, Business AI

Business Engineering is looking for impact-driven, entrepreneurial engineers rea...
Location
Location
United States , Menlo Park
Salary
Salary:
149000.00 - 210000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 5+ years of experience as a software engineer building and shipping production quality code in dynamic, ambiguous environments
  • Experience with designing, building, and iterating on scalable software platforms applications and taking products from zero-to-one to a level of maturity
  • Experience working with LLMs, agentic AI, and/or related AI/ML technologies
  • Experience working in highly collaborative, dynamic, and ambiguous environments
  • Experience with open source languages such as PHP, Python, Java, or JavaScript Frameworks
  • Experience communicating technical concepts to non-technical audiences
  • Experience with shipping reliable, scalable, and efficient code, with an emphasis on long-term maintainability, in partnership with all appropriate reviewers, in manageable pieces with relevant documentation and test plans
  • Willingness to travel up to 20% of the time
  • Fluency in English is required
Job Responsibility
Job Responsibility
  • Contribute to building next-gen AI products and improve existing ones in collaboration with Meta product engineering teams and cross functional partners to meet business needs
  • Understand business challenges to define and drive strategies to help businesses grow at scale
  • Design and build end-to-end systems, GTM automation, and launch-plan strategies
  • Use broad range of technical and soft skills to build productive relationships with our partners, and independently resolve complex technical and business needs
  • Guide workflow changes, and gain consensus from stakeholders while driving toward solutions
  • Respond and maintain effective communication with industry partners and internal stakeholders
  • Build and manage working relationships with technical counterparts
  • Mentor and share knowledge with peers, creating positive atmosphere amongst team
  • Conduct code reviews and provide constructive feedback while quickly actioning feedback from code reviews conducted of your code
  • Influence decision-making through presentation of data-centric business topics
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

Business Engineer - Business AI

Business Engineering is looking for impact-driven, entrepreneurial engineers rea...
Location
Location
Singapore
Salary
Salary:
Not provided
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 3+ years of experience as a software engineer building and shipping production quality code in dynamic, ambiguous environments
  • Experience with designing, building, and iterating on scalable software platforms applications and taking products from zero-to-one to a level of maturity
  • Experience with open source languages such as PHP, Python, Java, or JavaScript Frameworks
  • Experience communicating technical concepts to non-technical audiences
  • Experience with shipping reliable, scalable, and efficient code, with an emphasis on long-term maintainability, in partnership with all appropriate reviewers, in manageable pieces with relevant documentation and test plans
  • Willingness to travel up to 20% of the time
  • Fluency in English is required as this role will work closely with internal stakeholders and external customers whose usual business language is English
Job Responsibility
Job Responsibility
  • Contribute to building next-gen AI products and improve existing ones in collaboration with Meta product engineering teams and cross functional partners to meet business needs
  • Understand business challenges to define and drive strategies to help businesses grow at scale
  • Design and build end-to-end systems, GTM automation, and launch-plan strategies
  • Use broad range of technical and soft skills to build productive relationships with our partners, and independently resolve complex technical and business needs
  • Guide workflow changes, and gain consensus from stakeholders while driving toward solutions
  • Respond and maintain effective communication with industry partners and internal stakeholders
  • Build and manage working relationships with technical counterparts. Mentor and share knowledge with peers, creating positive atmosphere amongst team
  • Conduct code reviews and provide constructive feedback while quickly actioning feedback from code reviews conducted of your code
  • Influence decision-making through presentation of data-centric business topics
  • Serve as a subject matter expert within Business Engineering and provide consultation on domain-level projects
Read More
Arrow Right

Business Engineer - Business AI

Business Engineering is looking for impact-driven, entrepreneurial engineers rea...
Location
Location
Singapore
Salary
Salary:
Not provided
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • 5+ years of experience as a software engineer building and shipping production quality code in dynamic, ambiguous environments
  • Experience with designing, building, and iterating on scalable software platforms applications and taking products from zero-to-one to a level of maturity
  • Experience working with LLMs, agentic AI, and/or related AI/ML technologies
  • Experience working in highly collaborative, dynamic, and ambiguous environments
  • Experience with open source languages such as PHP, Python, Java, or JavaScript Frameworks
  • Experience communicating technical concepts to non-technical audiences
  • Experience with shipping reliable, scalable, and efficient code, with an emphasis on long-term maintainability, in partnership with all appropriate reviewers, in manageable pieces with relevant documentation and test plans
  • Willingness to travel up to 20% of the time
  • Fluency in English is required as this role will work closely with internal stakeholders and external customers whose usual business language is English
Job Responsibility
Job Responsibility
  • Contribute to building next-gen AI products and improve existing ones in collaboration with Meta product engineering teams and cross functional partners to meet business needs
  • Understand business challenges to define and drive strategies to help businesses grow at scale
  • Design and build end-to-end systems, GTM automation, and launch-plan strategies
  • Use broad range of technical and soft skills to build productive relationships with our partners, and independently resolve complex technical and business needs
  • Guide workflow changes, and gain consensus from stakeholders while driving toward solutions
  • Respond and maintain effective communication with industry partners and internal stakeholders
  • Build and manage working relationships with technical counterparts
  • Mentor and share knowledge with peers, creating positive atmosphere amongst team
  • Conduct code reviews and provide constructive feedback while quickly actioning feedback from code reviews conducted of your code
  • Influence decision-making through presentation of data-centric business topics
Read More
Arrow Right

Business Engineer, Business AI

Business Engineering is looking for impact-driven, entrepreneurial engineers rea...
Location
Location
United States , Menlo Park, CA +3 locations
Salary
Salary:
118000.00 - 176000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
  • 3+ years of experience as a software engineer building and shipping production quality code in dynamic, ambiguous environments
  • Experience with designing, building, and iterating on scalable software platforms applications and taking products from zero-to-one to a level of maturity
  • Experience working with LLMs, agentic AI, and/or related AI/ML technologies
  • Experience with open source languages such as PHP, Python, Java, or JavaScript Frameworks
  • Experience communicating technical concepts to non-technical audiences
  • Experience with shipping reliable, scalable, and efficient code, with an emphasis on long-term maintainability, in partnership with all appropriate reviewers, in manageable pieces with relevant documentation and test plans
  • Willingness to travel up to 20% of the time
  • Fluency in English is required
Job Responsibility
Job Responsibility
  • Contribute to building next-gen AI products and improve existing ones in collaboration with Meta product engineering teams and cross functional partners to meet business needs
  • Understand business challenges to define and drive strategies to help businesses grow at scale
  • Design and build end-to-end systems, GTM automation, and launch-plan strategies
  • Use broad range of technical and soft skills to build productive relationships with our partners, and independently resolve complex technical and business needs
  • Guide workflow changes, and gain consensus from stakeholders while driving toward solutions
  • Respond and maintain effective communication with industry partners and internal stakeholders
  • Build and manage working relationships with technical counterparts. Mentor and share knowledge with peers, creating positive atmosphere amongst team
  • Coding, conduct code reviews using AI assistance and provide constructive feedback while quickly actioning feedback from code reviews conducted of your code
  • Influence decision-making through presentation of data-centric business topics
  • Serve as a subject matter expert within Business Engineering and provide consultation on domain-level projects
What we offer
What we offer
  • bonus
  • equity
  • benefits
Read More
Arrow Right

Business Engineer, Business AI

Business Engineering is looking for impact-focused, entrepreneurial engineers re...
Location
Location
United States , Menlo Park
Salary
Salary:
118000.00 - 176000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
  • 3+ years experience as a software engineer building and shipping production quality code
  • Experience with designing, building, and iterating on scalable software platforms applications and taking products from zero-to-one to a level of maturity
  • Experience working with large language models, agentic AI, and/or related AI/ML technologies
  • Experience with open source languages such as PHP, Python, Java, or JavaScript Frameworks
  • Experience communicating technical concepts to non-technical audiences
  • Fluency in English is required
  • Experience with shipping reliable, scalable, and efficient code, with an emphasis on long-term maintainability, in partnership with all appropriate reviewers, in manageable pieces with relevant documentation and test plans
Job Responsibility
Job Responsibility
  • Contribute to building next-gen AI products and improve existing ones in collaboration with Meta product engineering teams and cross functional partners to meet business needs
  • Understand business challenges to define and drive strategies to help businesses grow at scale
  • Design and build end-to-end systems, GTM automation, and launch-plan strategies
  • Use broad range of technical and soft skills to build productive relationships with our partners, and independently resolve complex technical and business needs
  • Guide workflow changes, and gain consensus from stakeholders while driving toward solutions
  • Respond and maintain effective communication with industry partners and internal stakeholders
  • Build and manage working relationships with technical counterparts. Mentor and share knowledge with peers, creating positive atmosphere amongst team
  • Conduct code reviews and provide constructive feedback while quickly actioning feedback from code reviews conducted of your code
  • Influence decision-making through presentation of data-centric business topics
  • Serve as a subject matter expert within Business Engineering and provide consultation on domain-level projects
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...
Location
Location
India , Chennai, Madurai, Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
  • Excellent Python programming skills with data engineering libraries and frameworks
  • Advanced SQL capabilities including window functions, CTEs, and performance tuning
  • Solid understanding of distributed processing using Spark/PySpark
  • Experience designing and implementing scalable ETL/ELT workflows
  • Good understanding of data modeling concepts (dimensional, star, snowflake)
  • Familiarity with GenAI/LLM-based integration for data workflows
  • Experience working with Git, CI/CD, and Agile delivery frameworks
  • Strong communication skills for interacting with clients, stakeholders, and internal teams
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
  • Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
  • Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
  • Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
  • Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
  • Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
  • Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
  • Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations
What we offer
What we offer
  • Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
  • Hands-on exposure to modern data stacks and emerging AI technologies
  • Collaboration with experts across Data, AI/ML, and cloud practices
  • Access to structured learning, certifications, and leadership mentoring
  • Competitive compensation with fast-track career growth and visibility
  • Fulltime
Read More
Arrow Right

Senior Engineer - AI & Data Science

Location
Location
Poland
Salary
Salary:
15025.00 - 22500.00 PLN / Month
https://www.hsbc.com Logo
HSBC
Expiration Date
July 11, 2026
Flip Icon
Requirements
Requirements
  • Strong experience in delivering Data Science and similar solutions
  • Knowledge of ingestion and data preparation techniques, especially for use in AI solutions
  • Experience working with Cloud based APIs for Large Language Models is highly desirable
  • Very good Python skills and strong object-oriented programming concepts
  • Strong knowledge of software engineering architecture concepts for the build of multi-tier solutions that include user interfaces, data, workflow, and controls
  • Strong knowledge of technology and support practices to maintain a production grade user system, including testing practices
  • Strong experience working with developer tools and frameworks such as GitHub, Agile practices, Source control and branching concepts
  • Understanding of how Large Language Models work
  • Knowledge of web UI coding frameworks such as React, NodeJS, Angular, is desirable
  • Strong knowledge and experience of modern Agile and project management practices
Job Responsibility
Job Responsibility
  • Develop Python-based solutions for Global Finance business teams, including but not limited to Generative AI
  • Research and develop new techniques in data science, Generative AI and related areas to improve the quality of outputs
  • Perform detailed testing of prompts and data inputs and outputs
  • Maintain the codebase including frontend, backend, and algorithms in a engineering global team environment
  • Understand and implement appropriate governance and controls required
  • Face off to the business and other stakeholders, including but not limited to the business line teams, Global Finance Analytics, Transformation, Change/Project Management, IT, Governance teams
  • Contribute towards overall strategy development for the team
  • Work closely with the Quantitative Analytics teams to build software solutions that are practical, workable and comply with accounting, regulatory or other requirements
What we offer
What we offer
  • Additional bonuses for recognition awards
  • Multisport card
  • Private medical care
  • Life insurance
  • One-time reimbursement of home office set-up (up to 800 PLN)
  • Cafeteria platform
  • Employee assistance program
  • Additional contributions to PPK scheme
  • Corporate parties & events
  • CSR initiatives
  • Fulltime
Read More
Arrow Right