CrawlJobs Logo

Quality Automation Engineer - Data

India · Job Posted June 03, 2026
Apply Position
Job Link Share

Job Description

We are looking for a Data Quality Engineer to design and implement robust data quality frameworks. The ideal candidate will ensure data accuracy, consistency, and reliability across our data platforms.

Job Responsibility

  • Develop and maintain data quality checks and validation frameworks
  • Collaborate with data engineers and analysts to identify and resolve data issues
  • Monitor data pipelines for anomalies and inconsistencies
  • Implement data profiling and cleansing processes
  • Ensure adherence to data governance and compliance standards
  • Automate data quality reporting and alerting mechanisms
  • Contribute to continuous improvement of data quality practices

Requirements

  • Bachelor’s or Master’s in Computer Science, Data Engineering, or related field
  • 5–8 years of experience in data-related roles
  • Strong problem-solving and analytical skills
  • Clear communication and documentation abilities
  • Experience working in cross-functional teams
  • Databricks (PySpark, Delta Lake, SQL)
  • Snowflake
  • Azure Data Factory
  • Informatica
  • Teradata
  • CI/CD (GitHub Actions, Azure DevOps)
  • Cloud Platforms (Azure, AWS, GCP)
  • Python
  • SQL
  • Data Governance
  • Data Modeling
  • Streaming (Kafka, Event Hub)
  • Unity Catalog

Nice to have

  • Experience with ML pipelines (MLflow, Feature Store)
  • Knowledge of visualization tools (Power BI, Tableau, Looker)
  • Exposure to Graph databases (Neo4j) or RAG/LLM pipelines
  • Containerization (Docker, Kubernetes)
  • Basic front-end knowledge (React/Angular)
  • Microservices (FastAPI/Flask)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Quality Automation Engineer - Data

8 matching positions

Data Control & Data Quality Engineer

As a Data Quality Engineer, you will play a key role in the design, build, confi...
Location
Location
Egypt
Salary
Salary:
Not provided
coca-colahellenic.com Logo
Coca-Cola HBC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years in data engineering / analytics engineering / data quality engineering
  • Strong SQL and Python for scalable data validation and monitoring
  • Experience working with Databricks and modern data pipelines (ADF or similar)
  • Strong analytical and problem-solving mindset with attention to detail and quality
  • Ability to translate business requirements into technical implementation and measurable outcomes
  • Comfortable working across multiple stakeholders in a cross-functional environment
  • Strong communication skills and ability to explain technical topics to non-technical audiences
  • Ownership mindset: proactive, reliable and continuously improving solutions
  • SQL
  • Python
Job Responsibility
Job Responsibility
  • Build, configure and maintain Data Quality controls in the Data Control Center (DCC)
  • Translate business requirements into data quality rules, including logic definition, thresholds, exception handling and reduction of false positives
  • Ensure DQ controls are aligned with agreed business definitions and standards
  • Monitor DQ performance and ensure stable DCC operations, including regular refresh cycles and system reliability
  • Troubleshoot failed checks, investigate data issues and perform root-cause analysis in collaboration with relevant stakeholders
  • Support incident resolution and contribute to continuous operational improvements
  • Implement improvements to existing DQ checks and contribute to the continuous enhancement of DCC capabilities
  • Identify opportunities to improve automation, scalability and reusability of controls and monitoring processes
  • Identify opportunities to automate monitoring and reduce manual effort for stakeholders
  • Develop and maintain DQ dashboards and scorecards, enabling visibility of DQ KPIs, trends and drilldowns
What we offer
What we offer
  • Equal opportunity employer
  • IT Equipment
  • Medical Insurance
  • Work with iconic brands
  • Supportive team
  • Volunteering Opportunities
  • Wellbeing program
Read More
Arrow Right

Data Governance & Data Quality Platform Engineer

We are seeking a Data Governance & Data Quality Platform Engineer to own the tec...
Location
Location
United States , Houston
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Data Engineering, or a related field
  • Hands‑on experience administering data governance and data quality platforms (e.g., Atlan, Monte Carlo, DQ tools), including API‑based integrations
  • Strong understanding of data catalogs, data lineage, and metadata management
  • Solid knowledge of data governance principles and data quality frameworks
  • Familiarity with Data Mesh concepts and decentralized data ownership models
  • Experience building data products and supporting orchestration workflows
Job Responsibility
Job Responsibility
  • Configure and maintain data governance platforms for metadata management, data lineage, and governance workflows
  • Configure data quality tools for profiling, rule creation, and monitoring dashboards
  • Manage platform security, including user roles, authentication, SSO, RBAC, and access controls
  • Develop and maintain integrations across data sources, databases, data lakes, and BI tools
  • Automate metadata ingestion and data quality checks using APIs, Python scripts, or ETL frameworks
  • Configure and maintain connectors for analytics and reporting platforms
  • Monitor platform health and optimize performance and scalability
  • Apply upgrades, patches, and troubleshoot technical issues
  • Implement logging, alerting, and proactive monitoring for governance and data quality environments
  • Provide Tier 3 support for platform‑related incidents and escalations
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Quality Automation Engineer

Location
Location
Iceland , Reykjavik
Salary
Salary:
Not provided
tripadvisor.com Logo
Tripadvisor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience as an SDET / Quality Engineer with a focus on frameworks and tooling, not just test implementation
  • Excellent programming skills in TypeScript / JavaScript
  • Proven experience designing and maintaining test frameworks at scale
  • Hands-on experience with modern automation tools (Playwright preferred)
  • Strong understanding of test architecture patterns (test pyramid, separation of concerns, isolation strategies)
  • Experience enabling teams through libraries, SDKs, or shared tooling
  • Solid experience with CI/CD systems (e.g., Jenkins), including pipeline optimization and debugging
  • Experience with API testing (REST/GraphQL) and designing reusable testing layers
  • Strong problem-solving skills focused on root cause analysis and systemic improvements
  • Comfortable working cross-team and acting as a technical reference for quality
Job Responsibility
Job Responsibility
  • Design, build, and evolve test automation frameworks and internal tooling (Playwright + TypeScript as primary stack)
  • Act as owner of the test ecosystem, including repositories, architecture, and long-term maintainability
  • Define and enforce testing standards, guidelines, and best practices across engineering teams
  • Enable developers to write effective tests by providing abstractions, utilities, and reusable components
  • Drive test architecture decisions (structure, layering, fixtures, data handling, isolation strategies)
  • Collaborate with teams to improve testability of systems (APIs, frontend, data flows) without directly owning feature tests
  • Own and optimize CI/CD test pipelines (e.g., Jenkins), focusing on speed, reliability, and scalability
  • Identify systemic issues (flakiness, instability, slow feedback loops) and implement structural solutions, not patches
  • Design and maintain test data management and environment orchestration strategies
  • Define, implement, and evolve quality gates and metrics (coverage, reliability, execution time, signal quality)
What we offer
What we offer
  • An awesome team
  • A permanent contract
  • Flexible working environment (2 days home office per week plus up to 4 total weeks additional flexibility during the summer period and in December to work fully remotely)
  • Competitive fixed salary and bonus
  • Lunch vouchers available for each working day
  • International teams and a multicultural environment spanning 10 offices across Europe
  • Highly inclusive working environment
  • Lifestyle benefits that can be used to reimburse expenses related to physical and leisure activities, family support, travel etc
  • Continuous learning and development programs
  • Free access to the Calm app
  • Fulltime
Read More
Arrow Right

Principal Automation Engineer (Data Security & Identity)

The Cortex Cloud Data Security Posture Management (DSPM) product is responsible ...
Location
Location
Israel , Tel Aviv
Salary
Salary:
Not provided
paloaltonetworks.it Logo
Palo Alto Networks Italia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience QA automation developer
  • Experience in one of the following languages – Python (Must)
  • Experience with API testing
  • Experience with cloud–native technologies like DB, Bucket, SQL, GSUITE (SaaS products)
  • Experience with designing, developing, and implementing test/applicative frameworks from scratch
  • Deeply passionate about product quality with a mindset focused on continuous improvement
  • Experience with Gitlab/Jenkins (Advantage)
Job Responsibility
Job Responsibility
  • Create detailed and well–structured test plans based on requirements and features crew meetings
  • Design and writing the infrastructure for regression / progression tests
  • Develop and execute efficient and stable automated tests
  • Identifying, reporting, documenting and tracking defect/bug issues
  • Work closely with our engineering teams to understand business requirements
  • Excellent verbal and written communication skills
  • Strong focus on customer satisfaction
Read More
Arrow Right

Data Automation Engineer

Location
Location
United States , Washington
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or related field
  • 2+ years of experience in data engineering, automation, or cloud development
  • Strong experience with Python and SQL
  • Hands-on experience with AWS services (S3, Glue, Lambda, EMR, DynamoDB)
  • Experience with data pipeline development and ETL/ELT processes
  • Familiarity with Spark, Kafka, Flume, or large-scale data processing
  • Exposure to Generative AI / LLM frameworks
  • Experience with CI/CD tools and DevOps practices
  • Strong troubleshooting, performance tuning, and problem-solving skills
  • Ability to obtain Public Trust clearance
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines using AWS services (S3, Glue, Lambda, EMR, DynamoDB)
  • Develop and optimize ETL/ELT workflows across hybrid AWS and Azure environments
  • Integrate structured, unstructured, and streaming data across enterprise systems
  • Leverage Generative AI frameworks (AWS Bedrock, Azure OpenAI, LangChain, Hugging Face) to build intelligent automation
  • Implement solutions for embeddings, vector generation, and RAG workflows
  • Develop AI-driven tools for data quality, anomaly detection, and pipeline optimization
  • Build AI-powered copilots for monitoring, troubleshooting, and workflow automation
  • Engineer real-time and batch ingestion pipelines using Spark, Kafka, and Flume
  • Integrate enterprise platforms and CRM data into data pipelines for analytics and reporting
  • Optimize SQL performance through stored procedures, indexing, and query tuning
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • enroll in our company 401(k) plan
Read More
Arrow Right

Data Automation Engineer

We are seeking a highly motivated Data Automation Engineer to design and impleme...
Location
Location
United States , Houston
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or related field
  • 2+ years of experience in data engineering, automation, or cloud development
  • Strong experience with SQL, Python, PySpark, or related scripting tools
  • Experience with Azure services (Data Factory, Synapse, Data Lake)
  • Experience building and maintaining ETL/data pipelines
  • Familiarity with Azure DevOps, GitHub, or CI/CD pipelines
  • Strong troubleshooting and performance optimization skills
  • ability to obtain Public Trust clearance
Job Responsibility
Job Responsibility
  • Design and implement data pipelines using Azure Data Factory, Synapse, Spark, SQL, and Python
  • Build and maintain ETL/ELT workflows across structured and unstructured data sources
  • Support data ingestion, transformation, and integration for enterprise analytics platforms
  • Develop automation solutions to improve efficiency, scalability, and reliability of data workflows
  • Research and implement AI/ML and Generative AI tools to enhance data processing and insights
  • Eliminate bottlenecks through intelligent automation and workflow optimization
  • Implement data quality, integrity, and metadata management practices
  • Monitor and troubleshoot pipelines to ensure high availability and performance
  • Perform performance testing, tuning (query optimization, indexing), and pipeline benchmarking
  • Partner with engineering, DevOps, and business stakeholders to develop solutions
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Quality Engineer

Location
Location
United States , Wayne
Salary
Salary:
120000.00 - 130000.00 USD / Year
bhsg.com Logo
Beacon Hill
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Snowflake or Google BigQuery
  • Azure DevOps a must (Test Plans) – reporting how many test cases pass/fail
  • Strong understanding of Medallion or Lakehouse architecture and Data Engineering core concepts
  • SQL experience a must – hands-on writing queries
  • Understanding of repeatable processes turned into Automation. Use Python, SQL, Azure DevOps to automate anything that is repeatable process.
  • 7+ years of experience in Data QA/testing
  • Strong proficiency in Python and SQL for test automation.
  • Solid understanding of data governance, PII compliance, and data quality frameworks.
  • Background in CI/CD pipelines, DevOps practices, and cloud-based data platforms.
Job Responsibility
Job Responsibility
  • Design and execute test plans, automation, and defect tracking for ELT/ETL pipelines, payer data, APIs, and reporting measures.
  • Develop and implement QA automation frameworks for Databricks, ADF, and CI/CD workflows.
  • Embed automated quality checks, schema validation, and reconciliation logic across data pipelines and deployments.
  • Use Python, SQL, Azure DevOps to automate anything that is repeatable process.
  • Collaborate with engineering and governance teams to ensure end-to-end data quality, leveraging PySpark, SQL, and Python.
  • Ensure compliance with HIPAA, CMS, and industry standards, documenting QA processes and delivering audit-ready evidence.
  • Fulltime
Read More
Arrow Right

Data Automation Engineer

We are seeking a delivery-focused Data Automation Engineer to design and impleme...
Location
Location
United States , Houston
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science or related field
  • 2+ years of experience with SQL, T-SQL, DAX/MDX, Python, or PySpark
  • Experience designing and building ETL solutions within cloud environments
  • Hands-on experience with Azure Data Factory, Synapse, or Azure Data Lake
  • Experience with Microsoft BI tools including SQL Server, SSIS, SSRS, SSAS, or Power BI
  • Familiarity with Azure/AWS CLI automation using Bash or PowerShell
  • Experience with Git or Azure DevOps for release/version management
  • Experience working in Agile environments
  • Ability to obtain a Public Trust clearance required
Job Responsibility
Job Responsibility
  • Develop high-performance data pipelines using Azure Data Factory, Synapse Pipelines, Spark Notebooks, Python, and SQL
  • Design ETL workflows supporting advanced analytics, reporting, and AI/ML use cases
  • Implement data migration, integrity, quality, metadata, and security controls across pipelines
  • Monitor, troubleshoot, and optimize pipelines for availability, scalability, and performance
  • Execute ETL performance testing and validate load performance against benchmarks
  • Analyze pipeline runtime, throughput, latency, and resource utilization
  • Support tuning activities (e.g., query optimization, partitioning, indexing)
  • Validate data completeness and consistency after high-volume processing
  • Collaborate with DevOps and infrastructure teams to optimize compute, memory, and scaling
  • Maintain versioning and configuration control across environments
What we offer
What we offer
  • Medical
  • Vision
  • Dental
  • Life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right