Data Governance & Data Quality Platform Engineer Job at Robert Half (Houston)

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...

Location

United Arab Emirates , Dubai

Salary:

Not provided

NorthBay

Expiration Date

Until further notice

Requirements

8+ years of experience in data engineering and data platform development
Strong hands-on experience with: AWS Glue
Amazon EMR (Spark)
AWS Lambda
Apache Airflow (MWAA)
Amazon EC2
Amazon CloudWatch
Amazon Redshift
Amazon DynamoDB
AWS DataZone

Job Responsibility

Design, develop, and optimize scalable data pipelines using AWS native services
Lead the implementation of batch and near-real-time data processing solutions
Architect and manage data ingestion, transformation, and storage layers
Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
Orchestrate complex data workflows using Apache Airflow (MWAA)
Develop and manage serverless data processing using AWS Lambda
Design and optimize data warehouses using Amazon Redshift
Implement and manage NoSQL data models using Amazon DynamoDB
Utilize AWS DataZone for data governance, cataloging, and access management
Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch

Fulltime

Data Platform Engineer (DWH / Data Management)

A global manufacturing company is seeking a Data Platform Engineer to lead the d...

Location

Japan , 東京23区,神奈川

Salary:

6000000.00 - 9000000.00 JPY / Year

Randstad

Expiration Date

March 18, 2027

Requirements

Experience in data platform / DWH / BI infrastructure development or operations
Experience with data management (data quality, governance, or cataloging)
Understanding of ETL/ELT processes and data integration
Knowledge of data architecture and data lifecycle management

Job Responsibility

Design, build, and maintain a data warehouse (DWH) integrating multiple internal data sources
Develop and implement data management frameworks (data quality, data catalog, governance)
Establish data validation, testing, and standardization processes
Manage platform operations including monitoring, backup, and recovery
Conduct technical research and evaluate new data technologies
Define and promote data management standards and best practices across the organization

What we offer

健康保険
厚生年金保険
雇用保険
土曜日
日曜日
祝日
賞与あり

Fulltime

Aws Data Engineer (Cloud Data Platform & Pipeline Specialist)

Design, develop, and maintain scalable cloud-based data pipelines using AWS serv...

Location

United States , Atlanta

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

5+ years of experience in data engineering, with strong hands-on expertise in AWS data services (Glue, EMR, S3, RDS, DataSync, DMS)
5+ years of Proven experience building and managing data pipelines (batch and streaming) in cloud environments
5+ years of Strong experience in data migration, transformation frameworks, and large-scale data replication
5+ years of Deep understanding of data modeling, data transformation, and reconciliation techniques
5+ years of Experience designing and implementing secure data access and governance (least privilege principles)
5+ years of Hands-on experience with data validation, auditing, and reconciliation processes
Familiarity with regulatory or finance data environments and reporting workloads
5+ years of Strong problem-solving skills and ability to work in a collaborative, fast-paced environment
AWS data services
data pipelines

Job Responsibility

Design, develop, and maintain scalable cloud-based data pipelines using AWS services such as Glue, EMR, S3, RDS, DataSync, and DMS
Build and optimize batch and streaming data orchestration workflows to support enterprise data platforms
Lead large-scale data migration efforts, including legacy-to-cloud transformations and replication strategies
Perform data modeling, transformation, and reconciliation to ensure high-quality, consistent datasets across systems
Implement secure data access patterns following least-privilege principles for pipelines and datasets
Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver solutions
Establish robust data validation, reconciliation, and audit mechanisms to meet regulatory and reporting requirements
Troubleshoot and optimize performance of ETL/ELT pipelines and data workflows in AWS environments
Support governance, compliance, and audit readiness for data platforms in regulated environments (finance/reporting)

Fulltime

Data Platform Engineer (Python / Golang)

You will work on a live, high-load fleet management platform that connects tens ...

Location

Poland; Ukraine

Salary:

Not provided

Intellias

Expiration Date

Until further notice

Requirements

5+ years Python backend in production
2+ years as a lead or principal on a data-heavy platform
Typed Python at depth: Pydantic, mypy/pyright, clean code and OOP principles
sets standards the team follows
AWS data services in production (must-have): Lambda, Kinesis, DynamoDB, S3, Athena/Presto or Redshift, SQS/SNS — owned and operated end-to-end, not just used
Event-driven architecture ownership — designs streaming pipelines, DLQ strategies, retry/idempotency patterns
makes the calls others follow
Data engineering at principal depth: ETL/ELT, schema validation, data contracts, data lake/warehouse architecture
defines patterns the team reuses
SQL at depth — PostgreSQL and analytical engines (Athena, Redshift)

Job Responsibility

Own data platform architecture across platform — streaming pipelines, partner integrations, and core backend services
Define and enforce backend and data engineering standards: service contracts, error handling, logging, secrets management
Own code quality and architectural consistency
Own event-driven integrations with 20+ external data partners — data contracts, ingestion, transformation, failure handling
Design and govern data models across PostgreSQL, DynamoDB, S3, and analytical systems
Define and maintain IaC architecture for owned services using Terraform
Collaborate with DevOps on deployment patterns, observability, and incident runbooks
Monitor production systems, drive alerting standards, and lead resolution of critical data incidents
Represent backend and data constraints in planning and API contract discussions — raises risks before implementation starts
Produce and maintain architecture documentation, ADRs, and onboarding materials

What we offer

Comfortable atmosphere
support for well-being
charge professional growth
equity, diversity, and inclusion

Fulltime

Data Quality Engineer

Location

United States , Wayne

Salary:

120000.00 - 130000.00 USD / Year

Beacon Hill

Expiration Date

Until further notice

Requirements

Snowflake or Google BigQuery
Azure DevOps a must (Test Plans) – reporting how many test cases pass/fail
Strong understanding of Medallion or Lakehouse architecture and Data Engineering core concepts
SQL experience a must – hands-on writing queries
Understanding of repeatable processes turned into Automation. Use Python, SQL, Azure DevOps to automate anything that is repeatable process.
7+ years of experience in Data QA/testing
Strong proficiency in Python and SQL for test automation.
Solid understanding of data governance, PII compliance, and data quality frameworks.
Background in CI/CD pipelines, DevOps practices, and cloud-based data platforms.

Job Responsibility

Design and execute test plans, automation, and defect tracking for ELT/ETL pipelines, payer data, APIs, and reporting measures.
Develop and implement QA automation frameworks for Databricks, ADF, and CI/CD workflows.
Embed automated quality checks, schema validation, and reconciliation logic across data pipelines and deployments.
Use Python, SQL, Azure DevOps to automate anything that is repeatable process.
Collaborate with engineering and governance teams to ensure end-to-end data quality, leveraging PySpark, SQL, and Python.
Ensure compliance with HIPAA, CMS, and industry standards, documenting QA processes and delivering audit-ready evidence.

Fulltime

Senior Data Platform Engineer

Join our Data Platform team at 10x Genomics to architect and implement our strat...

Location

United States , Pleasanton

Salary:

168200.00 - 227600.00 USD / Year

10x Genomics

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Information Management, or a related field, or equivalent experience
5+ years of hands-on experience in software engineering focused on data platform development, distributed systems, or enterprise integrations
Proven experience designing and implementing highly scalable data platforms on major cloud environments (e.g., AWS, GCP, or Azure)
Deep proficiency in one or more general-purpose programming languages (e.g., Python, Java, or similar)
Strong foundation in computer science fundamentals, including data structures, algorithms, and system design

Job Responsibility

Architect and implement the canonical data layer and Event-Driven Architecture (EDA) using technologies like Apache Iceberg and Kafka to decouple applications and ensure real-time data flow
Design, build, and optimize high-volume, code-first data pipelines (real-time and batch) across a large application landscape (e.g., Salesforce, Oracle, Workday)
Establish Amazon S3 as the Single Source of Truth (SSOT) and govern data using principles like the Medallion Architecture (Silver and Gold layers) and schema evolution
Develop, test, and maintain robust and scalable ELT pipelines and data models in Snowflake, including leveraging advanced features like Snowpipes, Streams, and Stored Procedures
Develop the data presentation layer for self-service analytics, including the Natural Language Query (NLQ) interface integrated with Generative AI (e.g., Bedrock)
Lead technical efforts to migrate key business domains off legacy middleware and onto the new platform, eliminating the 'Integration Bottleneck'
Define and enforce data governance, quality, and security standards across the Unified Data Platform
Collaborate with the Architecture Review Board (ARB) to promote modern approaches such as serverless computing and Domain-Driven Design
Take ownership of the full development lifecycle, from prototyping and design through deployment, monitoring, and operational excellence

What we offer

Equity grants
Comprehensive health and retirement benefit programs
Annual bonus program or sales incentive program
Health Package
Easy-to-use Benefits
Family oriented policies including parental leave
Generous Time Off
Award-Winning Workplace

Fulltime

Senior Software Engineer - Data Platform, AI Infrastructure

We are building a large-scale, productized data platform that powers critical in...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Strong programming experience in Python
Experience building and operating large-scale distributed systems
Hands-on experience with: Backend services or APIs (e.g., FastAPI, Flask, or similar)
Cloud-based infrastructure (Azure, AWS, or GCP)
Monitoring and observability systems (metrics, logging, alerting)
Experience designing systems with reliability, scalability, and operational clarity in mind
Proven ability to own and deliver production systems end-to-end
Ability to break down ambiguous problems, ask the right questions, and execute effectively

Job Responsibility

Design, build, and operate core components of a distributed data platform, including: Orchestration systems (e.g., Airflow or equivalent)
Backend services and APIs (Python/FastAPI or similar)
Monitoring, alerting, and reliability systems
Own the end-to-end lifecycle of platform components - from design through deployment, scaling, and maintenance
Ensure systems meet requirements for availability, performance, and data reliability at large scale
Define and enforce standardized patterns for infrastructure, deployment, and observability across the platform
Partner with data engineering teams to enable efficient, reliable data processing workflows
Diagnose and resolve complex issues in distributed systems, including performance bottlenecks and failure modes
Contribute to infrastructure-as-code and deployment systems to support reproducibility and operational excellence
Drive continuous improvements in system robustness, cost efficiency, and operational clarity

What we offer

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

Fulltime

Data Platform Engineer

We’re looking for a Data Platform Engineer (d/f/m) who enjoys working with data ...

Location

Germany , Berlin

Salary:

Not provided

Adevinta

Expiration Date

Until further notice

Requirements

Experience building scalable, reliable data solutions and bring a platform mindset
Solid programming skills in a JVM language or Python
Comfortable with SQL
Knowledge of cloud fundamentals and hands‑on experience (e.g., GCP, BigQuery, Dataproc, Cloud Run, IAM)
Hands‑on experience with infrastructure and operations practices and tooling (e.g., IaC (Terraform), CI/CD (GitHub Actions))
Strong data quality & governance mindset (schema evolution, data quality checks, data contracts, metadata, access control)
AI literacy and curiosity, ideally with exposure to app development and LLM integration patterns (e.g., RAG, vector stores, MCP)

Job Responsibility

Design, build, and evolve a resilient, future‑proof cloud data platform
Collaborate with Product, Data Science, and Analytics to understand needs and deliver platform capabilities
Drive operational excellence by integrating monitoring, alerting, FinOps, and observability best practices
Help us move faster on AI readiness by enabling platform integrations for AI use cases and supporting LLM‑ready data
Shape the future of our data platform by contributing to architecture discussions and code reviews
Raise our standards by standardizing services and tooling, and producing clear documentation and communication

What we offer

28 days of paid time off
€50 monthly transportation/mobility allowance
Development budget and access to coaching
Up to 12 (non-birth parent) or 20 (birth parent) weeks of fully paid parental leave
Online and offline library
Attractive base salary and participation in annual incentive plans
Work from anywhere - up to 20 days per year
24/7 Employee Assistance Programme for you and your immediate family

Fulltime

Select Country

Data Governance & Data Quality Platform Engineer

Job Description

Job Responsibility

Requirements

Nice to have

What we offer

Looking for more opportunities?