Data Quality Engineer Job at Beacon Hill (Wayne)

Data Quality Engineer

We are looking for one Data Quality Engineer responsible for designing, implemen...

Location

India , Noida

Salary:

Not provided

Sopra Steria

Expiration Date

Until further notice

Requirements

9+ years of experience in design and implement data quality frameworks to assess data accuracy, consistency, completeness, and validity
Strong experience of defining, documenting, and managing Data quality rules, metrics, and thresholds for key data domains
Strong experience of implementing automated validation and reconciliation processes across source and target systems
Strong expertise in Snowflake
Good Knowledge of SQL, and Data testing
In-depth knowledge of Data Governance, Sifflets, Data Quality, and MDM frameworks
Experience of working with Python
BE / B.Tech/ MS/ M.Tech/ MCA
Excellent documentation skills
Strong stakeholder management and Communication skills

Job Responsibility

Designing, implementing, and maintaining Data quality frameworks, validation processes, and monitoring solutions
Ensuring accuracy, completeness, and consistency of enterprise data
Collaborating with Data Architects, Data stewards, and Data Governance teams
Automating data validation
Resolving data anomalies
Building trust in Data products
Providing operational monitoring and reporting on data quality through tools and indicators
Onboarding Data products
Supporting users in ensuring consistency, facilitating adoption and maintaining features backlog
Configuring quality rules, managing dashboards/KPIs, and running monitoring checks

What we offer

Commitment to fighting against all forms of discrimination
Inclusive and respectful work environment
Open to people with disabilities

Fulltime

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...

Location

India , Chennai, Madurai, Coimbatore

Salary:

Not provided

OptiSol Business Solutions

Expiration Date

Until further notice

Requirements

Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
Excellent Python programming skills with data engineering libraries and frameworks
Advanced SQL capabilities including window functions, CTEs, and performance tuning
Solid understanding of distributed processing using Spark/PySpark
Experience designing and implementing scalable ETL/ELT workflows
Good understanding of data modeling concepts (dimensional, star, snowflake)
Familiarity with GenAI/LLM-based integration for data workflows
Experience working with Git, CI/CD, and Agile delivery frameworks
Strong communication skills for interacting with clients, stakeholders, and internal teams

Job Responsibility

Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations

What we offer

Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
Hands-on exposure to modern data stacks and emerging AI technologies
Collaboration with experts across Data, AI/ML, and cloud practices
Access to structured learning, certifications, and leadership mentoring
Competitive compensation with fast-track career growth and visibility

Fulltime

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...

Location

United Arab Emirates , Dubai

Salary:

Not provided

NorthBay

Expiration Date

Until further notice

Requirements

8+ years of experience in data engineering and data platform development
Strong hands-on experience with: AWS Glue
Amazon EMR (Spark)
AWS Lambda
Apache Airflow (MWAA)
Amazon EC2
Amazon CloudWatch
Amazon Redshift
Amazon DynamoDB
AWS DataZone

Job Responsibility

Design, develop, and optimize scalable data pipelines using AWS native services
Lead the implementation of batch and near-real-time data processing solutions
Architect and manage data ingestion, transformation, and storage layers
Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
Orchestrate complex data workflows using Apache Airflow (MWAA)
Develop and manage serverless data processing using AWS Lambda
Design and optimize data warehouses using Amazon Redshift
Implement and manage NoSQL data models using Amazon DynamoDB
Utilize AWS DataZone for data governance, cataloging, and access management
Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch

Fulltime

Software Engineer - Data Engineering

Akuna Capital is a leading proprietary trading firm specializing in options mark...

Location

United States , Chicago

Salary:

130000.00 USD / Year

AKUNA CAPITAL

Expiration Date

Until further notice

Requirements

BS/MS/PhD in Computer Science, Engineering, Physics, Math, or equivalent technical field
5+ years of professional experience developing software applications
Java/Scala experience required
Highly motivated and willing to take ownership of high-impact projects upon arrival
Prior hands-on experience with data platforms and technologies such as Delta Lake, Spark, Kubernetes, Kafka, ClickHouse, and/or Presto/Trino
Experience building large-scale batch and streaming pipelines with strict SLA and data quality requirements
Must possess excellent communication, analytical, and problem-solving skills
Recent hands-on experience with AWS Cloud development, deployment and monitoring necessary
Demonstrated experience working on an Agile team employing software engineering best practices, such as GitOps and CI/CD, to deliver complex software projects
The ability to react quickly and accurately to rapidly changing market conditions, including the ability to quickly and accurately respond and/or solve math and coding problems are essential functions of the role

Job Responsibility

Work within a growing Data Engineering division supporting the strategic role of data at Akuna
Drive the ongoing design and expansion of our data platform across a wide variety of data sources, supporting an array of streaming, operational and research workflows
Work closely with Trading, Quant, Technology & Business Operations teams throughout the firm to identify how data is produced and consumed, helping to define and deliver high impact projects
Build and deploy batch and streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK and Databricks/Spark
Mentor junior engineers in software and data engineering best practices
Produce clean, well-tested, and documented code with a clear design to support mission critical applications
Build automated data validation test suites that ensure that data is processed and published in accordance with well-defined Service Level Agreements (SLA’s) pertaining to data quality, data availability and data correctness
Challenge the status quo and help push our organization forward, as we grow beyond the limits of our current tech stack

What we offer

Discretionary performance bonus
Comprehensive benefits package that may encompass employer-paid medical, dental, vision, retirement contributions, paid time off, and other benefits

Fulltime

Data Quality Lead Analyst

The Data Quality Lead Analyst is a strategic professional who stays abreast of d...

Location

Canada , Mississauga

Salary:

94300.00 - 141500.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

5-8 years software experience preferred
High proficiency in MS Excel, Python, SQL for Data analysis
Ability to create BI tools such as Qlikview and/or Tableau views for analysis
Problem Solving - Evaluates moderately complex and variable issues with substantial potential impact
Good analytical skills to filter, prioritize and validate potentially complex and dynamic material from multiple sources
Outstanding written and oral communication, influencing and presentation skills
A self-starter with ability to independently manage work and drive multiple deliverables concurrently
Strong subject matter expertise regarding technology application control disciplines and technology infrastructure knowledge
Demonstrated capability and maturity to work in an individual capacity
Demonstrates experience in managing teams and managing integrated internal audit and assurance delivery

Job Responsibility

Devises methods for identifying data patterns and trends in available data sources
Defines strategies to drive data quality measurement, produce data quality dashboards and reports, and implement data quality strategies to effectively govern data and improve data quality
Works with data quality partners and Technology teams to identify and implement data quality tools
Identify critical data elements, data quality rules, thresholds, and other business requirements
Mentors junior analysts
Applies in-depth understanding and knowledge of how business integrates within the sub function
Contributes to the development of new techniques and processes and for the aligned business
Integrates subject matter and industry expertise within a defined area
Responsible for own work to support business teams in assigned area
Build data quality assessments and measurement of critical data utilized by Citi strategic systems and processes

Fulltime

Engineering Manager, Mobile Quality Engineering

The Quality Engineering team helps Airbnb build high quality software efficientl...

Location

Brazil , São Paulo

Salary:

Not provided

Airbnb

Expiration Date

Until further notice

Requirements

3+ years of engineering management
7+ years of industry experience with a strong focus on iOS and/or Android developer tooling, testing, or quality engineering
Strong familiarity with software engineering principles, including object-oriented and functional programming paradigms, design patterns, and code quality practices
Hands-on technical leadership leading multiple teams and setting technical direction
Led projects with notable risk and complexity
develops the strategy for project execution
Proven experience leading distributed or regional engineering teams and driving technical outcomes
Skilled in mentoring engineers and creating strong team dynamics across cultural and geographic boundaries
Be an agent of change inside the organization and be comfortable leading through ambiguity
Excellent communication and collaboration skills, with the ability to align local execution to a global strategy

Job Responsibility

Define and promote a quality mindset and strategy across the organization, by creating a vision that drives QE policies, programs and initiatives
Hire and retain a team of high-performing engineers
empower the team to achieve a high level of productivity, reliability and simplicity
Drive a sense of trust and belonging, and build inclusive teams with world class talent
Build and maintain our testing environments, testing data, and testing frameworks, working through ambiguity, concept validation and implementation of a best-in-class solution
Collaborate with cross-functional stakeholders to analyze internal/external failures, and suggest corrective and preventive action
Use a data-based approach to help resolve internal quality issues to prevent defects in code shipment
Partner with global Infra leadership to execute the Brazil site’s technical roadmap
Drive excellence in technical design, reliability, scalability, and efficiency across projects
Collaborate cross-functionally with global teams to ensure alignment on architecture, tooling, and standards

Senior Data Engineering Architect

Location

Poland

Salary:

Not provided

Lingaro

Expiration Date

Until further notice

Requirements

Proven work experience as a Data Engineering Architect or a similar role and strong experience in in the Data & Analytics area
Strong understanding of data engineering concepts, including data modeling, ETL processes, data pipelines, and data governance
Expertise in designing and implementing scalable and efficient data processing frameworks
In-depth knowledge of various data technologies and tools, such as relational databases, NoSQL databases, data lakes, data warehouses, and big data frameworks (e.g., Hadoop, Spark)
Experience in selecting and integrating appropriate technologies to meet business requirements and long-term data strategy
Ability to work closely with stakeholders to understand business needs and translate them into data engineering solutions
Strong analytical and problem-solving skills, with the ability to identify and address complex data engineering challenges
Proficiency in Python, PySpark, SQL
Familiarity with cloud platforms and services, such as AWS, GCP, or Azure, and experience in designing and implementing data solutions in a cloud environment
Knowledge of data governance principles and best practices, including data privacy and security regulations

Job Responsibility

Collaborate with stakeholders to understand business requirements and translate them into data engineering solutions
Design and oversee the overall data architecture and infrastructure, ensuring scalability, performance, security, maintainability, and adherence to industry best practices
Define data models and data schemas to meet business needs, considering factors such as data volume, velocity, variety, and veracity
Select and integrate appropriate data technologies and tools, such as databases, data lakes, data warehouses, and big data frameworks, to support data processing and analysis
Create scalable and efficient data processing frameworks, including ETL (Extract, Transform, Load) processes, data pipelines, and data integration solutions
Ensure that data engineering solutions align with the organization's long-term data strategy and goals
Evaluate and recommend data governance strategies and practices, including data privacy, security, and compliance measures
Collaborate with data scientists, analysts, and other stakeholders to define data requirements and enable effective data analysis and reporting
Provide technical guidance and expertise to data engineering teams, promoting best practices and ensuring high-quality deliverables. Support to team throughout the implementation process, answering questions and addressing issues as they arise
Oversee the implementation of the solution, ensuring that it is implemented according to the design documents and technical specifications

What we offer

Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites
Workation. Enjoy working from inspiring locations in line with our workation policy
Great Place to Work® certified employer
Flexibility regarding working hours and your preferred form of contract
Comprehensive online onboarding program with a “Buddy” from day 1
Cooperation with top-tier engineers and experts
Unlimited access to the Udemy learning platform from day 1
Certificate training programs. Lingarians earn 500+ technology certificates yearly
Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly
Grow as we grow as a company. 76% of our managers are internal promotions

Data Engineer, Enterprise Data, Analytics and Innovation

Are you passionate about building robust data infrastructure and enabling innova...

Location

United States

Salary:

110000.00 - 125000.00 USD / Year

Vaniam Group

Expiration Date

Until further notice

Requirements

5+ years of professional experience in data engineering, ETL, or related roles
Strong proficiency in Python and SQL for data engineering
Hands-on experience building and maintaining pipelines in a lakehouse or modern data platform
Practical understanding of Medallion architectures and layered data design
Familiarity with modern data stack tools, including: Spark or PySpark
Workflow orchestration (Airflow, dbt, or similar)
Testing and observability frameworks
Containers (Docker) and Git-based version control
Excellent communication skills, problem-solving mindset, and a collaborative approach

Job Responsibility

Design, build, and operate reliable ETL and ELT pipelines in Python and SQL
Manage ingestion into Bronze, standardization and quality in Silver, and curated serving in Gold layers of our Medallion architecture
Maintain ingestion from transactional MySQL systems into Vaniam Core to keep production data flows seamless
Implement observability, data quality checks, and lineage tracking to ensure trust in all downstream datasets
Develop schemas, tables, and views optimized for analytics, APIs, and product use cases
Apply and enforce best practices for security, privacy, compliance, and access control, ensuring data integrity across sensitive healthcare domains
Maintain clear and consistent documentation for datasets, pipelines, and operating procedures
Lead the integration of third-party datasets, client-provided sources, and new product-generated data into Vaniam Core
Partner with product and innovation teams to build repeatable processes for onboarding new data streams
Ensure harmonization, normalization, and governance across varied data types (scientific, engagement, operational)

What we offer

100% remote environment with opportunities for local meet-ups
Positive, diverse, and supportive culture
Passionate about serving clients focused on Cancer and Blood diseases
Investment in you with opportunities for professional growth and personal development through Vaniam Group University
Health benefits – medical, dental, vision
Generous parental leave benefit
Focused on your financial future with a 401(k) Plan and company match
Work-Life Balance and Flexibility
Flexible Time Off policy for rest and relaxation
Volunteer Time Off for community involvement

Fulltime

Select Country

Data Quality Engineer

Job Responsibility

Requirements

Looking for more opportunities?

Data Quality Engineer

Data Quality Engineer

Senior Data Engineer – Data Engineering & AI Platforms

Senior AWS Data Engineer / Data Platform Engineer

Software Engineer - Data Engineering

Data Quality Lead Analyst

Engineering Manager, Mobile Quality Engineering

Senior Data Engineering Architect

Data Engineer, Enterprise Data, Analytics and Innovation

Our AI answers in your language