Senior Data Engineer Job at Solas IT Recruitment (Dublin)

New

Senior Data Engineer

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

5–8 Years Experience
Apache Iceberg
Python
SQL
Data Modeling
ETL/ELT
AWS Data Services

Job Responsibility

Build governed data products using Apache Iceberg
Develop scalable ingestion pipelines
Implement data validation, reconciliation, and lineage
Maintain schema evolution and auditing capabilities
Integrate structured and unstructured datasets
Enable analytics and AI consumption
Optimize storage and query performance
Support data governance initiatives

New

Senior Data Engineer

As Senior Data Engineer you will be responsible for designing, building, maintai...

Location

Portugal , Lisbon

Salary:

35571.65 - 48126.35 EUR / Year

Amgen

Expiration Date

Until further notice

Requirements

Bachelor's degree and 3 to 5 years of Computer Science, IT or related field experience
Proficiency in Python, PySpark, and Scala for data processing and ETL (Extract, Transform, Load) workflows, with hands-on experience in using Databricks for building ETL pipelines and handling big data processing
Experience with data warehousing platforms such as Amazon Redshift, or Snowflake
Strong knowledge of SQL and experience with relational (e.g., PostgreSQL, MySQL) databases
Familiarity with big data frameworks like Apache Hadoop, Spark, and Kafka for handling large datasets
Experienced with software engineering best-practices, including but not limited to version control (GitLab, Subversion, etc.), CI/CD (Jenkins, GITLab etc.), automated unit testing, and Dev Ops

Job Responsibility

Design, develop, and maintain data solutions for data generation, collection, and processing
Be a key team member that assists in design and development of the data pipeline
Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
Implement data security and privacy measures to protect sensitive data
Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
Collaborate and communicate effectively with product teams

What we offer

Work That Matters – Build tech that accelerates scientific breakthroughs and helps patients worldwide
Modern Tech Stack – Cloud-first, automation-focused, AI-powered
Global Scale, Agile Mindset – Collaborate across continents while working in nimble, high-impact teams
Continuous Learning – Access to certifications, trainings, mentorship, and career mobility
AMGEN Total Rewards Plan – Comprehensive benefits in healthcare, finance, and well-being
Flexibility – Hybrid work model with time split between our Lisbon office and remote work

Fulltime

New

Senior Data Engineer

Radancy’s Data Engineering team is seeking a Senior Data Engineer to join our Ba...

Location

India , Bengaluru

Salary:

Not provided

Radancy

Expiration Date

Until further notice

Requirements

4-6 years of experience in data engineering, including strong hands-on experience with SQL, Python, and data modeling
Experience building and optimizing data pipelines using Apache Airflow or similar orchestration tools
Strong experience with cloud data platforms such as Google BigQuery, Amazon Redshift, Databricks, Snowflake, or similar technologies
Experience working with large-scale structured and semi-structured datasets
Familiarity with distributed data processing technologies such as Spark, Kafka, or similar frameworks
Experience with data quality, data validation, pipeline monitoring, and automated testing practices
Exposure to Generative AI tools such as OpenAI, Gemini, GitHub Copilot, Cursor, or similar tools is strongly preferred
Ability to use AI-assisted or agentic development tools to improve productivity, troubleshoot issues, generate tests, and accelerate delivery
Experience with Machine Learning, MLOps, predictive analytics, or AI-powered analytics is a plus
Experience building datasets or platforms that support analytics products, conversational insights, data agents, or business intelligence solutions is a plus

Job Responsibility

Design, develop, and optimize data models, schemas, and datasets for cloud-based data platforms
Build, optimize, and maintain reliable data pipelines using Python, SQL, Airflow, and cloud data technologies
Ingest, transform, aggregate, and curate data from diverse internal and external sources to create high-quality datasets for analytics, reporting, AI, and agentic solutions
Work with domain experts, product teams, analytics teams, and engineering stakeholders to understand business needs and translate them into scalable data solutions
Support the development of Insights Agents and Data Agents that help users ask questions, generate insights, summarize trends, and make data-driven decisions
Develop AI-assisted and agentic solutions that generate actionable insights, business narratives, and compelling data stories from structured and semi-structured data
Use agentic software development tools and Generative AI tools to improve engineering productivity, including code generation, test creation, documentation, data validation, troubleshooting, and workflow automation
Continuously improve pipeline performance, reliability, observability, and cost efficiency through optimization, automation, and proactive monitoring
Build and maintain data quality frameworks, automated tests, validation checks, and monitoring processes to ensure trustworthy data
Collaborate with global engineering teams to define standards for data collection, modeling, governance, and AI-readiness

Fulltime

New

Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, build, and opt...

Location

Kosovo

Salary:

Not provided

Valtech

Expiration Date

Until further notice

Requirements

Strong hands-on experience with Apache Spark and Delta Lake
strong programming skills in Python and SQL
Proven experience building batch and streaming data pipelines and production-grade data platforms
solid understanding of data modeling, data quality, and governance principles
Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP
Familiarity with modern data platforms such as Databricks and Snowflake
Experience with lakehouse architectures and distributed data systems
strong understanding of scalability, reliability, and performance considerations in data pipelines
Strong problem-solving skills focused on scalability and reliability
collaborative approach to working in cross-functional teams

Job Responsibility

Design and implement scalable data platforms and pipelines across cloud environments (Azure/Fabric, AWS, GCP, Databricks, Snowflake)
developing reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
building ingestion, transformation, and curation workflows for both structured and unstructured data
implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold)
deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems
enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows)
design scalable logical and physical data models for analytical and operational use cases
orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents
apply modern architecture patterns including event-driven and streaming architectures
ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC)

What we offer

Health insurance that guarantees fast access to contracted health services
Vacation Plan
Subsidy for study materials, trainings, conferences and events that will contribute to your development
Hybrid Working model
Performance Evaluation Process that paves the roadmap for a personal and professional career development
Refreshments and fruit in the office
Team gatherings and parties organized and subsidized by the company

Fulltime

Senior Data Engineer

We are looking for a Senior Data Engineer to join a growing data team supporting...

Location

United States , Boston

Salary:

Not provided

Robert Half

Expiration Date

Until further notice

Requirements

5+ years of hands-on experience in data engineering or a closely related field
Strong hands-on expertise with SQL, including advanced query development and performance optimization
Experience building ETL/ELT workflows for large and varied datasets in production environments
Proficiency with Azure Databricks and Azure Data Factory for cloud-based data processing and orchestration
Working knowledge of Python for data engineering, automation, or pipeline development
Ability to work with multiple data domains, such as healthcare, financial, marketing, or other regulated and high-volume data types
Strong communication skills and the ability to collaborate effectively with technical teams, analytics partners, and business stakeholders

Job Responsibility

Design, build, and maintain robust data pipelines that ingest, transform, and organize information from multiple sources for downstream analytics use
Develop scalable data engineering solutions using Databricks, Azure Data Factory, SQL, and Python within a cloud-based architecture
Integrate and prepare diverse datasets, including patient-related, clinical, financial, and marketing data, to support reporting and business insights
Collaborate with business intelligence partners to deliver clean, dependable datasets that power dashboards, reporting, and decision-making for leadership teams
Write efficient SQL and transformation logic to solve complex data challenges and improve the performance and reliability of existing workflows
Partner with architects and cross-functional stakeholders to define data models, engineering standards, and best practices across the platform
Monitor pipeline health, troubleshoot data issues, and implement improvements that strengthen data quality, accuracy, and operational stability
Contribute as a senior member of a small engineering team by sharing technical guidance, communicating clearly, and supporting long-term platform growth

What we offer

medical
vision
dental
life and disability insurance
company 401(k) plan
free online training

Senior Data Engineer

Location

United States , Remote City

Salary:

96000.00 - 192000.00 USD / Year

Beretta Clima Italia

Expiration Date

Until further notice

Requirements

Bachelor's degree
5+ years of experience in data engineering
5+ years of experience in open lakehouse architecture in Azure, GCP, AWS and/or Snowflake
5+ years of experience creating automated data pipelines and performing data modeling
5+ years of experience writing SQL, Python, and modern ETL/ELT frameworks

Job Responsibility

Design, build, and optimize data ingestion, transformation, and delivery pipelines that support batch, micro-batch, and streaming workloads
Develop ETL/ELT workflows that integrate data from enterprise systems, operational platforms, external sources, and commercial applications
Implement scalable data processing patterns that support open lakehouse architectures and medallion-layered data products
Ensure pipelines are reliable, maintainable, cost-efficient, and aligned with enterprise engineering standards
Design data models that support analytics, reporting, and data product consumption across raw, refined, and curated layers
Apply medallion architecture principles to ensure data quality, reusability, and consistency across domains
Contribute to architectural decisions that balance performance, scalability, governance, and operational simplicity
Support integration of ERP and enterprise systems, ensuring data consistency and alignment with business processes
Implement data quality checks, validation rules, and monitoring frameworks to ensure accuracy and reliability
Apply foundational data governance practices including lineage, metadata management, cataloging, and access controls

What we offer

Health Care Benefits: Medical, Dental, Vision
Wellness incentives
Retirement Benefits
Time off and Leave: Paid vacation days, up to 15 days
paid sick days, up to 5 days
paid personal leave, up to 5 days
paid holidays, up to 13 days
birth and adoption leave
parental leave
family and medical leave

Fulltime

Senior Data Engineer

Location

United States , Los Angeles

Salary:

184558.00 - 208000.00 USD / Year

VideoAmp

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or a related field, plus 5 years of experience
5 years of experience with Data Engineering
5 years of experience developing Production-Grade Software
5 years of experience with SQL
5 years of experience with Data Pipeline Orchestration
3 years of experience with Modern Engineering Stack/Tools
Must also have the authority to work permanently in the U.S.

Job Responsibility

Apply fluency in SQL to analyze and model complex linear viewership data
Develop data infrastructure processing and serving software, primarily written in Python
Build ETL/ELT streaming and batch pipelines on big data platforms and frameworks, including Snowflake, Spark, and Databricks
Orchestrating data engineering pipelines with Airflow
Apply Fluency with modern software development environments and tooling, e.g., Git, Jira, CircleCI (or similar CI/CD), Bazel
Collaborate with peers within her immediate team and across the larger engineering organization on activities that include distilling engineering designs from product requirements and data science
development of work plans
implementation, testing, productization, monitoring, and maintenance of big data infrastructure

Fulltime

Senior Data Engineer

In this vital role as Specialist / Senior Data Engineer at Amgen you will be res...

Location

India , Hyderabad

Salary:

Not provided

Amgen

Expiration Date

Until further notice

Requirements

Master's/Bachelor's degree and 8 to 13 years of Computer Science, IT or related field experience
Experience managing a team of data engineers
Experience architecting and building data and analytics solutions that extract, transform, and load data from multiple source systems
Demonstrated hands-on experience with cloud platforms (AWS) and the ability to architect cost-effective and scalable data solutions
Proficiency in Python, PySpark, SQL
Experience with dimensional data modeling
Experience working with Apache Spark, Apache Airflow
Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
Experienced with AWS or GCP or Azure cloud services
Understanding of end to end project/product life cycle

Job Responsibility

Lead and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous learning for solving complex problems of R&D division
Oversee the development of data extraction, validation, and transformation techniques, ensuring ingested data is of high quality and compatible with downstream systems
Guide the team in writing and validating high-quality code for data ingestion, processing, and transformation, ensuring resiliency and fault tolerance
Drive the development of data tools and frameworks for managing and accessing data efficiently across the organization
Oversee the implementation of performance monitoring protocols across data pipelines, ensuring real-time visibility, alerts, and automated recovery mechanisms
Coach engineers in building dashboards and aggregations to monitor pipeline health and detect inefficiencies, ensuring optimal performance and cost-effectiveness
Lead the implementation of self-healing solutions, reducing failure points and improving pipeline stability and efficiency across multiple product features
Oversee data governance strategies, ensuring compliance with security policies, regulations, and data accessibility best practices
Guide engineers in data modeling, metadata management, and access control, ensuring structured data handling across various business use cases
Collaborate with business leaders, product owners, and cross-functional teams to ensure alignment of data architecture with product requirements and business objectives

Fulltime

Select Country

Senior Data Engineer

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Our AI answers in your language