CrawlJobs Logo
Egor Logo Egor · IT - Software Development

Senior Data Engineer

Portugal, Porto Employment contract · Job Posted May 20, 2026
Apply Position
Job Link Share

Job Description

IT House is looking for a Senior Data Engineer for a direct placement with an end client in the Logistics and Transportation sector.

Job Responsibility

  • Design, develop and maintain scaleable data pipelines
  • Implement data integration processes using nifi, Airflow, Apache Kafka and Universal Messaging
  • Ensure data quality, integrity, and security throughout the data lifecycle
  • Continously explore and evaluate new technologies
  • Collaborate with BI specialists, data scientists and cloud engineers

Requirements

  • At least 5 years of experience in similar roles
  • Advanced SQL and Python skills
  • Hands-on experience with Azure and platforms such as Databricks, Teradata and Cloudera
  • Solid knowledge of modern database and cloud data architectures
  • Familiarity with Terraform, Git, CI/CD, and Agile tools such as Jira
  • Excellent English communication and stakeholder collaboration skills.

What we offer

  • Direct integration into the end clients organization
  • Contractual conditions aligned with the candidates profile and experience
  • Hybrid working model (Porto)
  • 24 vacation days per year and additional benefits
Egor - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Data Engineer

8 matching positions

New

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin
Salary
Salary:
133000.00 - 188600.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant full-time experience
  • or equivalent knowledge
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field, or equivalent practical experience.
  • Strong proficiency in Scala, Python, SQL, Spark, and Databricks, with production-quality software engineering practices.
  • Strong experience building and supporting cloud-based ETL/ELT pipelines, data platforms, and pipeline orchestration patterns for both batch and streaming operations.
  • Experience deploying machine learning models into production environments and supporting model development through operational release.
  • Strong experience with Databricks jobs, workflows, repos, Unity Catalog, and MLflow-based experimentation and model lifecycle management.
  • Experience building CI/CD pipelines with Git-based workflows, automated testing, and deployment of data or ML products.
  • Strong troubleshooting, communication, and cross-functional collaboration skills.
Job Responsibility
Job Responsibility
  • Design and develop batch and streaming ETL/ELT pipelines in Azure Databricks to support ingestion, transformation, curation, and delivery of manufacturing and enterprise data
  • Build reusable Bronze, Silver, and Gold data pipelines, data quality frameworks, and governed data products in Unity Catalog
  • Build and operationalize ML workflows for data preparation, feature engineering, model training, evaluation, deployment, batch scoring, retraining, and inference
  • Establish and maintain MLflow-based model lifecycle controls, including experiment tracking, model registration, versioning, lineage, traceability, and controlled promotion across environments
  • Implement CI/CD pipelines for data products, ML code, workflows, and deployment bundles using Git-based development practices, automated testing, and release automation
  • Build and support Databricks jobs and workflows for orchestration, scheduled execution, retraining, scoring, and downstream operational consumption
  • Improve reliability, observability, and production readiness through testing, monitoring, validation, alerting, documentation, and automation that reduce deployment risk and manual intervention
  • Partner with data scientists, data engineers, platform teams, architecture, manufacturing, and business stakeholders to productionize scalable, supportable solutions aligned to production constraints
  • Support modernization of legacy data and ML workflows into standardized cloud-native Databricks patterns and help bridge proof-of-concept work into repeatable production solutions
What we offer
What we offer
  • Medical
  • Dental
  • Vision
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Tuition assistance programs
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Ready to lead data engineering that powers critical financial decisions at scale...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience leading small to medium sized engineering teams within agile delivery environments
  • Strong expertise in at least one server-side language such as Python, Java, Kotlin or NodeJS
  • Knowledge of serverless, event-driven, and loosely coupled architectures
  • Experience designing and integrating REST APIs and third-party services
  • Commercial experience working with React or React Native and state management libraries
  • Strong experience with CI/CD tooling such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development practices
  • Proven experience working within the energy industry
  • Ability to communicate complex technical concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Leading the day-to-day engineering capability within the Finance Data Squad
  • Delivering scalable data products and software components aligned to business priorities
  • Driving quality through code reviews, testing practices, and engineering standards
  • Mentoring and developing engineers to build capability and performance
  • Collaborating with product owners, architects, and stakeholders to deliver value-focused solutions
What we offer
What we offer
  • Competitive salary
  • Potential for an annual bonus
  • Market-leading pension scheme
  • Customisable benefits including electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
  • Fulltime
!
Read More
Arrow Right
New

Senior Data Engineer

Well-known technology platform company is looking for a Senior Data Engineer to ...
Location
Location
United States , San Francisco
Salary
Salary:
155000.00 - 195000.00 USD / Year
strategicemployment.com Logo
Strategic Employment Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience
  • Strong Python development skills
  • Production experience with Airflow or other workflow orchestration tools
  • Experience building data pipelines in the public cloud (AWS, GCP, or Azure)
  • Strong communication (ex: push back, clarify, and manage expectations proactively)
Job Responsibility
Job Responsibility
  • Work directly with stakeholders to understand their data needs
  • Build and maintain production pipelines
  • Deliver high-quality data sets that drive business decisions
  • Be embedded within the business unit attending stakeholder meetings
  • Translate ambiguous requirements into technical specs
  • Manage your domain end to end
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

I'm working with a leading global hedge fund that is looking to hire a Data Deve...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software and/or data engineering experience
  • Strong development experience in Python or C#, ideally both
  • Expert-level SQL skills
  • Strong experience with relational databases, data modelling and schema design
  • Experience building ETL pipelines and data-driven applications
  • Strong problem-solving ability and a genuine interest in understanding systems end-to-end
  • Excellent communication skills and the ability to work directly with business users
Job Responsibility
Job Responsibility
  • Design and develop data models, reporting solutions and analytics platforms
  • Build and enhance ETL pipelines and data processing workflows
  • Develop applications and tooling using Python
  • Design and optimise database schemas and reporting architectures
  • Create and tune complex SQL queries for reporting, reconciliation and analytics
  • Work directly with business stakeholders to gather requirements and deliver solutions
  • Support and modernise existing reporting and analytics platforms
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Randstad has partnered with a software solutions company, building innovative an...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
15000.00 - 20000.00 MYR / Month
https://www.randstad.com Logo
Randstad
Expiration Date
August 17, 2026
Flip Icon
Requirements
Requirements
  • 7+ years of dedicated data engineering or distributed systems experience
  • Proven production experience with Apache Kafka (including ecosystem tools) and Apache Flink for real-time processing
  • Expert-level proficiency in Python for data processing and automation
  • Hands-on experience scaling modern cloud data warehouses (e.g., Snowflake, BigQuery, Redshift)
  • Strong grasp of distributed systems architecture, microservices, and modern data lakehouse patterns (e.g., Iceberg, Delta)
  • Familiarity with orchestration (e.g., Airflow), containerization (Docker, Kubernetes), and CI/CD pipelines
Job Responsibility
Job Responsibility
  • Architecture: Design fault-tolerant, petabyte-scale distributed data architectures and define company-wide data governance standards
  • Streaming: Build high-throughput, low-latency streaming pipelines using Apache Kafka and stateful Apache Flink applications
  • Data Warehousing: Integrate diverse data streams into a centralized Cloud Data Warehouse while optimizing query performance and storage costs
  • Development: Write clean, production-grade pipeline code using Python and manage end-to-end data lifecycle orchestration
  • Optimization: Troubleshoot bottlenecks in distributed systems, ensuring high availability, system uptime, and cost efficiency
  • Leadership: Provide technical mentorship to junior engineers and collaborate with cross-functional product and data science teams
What we offer
What we offer
  • Career Growth Opportunities
  • Open Communication Culture
  • Good Incentives
Read More
Arrow Right
New

Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer for an extensive 35-month c...
Location
Location
Canada , Toronto
Salary
Salary:
57.46 - 67.04 USD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
July 26, 2026
Flip Icon
Requirements
Requirements
  • 5+ years of dedicated experience in Data Engineering or Database Development for enterprise-scale solutions
  • Hands-on expertise with Azure Synapse (SQL DW), Azure Data Factory, Azure Databricks, and SQL Server 2016+
  • Proficient in SQL and Python (specifically PySpark for big data processing)
  • Proven experience implementing CI/CD pipelines using Azure DevOps
  • Demonstrated experience developing reports in Power BI
  • University degree in Computer Science or an equivalent combination of education and experience
  • Expert understanding of DW/BI implementations, data lake design, and data stewardship techniques
Job Responsibility
Job Responsibility
  • Design, develop, and document Azure Data Factory (ADF) and SSIS packages to integrate complex data from multiple source systems
  • Build and maintain Databricks notebooks and jobs using Python (PySpark) and SQL for both batch and streaming workloads
  • Implement curated, analytics-ready datasets following the Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake best practices
  • Develop complex T-SQL, stored procedures, views, triggers, and indexes to optimize performance within Azure Synapse and SQL Server environments
  • Conduct advanced data analysis to provide meaningful, data-driven insights to business stakeholders
  • Develop high-quality Power BI reports and dashboards to visualize key performance indicators and operational metrics
  • Assist in the data modeling of the data warehouse/data lake solutions to ensure scalability and alignment with business requirements
  • Design and implement rigorous data quality and cleansing processes to ensure the integrity of the enterprise data assets
  • Manage the end-to-end development lifecycle using Azure DevOps pipelines to ensure reliable and automated deployments
  • Convert business requirements into detailed technical specifications, provide accurate time estimates, and conduct knowledge transfer sessions for the team
What we offer
What we offer
  • Unmatched Stability: A 35-month contract provides rare long-term stability and the opportunity to lead a project from foundational design to mature operation
  • Enterprise Scale: Work on a massive transit data ecosystem, solving complex data problems that impact millions of users
  • Modern Cloud Stack: Deepen your expertise in the full Azure data suite, including Delta Lake, PySpark, and Synapse
  • Strategic Role: Move beyond simple coding to help model the enterprise data strategy and deliver actionable business intelligence
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are seeking Senior Data Engineers to support TCCC’s Symphony platform on a pe...
Location
Location
India , Delhi
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–10 years of hands-on data engineering experience
  • Strong understanding of Apache Spark and its core concepts
  • Proficiency in Scala and/or Java — code-first approach is mandatory
  • Advanced SQL skills
  • Hands-on experience with Azure Synapse
  • Working knowledge of GitHub for source control
  • Experience with data warehousing and multi-source data integration
  • Ability to work in an offshore delivery model
  • Must be a hands-on builder — no oversight-only profiles
  • Must be available to mobilize immediately
Job Responsibility
Job Responsibility
  • Implement and configure the Symphony platform solution for assigned market(s)
  • Develop and maintain market-specific data pipelines using Scala and SQL on Apache Spark
  • Integrate market-level marketing and data sources into the Symphony platform
  • Identify and resolve market-specific data quality issues, discrepancies, and inconsistencies
  • Support ongoing maintenance and monitoring of market-level pipelines
  • Optimize market-specific solutions for performance and scalability
  • Collaborate with the core team to ensure market implementations align with global architecture standards
  • Work within TCCC’s metadata-driven architecture — no reinvention of existing frameworks
  • Ensure pipelines are used strictly for scheduling — all ETL logic must remain in code
  • Communicate findings and technical issues clearly to the Delivery Lead and market Business Analyst
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

This role is centered on building a Centralized Data Lakehouse from scratch. The...
Location
Location
Germany , Ansbach
Salary
Salary:
Not provided
zalando.se Logo
Zalando Sverige
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience with the Databricks ecosystem (Unity Catalog, Delta Live Tables, Workflows)
  • Deep understanding of the Medallion Architecture (Bronze, Silver, Gold) and Delta Lake internals
  • Proficient in Apache Spark (PySpark) and Python for large-scale data processing
  • Several years of experience in building and maintaining scalable Streaming & Batch pipelines, specifically using CDC (Change Data Capture) from RDBMS (e.g., MySQL/BinLogs)
  • Familiar with Infrastructure as Code (Terraform), Docker, Git (trunk-based development), and DevOps principles
  • Ability to translate complex business requirements into robust, de-normalized data models optimized for Lakehouse performance
  • Good understanding of Cloud Infrastructure (AWS), REST APIs, and secure data exchange
  • Excellent verbal and written communication skills in English and the ability to accurately document designs and processes
  • Experience in aligning data strategies within a larger group ecosystem (like Zalando)
Job Responsibility
Job Responsibility
  • Take end-to-end responsibility for our Data Refinery – from ingestion (CDC) to providing business-ready data products in the Gold layer
  • Design, build, and maintain scalable ELT pipelines using Databricks Delta Live Tables (DLT)
  • Liaise with the owners of source systems (e.g., TB.One) to define and align Data Contracts
  • Implement and oversee Data Governance and security standards within the Unity Catalog
  • Perform technical analysis and root cause analysis to improve data quality and pipeline reliability
  • Build and maintain strong working relationships with the development teams and the Zalando Data Foundation
  • Record and share information on current working methods and lessons learned to foster a high-performance data culture
What we offer
What we offer
  • Employee shares program
  • 40% off fashion and beauty products sold and shipped by Zalando, 30% off Lounge by Zalando, discounts from external partners
  • 2 paid volunteering days a year
  • Hybrid working model - work where it works for you within Germany or the UK, with occasional office attendance required for moments that matter
  • Work from abroad for up to 30 working days a year
  • 27 days of vacation a year to start for full-time employees
  • Relocation assistance available (subject to prior agreement)
  • Family services, including counseling and support
  • Health and wellbeing options (including Wellhub, formerly Gympass)
  • Mental health support and coaching available
  • Fulltime
Read More
Arrow Right