CrawlJobs Logo

Senior Data Engineer

Portugal, Porto Employment contract · Job Posted May 20, 2026
Apply Position
Job Link Share

Job Description

IT House is looking for a Senior Data Engineer for a direct placement with an end client in the Logistics and Transportation sector.

Job Responsibility

  • Design, develop and maintain scaleable data pipelines
  • Implement data integration processes using nifi, Airflow, Apache Kafka and Universal Messaging
  • Ensure data quality, integrity, and security throughout the data lifecycle
  • Continously explore and evaluate new technologies
  • Collaborate with BI specialists, data scientists and cloud engineers

Requirements

  • At least 5 years of experience in similar roles
  • Advanced SQL and Python skills
  • Hands-on experience with Azure and platforms such as Databricks, Teradata and Cloudera
  • Solid knowledge of modern database and cloud data architectures
  • Familiarity with Terraform, Git, CI/CD, and Agile tools such as Jira
  • Excellent English communication and stakeholder collaboration skills.

What we offer

  • Direct integration into the end clients organization
  • Contractual conditions aligned with the candidates profile and experience
  • Hybrid working model (Porto)
  • 24 vacation days per year and additional benefits

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer

8 matching positions

New

Senior Data Engineer

The Product Engineering Partnership pillar is the connective tissue between Data...
Location
Location
United States , Multiple Locations
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years of experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years of experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience
  • Ability to meet Microsoft, customer, and/or government security screening requirements may be required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check — this position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Own telemetry contracts and instrumentation that ship with Global Skilling products (e.g., Microsoft Learn, ASN, Skilling Catalog)
  • Design and operate experimentation data infrastructure, including A/B testing pipelines, metric definitions, and significance tooling
  • Build catalog and content management data integrations across the Global Skilling product surface
  • Lead semantic model design for product analytics in partnership with Reporting and Analytics teams
  • Build and maintain external (end-customer) reporting pipelines for ASN and partner-facing products
  • Operate Insights and Analytics feedback loops, including pipelines that surface usage patterns, customer feedback, and product signals to engineering teams
  • Mentor Data Engineer II (DE II) engineers on telemetry design, experimentation practices, and product–engineering partnership approaches
  • Partner with Microsoft-wide alignment forums to align WISE telemetry standards with broader Microsoft frameworks
  • Provide on-call leadership for product-tier pipelines (severity levels 1–3)
  • Embody our Culture and Values
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation.
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Senior Data Engineer - The Senior Data Engineer is responsible for executing the...
Location
Location
Canada , Toronto
Salary
Salary:
110000.00 - 130000.00 USD / Year
fourseasons.com Logo
Four Seasons
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 5-8 years experience Data Engineering
  • with experience in Azure using Databricks
  • Bachelor’s degree Required
  • Expert in Data Engineering in Microsoft Azure Environment + Toolsets (ADF, Synapse, Data Bricks, Cosmos DB, FunctionApps, Logic Apps etc)
  • Lakehouse experience using Databricks
  • Azure platform administration
  • Data Governance Software experience
  • Microsoft Power BI delivery and support
  • Strong SQL query skills
  • Strong history in Python, Pyspark, or Scala
Job Responsibility
Job Responsibility
  • Leading the delivery of finance domain data migration projects with clear milestones, quality controls, and operational readiness
  • Designing and maintaining reusable data ingestion and transformation frameworks aligned with enterprise engineering standards
  • Ensuring data consistency, lineage, and trustworthiness across finance and enterprise data domains
  • Collaborating with business and technical stakeholders to enable analytics, forecasting, and AI readiness for finance data
  • Driving operational excellence across engineering practices, optimizing for cost, performance, and maintainability
  • Design, develop, and maintain robust batch and streaming data pipelines across Azure Data Factory, Databricks, Informatica, and SQL environments
  • Closely work with vendors, contractors and other FS teams to operationalize the data migration process for the hotels
  • Implement and oversee CI/CD workflows, Infrastructure as Code (IaC), and automated testing frameworks
  • Operationalize data quality by integrating Informatica IDQ into finance workflows
  • Apply governance standards by embedding metadata, cataloging, and lineage practices
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

As a Data Engineer, you will join our Data Platform team and contribute to the d...
Location
Location
Poland , Cracow
Salary
Salary:
18000.00 - 23000.00 PLN / Month
medius.com Logo
Medius
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience developing with Python, including Pandas and PySpark
  • Strong SQL skills and experience working with large-scale datasets
  • Hands-on experience designing and implementing ETL/ELT processes in Data Lakehouse environments
  • Practical experience with Azure cloud services
  • Experience working with Apache Spark and Azure Databricks
  • Understanding of data modeling, data integration, and modern data engineering best practices
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data processing infrastructure and ETL/ELT pipelines on Azure
  • Build and optimize data solutions within Azure Databricks and Data Lakehouse environments
  • Deliver high-quality, reliable data to support AI/ML applications, analytics, reporting, and other data consumers
  • Ensure data governance, security, integrity, and availability across the data platform
  • Monitor, troubleshoot, and improve data workflows and platform performance
  • Collaborate with cross-functional teams to understand data requirements and implement effective solutions
  • Stay current with emerging technologies and best practices in data engineering
  • Share knowledge and contribute to continuous learning within the team
What we offer
What we offer
  • 26 days PTO
  • medical, dental, and vision coverage
  • paid time off
  • retirement benefits
  • variable compensation (performance bonus or commission)
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin
Salary
Salary:
133000.00 - 188600.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant full-time experience
  • or equivalent knowledge
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field, or equivalent practical experience.
  • Strong proficiency in Scala, Python, SQL, Spark, and Databricks, with production-quality software engineering practices.
  • Strong experience building and supporting cloud-based ETL/ELT pipelines, data platforms, and pipeline orchestration patterns for both batch and streaming operations.
  • Experience deploying machine learning models into production environments and supporting model development through operational release.
  • Strong experience with Databricks jobs, workflows, repos, Unity Catalog, and MLflow-based experimentation and model lifecycle management.
  • Experience building CI/CD pipelines with Git-based workflows, automated testing, and deployment of data or ML products.
  • Strong troubleshooting, communication, and cross-functional collaboration skills.
Job Responsibility
Job Responsibility
  • Design and develop batch and streaming ETL/ELT pipelines in Azure Databricks to support ingestion, transformation, curation, and delivery of manufacturing and enterprise data
  • Build reusable Bronze, Silver, and Gold data pipelines, data quality frameworks, and governed data products in Unity Catalog
  • Build and operationalize ML workflows for data preparation, feature engineering, model training, evaluation, deployment, batch scoring, retraining, and inference
  • Establish and maintain MLflow-based model lifecycle controls, including experiment tracking, model registration, versioning, lineage, traceability, and controlled promotion across environments
  • Implement CI/CD pipelines for data products, ML code, workflows, and deployment bundles using Git-based development practices, automated testing, and release automation
  • Build and support Databricks jobs and workflows for orchestration, scheduled execution, retraining, scoring, and downstream operational consumption
  • Improve reliability, observability, and production readiness through testing, monitoring, validation, alerting, documentation, and automation that reduce deployment risk and manual intervention
  • Partner with data scientists, data engineers, platform teams, architecture, manufacturing, and business stakeholders to productionize scalable, supportable solutions aligned to production constraints
  • Support modernization of legacy data and ML workflows into standardized cloud-native Databricks patterns and help bridge proof-of-concept work into repeatable production solutions
What we offer
What we offer
  • Medical
  • Dental
  • Vision
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Tuition assistance programs
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Ready to lead data engineering that powers critical financial decisions at scale...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience leading small to medium sized engineering teams within agile delivery environments
  • Strong expertise in at least one server-side language such as Python, Java, Kotlin or NodeJS
  • Knowledge of serverless, event-driven, and loosely coupled architectures
  • Experience designing and integrating REST APIs and third-party services
  • Commercial experience working with React or React Native and state management libraries
  • Strong experience with CI/CD tooling such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development practices
  • Proven experience working within the energy industry
  • Ability to communicate complex technical concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Leading the day-to-day engineering capability within the Finance Data Squad
  • Delivering scalable data products and software components aligned to business priorities
  • Driving quality through code reviews, testing practices, and engineering standards
  • Mentoring and developing engineers to build capability and performance
  • Collaborating with product owners, architects, and stakeholders to deliver value-focused solutions
What we offer
What we offer
  • Competitive salary
  • Potential for an annual bonus
  • Market-leading pension scheme
  • Customisable benefits including electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
  • Fulltime
!
Read More
Arrow Right
New

Senior Data Engineer

Well-known technology platform company is looking for a Senior Data Engineer to ...
Location
Location
United States , San Francisco
Salary
Salary:
155000.00 - 195000.00 USD / Year
strategicemployment.com Logo
Strategic Employment Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience
  • Strong Python development skills
  • Production experience with Airflow or other workflow orchestration tools
  • Experience building data pipelines in the public cloud (AWS, GCP, or Azure)
  • Strong communication (ex: push back, clarify, and manage expectations proactively)
Job Responsibility
Job Responsibility
  • Work directly with stakeholders to understand their data needs
  • Build and maintain production pipelines
  • Deliver high-quality data sets that drive business decisions
  • Be embedded within the business unit attending stakeholder meetings
  • Translate ambiguous requirements into technical specs
  • Manage your domain end to end
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

I'm working with a leading global hedge fund that is looking to hire a Data Deve...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software and/or data engineering experience
  • Strong development experience in Python or C#, ideally both
  • Expert-level SQL skills
  • Strong experience with relational databases, data modelling and schema design
  • Experience building ETL pipelines and data-driven applications
  • Strong problem-solving ability and a genuine interest in understanding systems end-to-end
  • Excellent communication skills and the ability to work directly with business users
Job Responsibility
Job Responsibility
  • Design and develop data models, reporting solutions and analytics platforms
  • Build and enhance ETL pipelines and data processing workflows
  • Develop applications and tooling using Python
  • Design and optimise database schemas and reporting architectures
  • Create and tune complex SQL queries for reporting, reconciliation and analytics
  • Work directly with business stakeholders to gather requirements and deliver solutions
  • Support and modernise existing reporting and analytics platforms
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Randstad has partnered with a software solutions company, building innovative an...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
15000.00 - 20000.00 MYR / Month
https://www.randstad.com Logo
Randstad
Expiration Date
August 17, 2026
Flip Icon
Requirements
Requirements
  • 7+ years of dedicated data engineering or distributed systems experience
  • Proven production experience with Apache Kafka (including ecosystem tools) and Apache Flink for real-time processing
  • Expert-level proficiency in Python for data processing and automation
  • Hands-on experience scaling modern cloud data warehouses (e.g., Snowflake, BigQuery, Redshift)
  • Strong grasp of distributed systems architecture, microservices, and modern data lakehouse patterns (e.g., Iceberg, Delta)
  • Familiarity with orchestration (e.g., Airflow), containerization (Docker, Kubernetes), and CI/CD pipelines
Job Responsibility
Job Responsibility
  • Architecture: Design fault-tolerant, petabyte-scale distributed data architectures and define company-wide data governance standards
  • Streaming: Build high-throughput, low-latency streaming pipelines using Apache Kafka and stateful Apache Flink applications
  • Data Warehousing: Integrate diverse data streams into a centralized Cloud Data Warehouse while optimizing query performance and storage costs
  • Development: Write clean, production-grade pipeline code using Python and manage end-to-end data lifecycle orchestration
  • Optimization: Troubleshoot bottlenecks in distributed systems, ensuring high availability, system uptime, and cost efficiency
  • Leadership: Provide technical mentorship to junior engineers and collaborate with cross-functional product and data science teams
What we offer
What we offer
  • Career Growth Opportunities
  • Open Communication Culture
  • Good Incentives
Read More
Arrow Right