CrawlJobs Logo

Senior Data Engineer

Spain, Barcelona · Job Posted April 16, 2026
Apply Position
Job Link Share

Job Description

The Data Platform Team builds and operates the infrastructure that powers every data use case at bsport: from raw ingestion to orchestration, quality monitoring, and the foundation for analytics and AI/ML. Your primary stakeholders are the full Data team (Analytics Engineers, Data Analysts, and Data Scientists) who is developing on the platform leveraging the ingested data layer and computing capacity for creating the reporting and enriched data layers. You will also work closely with the SRE team to keep the platform secure, reliable, and scalable.

Job Responsibility

  • Build and operate the data platform (Databricks, Airflow, AWS): compute configurations, Unity Catalog, access controls, and cost management to keep it performant and reliable
  • Design and ship the ingestion layer bringing data from our operational systems (PostgreSQL, Kafka, SaaS tools) into the lakehouse data layer (with schema evolution, deduplication, and lineage tracking)
  • Standardise ingestion patterns across batch and CDC use cases
  • Build and maintain the observability framework covering platform health, pipeline SLAs, and data quality
  • Drive developer experience across the Data team: shared libraries, CI/CD for data assets, self-service tooling, and contribution standards

Requirements

  • 5+ years of experience as a Data Engineer, with meaningful time spent on platform and infrastructure
  • Deep hands-on experience with Databricks (Unity Catalog, Delta Lake, job compute) and Apache Airflow in production
  • Strong Python skills with a software engineering mindset
  • Experience building or significantly improving ingestion systems
  • Comfortable with AWS and Terraform for infrastructure provisioning
  • Experience introducing tooling or processes that made your team meaningfully more productive
  • A proactive, problem-solving mindset
  • Strong communication skills and fluency in English to collaborate across teams

What we offer

  • Attractive compensation package
  • Hybrid model with remote days
  • Up to 15 days of remote work from abroad each year
  • helloCSE: discount platform for fitness, shopping, culture, cinema, live events
  • Multicultural colleagues, after-work events, team-building & more

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer

8 matching positions

New

Senior Data Engineer

Senior Data Engineer - The Senior Data Engineer is responsible for executing the...
Location
Location
Canada , Toronto
Salary
Salary:
110000.00 - 130000.00 USD / Year
fourseasons.com Logo
Four Seasons
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 5-8 years experience Data Engineering
  • with experience in Azure using Databricks
  • Bachelor’s degree Required
  • Expert in Data Engineering in Microsoft Azure Environment + Toolsets (ADF, Synapse, Data Bricks, Cosmos DB, FunctionApps, Logic Apps etc)
  • Lakehouse experience using Databricks
  • Azure platform administration
  • Data Governance Software experience
  • Microsoft Power BI delivery and support
  • Strong SQL query skills
  • Strong history in Python, Pyspark, or Scala
Job Responsibility
Job Responsibility
  • Leading the delivery of finance domain data migration projects with clear milestones, quality controls, and operational readiness
  • Designing and maintaining reusable data ingestion and transformation frameworks aligned with enterprise engineering standards
  • Ensuring data consistency, lineage, and trustworthiness across finance and enterprise data domains
  • Collaborating with business and technical stakeholders to enable analytics, forecasting, and AI readiness for finance data
  • Driving operational excellence across engineering practices, optimizing for cost, performance, and maintainability
  • Design, develop, and maintain robust batch and streaming data pipelines across Azure Data Factory, Databricks, Informatica, and SQL environments
  • Closely work with vendors, contractors and other FS teams to operationalize the data migration process for the hotels
  • Implement and oversee CI/CD workflows, Infrastructure as Code (IaC), and automated testing frameworks
  • Operationalize data quality by integrating Informatica IDQ into finance workflows
  • Apply governance standards by embedding metadata, cataloging, and lineage practices
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

The Product Engineering Partnership pillar is the connective tissue between Data...
Location
Location
United States , Multiple Locations
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years of experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years of experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience
  • Ability to meet Microsoft, customer, and/or government security screening requirements may be required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check — this position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Own telemetry contracts and instrumentation that ship with Global Skilling products (e.g., Microsoft Learn, ASN, Skilling Catalog)
  • Design and operate experimentation data infrastructure, including A/B testing pipelines, metric definitions, and significance tooling
  • Build catalog and content management data integrations across the Global Skilling product surface
  • Lead semantic model design for product analytics in partnership with Reporting and Analytics teams
  • Build and maintain external (end-customer) reporting pipelines for ASN and partner-facing products
  • Operate Insights and Analytics feedback loops, including pipelines that surface usage patterns, customer feedback, and product signals to engineering teams
  • Mentor Data Engineer II (DE II) engineers on telemetry design, experimentation practices, and product–engineering partnership approaches
  • Partner with Microsoft-wide alignment forums to align WISE telemetry standards with broader Microsoft frameworks
  • Provide on-call leadership for product-tier pipelines (severity levels 1–3)
  • Embody our Culture and Values
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation.
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5–8 Years Experience
  • Apache Iceberg
  • Python
  • SQL
  • Data Modeling
  • ETL/ELT
  • AWS Data Services
Job Responsibility
Job Responsibility
  • Build governed data products using Apache Iceberg
  • Develop scalable ingestion pipelines
  • Implement data validation, reconciliation, and lineage
  • Maintain schema evolution and auditing capabilities
  • Integrate structured and unstructured datasets
  • Enable analytics and AI consumption
  • Optimize storage and query performance
  • Support data governance initiatives
Read More
Arrow Right
New

Senior Data Engineer

As Senior Data Engineer you will be responsible for designing, building, maintai...
Location
Location
Portugal , Lisbon
Salary
Salary:
35571.65 - 48126.35 EUR / Year
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree and 3 to 5 years of Computer Science, IT or related field experience
  • Proficiency in Python, PySpark, and Scala for data processing and ETL (Extract, Transform, Load) workflows, with hands-on experience in using Databricks for building ETL pipelines and handling big data processing
  • Experience with data warehousing platforms such as Amazon Redshift, or Snowflake
  • Strong knowledge of SQL and experience with relational (e.g., PostgreSQL, MySQL) databases
  • Familiarity with big data frameworks like Apache Hadoop, Spark, and Kafka for handling large datasets
  • Experienced with software engineering best-practices, including but not limited to version control (GitLab, Subversion, etc.), CI/CD (Jenkins, GITLab etc.), automated unit testing, and Dev Ops
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions for data generation, collection, and processing
  • Be a key team member that assists in design and development of the data pipeline
  • Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
  • Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
  • Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
  • Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
  • Implement data security and privacy measures to protect sensitive data
  • Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
  • Collaborate and communicate effectively with product teams
What we offer
What we offer
  • Work That Matters – Build tech that accelerates scientific breakthroughs and helps patients worldwide
  • Modern Tech Stack – Cloud-first, automation-focused, AI-powered
  • Global Scale, Agile Mindset – Collaborate across continents while working in nimble, high-impact teams
  • Continuous Learning – Access to certifications, trainings, mentorship, and career mobility
  • AMGEN Total Rewards Plan – Comprehensive benefits in healthcare, finance, and well-being
  • Flexibility – Hybrid work model with time split between our Lisbon office and remote work
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Radancy’s Data Engineering team is seeking a Senior Data Engineer to join our Ba...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
radancy.com Logo
Radancy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-6 years of experience in data engineering, including strong hands-on experience with SQL, Python, and data modeling
  • Experience building and optimizing data pipelines using Apache Airflow or similar orchestration tools
  • Strong experience with cloud data platforms such as Google BigQuery, Amazon Redshift, Databricks, Snowflake, or similar technologies
  • Experience working with large-scale structured and semi-structured datasets
  • Familiarity with distributed data processing technologies such as Spark, Kafka, or similar frameworks
  • Experience with data quality, data validation, pipeline monitoring, and automated testing practices
  • Exposure to Generative AI tools such as OpenAI, Gemini, GitHub Copilot, Cursor, or similar tools is strongly preferred
  • Ability to use AI-assisted or agentic development tools to improve productivity, troubleshoot issues, generate tests, and accelerate delivery
  • Experience with Machine Learning, MLOps, predictive analytics, or AI-powered analytics is a plus
  • Experience building datasets or platforms that support analytics products, conversational insights, data agents, or business intelligence solutions is a plus
Job Responsibility
Job Responsibility
  • Design, develop, and optimize data models, schemas, and datasets for cloud-based data platforms
  • Build, optimize, and maintain reliable data pipelines using Python, SQL, Airflow, and cloud data technologies
  • Ingest, transform, aggregate, and curate data from diverse internal and external sources to create high-quality datasets for analytics, reporting, AI, and agentic solutions
  • Work with domain experts, product teams, analytics teams, and engineering stakeholders to understand business needs and translate them into scalable data solutions
  • Support the development of Insights Agents and Data Agents that help users ask questions, generate insights, summarize trends, and make data-driven decisions
  • Develop AI-assisted and agentic solutions that generate actionable insights, business narratives, and compelling data stories from structured and semi-structured data
  • Use agentic software development tools and Generative AI tools to improve engineering productivity, including code generation, test creation, documentation, data validation, troubleshooting, and workflow automation
  • Continuously improve pipeline performance, reliability, observability, and cost efficiency through optimization, automation, and proactive monitoring
  • Build and maintain data quality frameworks, automated tests, validation checks, and monitoring processes to ensure trustworthy data
  • Collaborate with global engineering teams to define standards for data collection, modeling, governance, and AI-readiness
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, build, and opt...
Location
Location
Kosovo
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake
  • strong programming skills in Python and SQL
  • Proven experience building batch and streaming data pipelines and production-grade data platforms
  • solid understanding of data modeling, data quality, and governance principles
  • Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP
  • Familiarity with modern data platforms such as Databricks and Snowflake
  • Experience with lakehouse architectures and distributed data systems
  • strong understanding of scalability, reliability, and performance considerations in data pipelines
  • Strong problem-solving skills focused on scalability and reliability
  • collaborative approach to working in cross-functional teams
Job Responsibility
Job Responsibility
  • Design and implement scalable data platforms and pipelines across cloud environments (Azure/Fabric, AWS, GCP, Databricks, Snowflake)
  • developing reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
  • building ingestion, transformation, and curation workflows for both structured and unstructured data
  • implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold)
  • deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems
  • enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows)
  • design scalable logical and physical data models for analytical and operational use cases
  • orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents
  • apply modern architecture patterns including event-driven and streaming architectures
  • ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC)
What we offer
What we offer
  • Health insurance that guarantees fast access to contracted health services
  • Vacation Plan
  • Subsidy for study materials, trainings, conferences and events that will contribute to your development
  • Hybrid Working model
  • Performance Evaluation Process that paves the roadmap for a personal and professional career development
  • Refreshments and fruit in the office
  • Team gatherings and parties organized and subsidized by the company
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are looking for a Senior Data Engineer to join a growing data team supporting...
Location
Location
United States , Boston
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience in data engineering or a closely related field
  • Strong hands-on expertise with SQL, including advanced query development and performance optimization
  • Experience building ETL/ELT workflows for large and varied datasets in production environments
  • Proficiency with Azure Databricks and Azure Data Factory for cloud-based data processing and orchestration
  • Working knowledge of Python for data engineering, automation, or pipeline development
  • Ability to work with multiple data domains, such as healthcare, financial, marketing, or other regulated and high-volume data types
  • Strong communication skills and the ability to collaborate effectively with technical teams, analytics partners, and business stakeholders
Job Responsibility
Job Responsibility
  • Design, build, and maintain robust data pipelines that ingest, transform, and organize information from multiple sources for downstream analytics use
  • Develop scalable data engineering solutions using Databricks, Azure Data Factory, SQL, and Python within a cloud-based architecture
  • Integrate and prepare diverse datasets, including patient-related, clinical, financial, and marketing data, to support reporting and business insights
  • Collaborate with business intelligence partners to deliver clean, dependable datasets that power dashboards, reporting, and decision-making for leadership teams
  • Write efficient SQL and transformation logic to solve complex data challenges and improve the performance and reliability of existing workflows
  • Partner with architects and cross-functional stakeholders to define data models, engineering standards, and best practices across the platform
  • Monitor pipeline health, troubleshoot data issues, and implement improvements that strengthen data quality, accuracy, and operational stability
  • Contribute as a senior member of a small engineering team by sharing technical guidance, communicating clearly, and supporting long-term platform growth
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
  • free online training
Read More
Arrow Right

Senior Data Engineer

Location
Location
United States , Remote City
Salary
Salary:
96000.00 - 192000.00 USD / Year
berettaclima.it Logo
Beretta Clima Italia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree
  • 5+ years of experience in data engineering
  • 5+ years of experience in open lakehouse architecture in Azure, GCP, AWS and/or Snowflake
  • 5+ years of experience creating automated data pipelines and performing data modeling
  • 5+ years of experience writing SQL, Python, and modern ETL/ELT frameworks
Job Responsibility
Job Responsibility
  • Design, build, and optimize data ingestion, transformation, and delivery pipelines that support batch, micro-batch, and streaming workloads
  • Develop ETL/ELT workflows that integrate data from enterprise systems, operational platforms, external sources, and commercial applications
  • Implement scalable data processing patterns that support open lakehouse architectures and medallion-layered data products
  • Ensure pipelines are reliable, maintainable, cost-efficient, and aligned with enterprise engineering standards
  • Design data models that support analytics, reporting, and data product consumption across raw, refined, and curated layers
  • Apply medallion architecture principles to ensure data quality, reusability, and consistency across domains
  • Contribute to architectural decisions that balance performance, scalability, governance, and operational simplicity
  • Support integration of ERP and enterprise systems, ensuring data consistency and alignment with business processes
  • Implement data quality checks, validation rules, and monitoring frameworks to ensure accuracy and reliability
  • Apply foundational data governance practices including lineage, metadata management, cataloging, and access controls
What we offer
What we offer
  • Health Care Benefits: Medical, Dental, Vision
  • Wellness incentives
  • Retirement Benefits
  • Time off and Leave: Paid vacation days, up to 15 days
  • paid sick days, up to 5 days
  • paid personal leave, up to 5 days
  • paid holidays, up to 13 days
  • birth and adoption leave
  • parental leave
  • family and medical leave
  • Fulltime
Read More
Arrow Right