CrawlJobs Logo

Senior Data Mesh Engineer

Egypt, Cairo · Job Posted June 14, 2026
Apply Position
Job Link Share

Job Description

We are looking for a highly skilled and experienced Senior Data Mesh Platform Engineer with strong technical expertise in Azure and software engineering to join our team in Coca-Cola Hellenic Digital & Technology Platform Services (DTPS) as part of the Data Management Platforms team. You will have the opportunity to contribute to the design, development, and continuous improvement of our enterprise Data Mesh Platform, enabling data-driven insights, predictive capabilities, and smarter decision-making for end users across all our countries. The role involves close collaboration with business stakeholders and IT teams, with the opportunity to build scalable platform capabilities that enable integration and transformation of data from multiple systems into reusable data products powering analytical solutions and AI/ML models.

Job Responsibility

  • Design, develop, and maintain scalable platform solutions using Python, Object-Oriented Programming, and Spark
  • Build and enhance platform capabilities using Azure services and frameworks such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Microsoft Fabric, and related technologies
  • Work with stakeholders and Product Managers to understand required platform capabilities
  • Contribute to the evolution and continuous improvement of the Data Mesh Platform roadmap and capabilities
  • Support platform lifecycle management, including upgrades, operational stability, reliability, monitoring, and continuous improvements
  • Participate in solution design, testing, troubleshooting, deployment, and operational excellence across Azure environments
  • Contribute to engineering best practices, technical standards, and knowledge sharing across the team
  • Stay updated with the latest Azure data technologies and best practices
  • Ensure that solutions are scalable, reliable, secure, and aligned with organizational standards and policies
  • Collaborate with data scientists, BI analysts, and business stakeholders to understand requirements and translate them into technical solutions - including data products that feed AI/ML models built on Databricks
  • Contribute to Agile/SAFe delivery processes, including technical planning and sprint execution

Requirements

  • Bachelor's degree in Information Technology, Computer Science, or related field
  • 3+ years of experience in software engineering, platform engineering, or data platform engineering roles
  • Practical experience in object-oriented programming, design patterns, software architecture
  • Understanding of algorithms and data structures, with focus on solving complex problems
  • Ability to write well designed and testable code
  • Proficiency in Python and Spark
  • Advanced knowledge of Azure data services and frameworks, such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage
  • Familiarity with data warehousing and business intelligence concepts and methodologies
  • Ability to work independently and deliver under ambiguity
  • Excellent communication skills - able to translate technical concepts for business stakeholders and vice versa
  • Excellent problem-solving and debugging skills
  • Excellent spoken and written English
  • Communication, organizational and analytical skills

Nice to have

  • Practical experience with C/C++/Java/C# is a plus
  • Experience with real-time or near-real-time streaming pipelines (Azure Event Hubs, Apache Kafka, Spark Streaming)
  • Experience with CI/CD for data pipelines using Azure DevOps, Git, and infrastructure-as-code (Terraform)
  • Familiarity with DevSecOps principles and experience working within the SAFe Agile framework
  • Knowledge of SAP BW (extractors, transformations, queries, data export) and experience supporting BW migrations
  • Knowledge about SAP BDC platform
  • Experience with big data technologies such as Hadoop, Spark, and Hive, and large data volume management
  • Analytical and problem-solving mindset - you enjoy finding root causes, not just symptoms
  • Databricks or Azure Data Engineer certification is a plus

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Mesh Engineer

8 matching positions

Senior Data Engineer

Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration, performance tuning on big data processing
  • Strong understanding of AWS services
  • Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
  • Ability to quickly learn, adapt and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • 8 to 12 years of Computer Science, IT or related field experience
  • AWS Certified Data Engineer preferred
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-structured, and unstructured data processing across the Enterprise Data Fabric
  • Implement real-time and batch data processing solutions, integrating data from multiple sources into a unified, governed data fabric architecture
  • Optimize big data processing frameworks using Apache Spark, Hadoop, or similar distributed computing technologies to ensure high availability and cost efficiency
  • Work with metadata management and data lineage tracking tools to enable enterprise-wide data discovery and governance
  • Ensure data security, compliance, and role-based access control (RBAC) across data environments
  • Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
  • Develop CI/CD pipelines for automated data pipeline deployments, version control, and monitoring
  • Implement data virtualization techniques to provide seamless access to data across multiple storage systems
  • Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
  • Stay up to date with emerging data technologies and best practices, ensuring continuous improvement of Enterprise Data Fabric architectures
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are looking for highly motivated expert Senior Data Engineer who can own the ...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration, performance tuning on big data processing
  • Strong understanding of AWS services
  • Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
  • Ability to quickly learn, adapt and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices.
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-structured, and unstructured data processing across the Enterprise Data Fabric
  • Implement real-time and batch data processing solutions, integrating data from multiple sources into a unified, governed data fabric architecture
  • Optimize big data processing frameworks using Apache Spark, Hadoop, or similar distributed computing technologies to ensure high availability and cost efficiency
  • Work with metadata management and data lineage tracking tools to enable enterprise-wide data discovery and governance
  • Ensure data security, compliance, and role-based access control (RBAC) across data environments
  • Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
  • Develop CI/CD pipelines for automated data pipeline deployments, version control, and monitoring
  • Implement data virtualization techniques to provide seamless access to data across multiple storage systems
  • Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
  • Stay up to date with emerging data technologies and best practices, ensuring continuous improvement of Enterprise Data Fabric architectures.
  • Fulltime
Read More
Arrow Right

Senior Data Engineer - Modern Engineering Team

The Senior Data Engineer is an experienced, hands-on engineer who is passionate ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience as a Senior Technology/Data Engineer
  • Strong, hands-on experience with event-driven architecture using Apache Kafka and Spring Boot microservices
  • Proficiency in Java (JDK 17/21+), Gradle, SQL/Oracle and Elasticsearch
  • Practical experience with BDD/TDD using Cucumber/Spock, Trunk-Based Development, and feature toggles
  • Strong understanding of Agile/Scrum development and a craftsperson approach to engineering, applying SOLID and Clean Code principles
  • Clear understanding of Data Structures and Object-Oriented Principles in Java
  • Experience with CI/CD pipelines (Tekton, Jenkins, Harness, etc.), either on-premises or in the cloud
  • Strong experience with Cloud-native development and Container Orchestration tools (Docker, Kubernetes, OpenShift)
  • B.Tech/B.Eng degree or equivalent work experience
Job Responsibility
Job Responsibility
  • Design, develop, and maintain high-quality, production-grade data pipelines built on Java, Spring Boot microservices, Kafka, Elasticsearch, and Oracle
  • Write clean, well-tested, and maintainable code, applying SOLID principles, TDD, BDD (Cucumber/Spock), and Trunk-Based Development practices
  • Actively participate in code reviews, pairing sessions with developers and AI coding agents (e.g., GitHub Copilot, Devin), and contribute to raising the overall engineering bar
  • Decompose acceptance criteria to understand backlog deliverables, complexities, and risks, contributing to sprint planning and agile ceremonies
  • Implement and manage feature toggles to enable safe, continuous delivery to production
  • Contribute to the design and documentation of scalable, highly available, and low-latency event-driven architectures
  • Apply modern software design patterns and contribute to architectural decisions, including CQRS, Data Mesh, and Medallion Architecture principles
  • Leverage knowledge of Cloud-native development, Container Orchestration (OpenShift/Kubernetes), and CI/CD pipelines (Tekton, Jenkins, Harness) to deliver robust solutions
  • Partner continuously with business stakeholders, architects, and cross-functional teams to deliver sprint goals and broader platform objectives
  • Serve as a Subject Matter Expert (SME) for senior stakeholders and team members on data engineering topics
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Are you passionate about shaping the future of AI and empowering millions of use...
Location
Location
Canada , Vancouver
Salary
Salary:
114400.00 - 203900.00 CAD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Compliance: Anticipates the need for data governance and designs data modeling and data handling procedures, with direct support and partnership with Corporate, External, and Legal Affairs (CELA), to ensure compliance with applicable laws and policies across all aspects of the development process
  • Tags data based on categorization (e.g., personally identifiable information [PII], pseudo-anonymized, financial)
  • Documents data type, build data dictionary, classifications, and lineage to ensure traceability
  • Governs accessibility of data within assigned data pipelines
  • Provides guidance on contributions to the data glossary to document the origin, usage, and format of data for each program
  • Independently implements data governance and privilege of least access practices leveraging security tools
  • Builds responsible AI-compliant data products and/or applications
  • Data Management and Transformation: Plans and creates efficient techniques and operations (e.g., inserting, aggregating, joining) to transform raw data into a form (e.g., dimensional data model) that is compatible with downstream data consumers, databases, and formats that support applications, analytics and reporting
  • Independently uses software, query languages, and computing tools (e.g., cloud-based) to transform raw data across end-to-end pipelines
  • Evaluates data to ensure data quality and completeness using queries, data wrangling, and statistical techniques
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Amgen is looking for highly motivated expert Senior Data Engineer who can own th...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Any degree with 5 - 9 years of experience in Computer Science, IT or related field
  • Strong solution design and problem solving skills
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, Redshift, and Scaled Agile methodologies
  • Proficiency in workflow orchestration, performance tuning on big data processing
  • Strong understanding of AWS services
  • Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
  • Ability to quickly learn, adapt and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data pipelines using AWS (Redshift, S3, Glue, Lambda) and Databricks (Spark, Delta Lake) to support enterprise analytics and reporting
  • Architect and implement robust data models (dimensional and normalized) to enable high-performance querying and optimized reporting in Redshift
  • Build and optimize batch and real-time data processing frameworks, leveraging Spark Structured Streaming and cloud-native services
  • Lead data ingestion, transformation, and orchestration workflows ensuring data quality, reliability, and performance at scale
  • Perform advanced data analytics and root cause analysis to troubleshoot data discrepancies, performance issues, and pipeline failures
  • Ensure data security, compliance, and role-based access control (RBAC) across data environments
  • Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
  • Develop and drive continuous improvements in CI/CD pipelines for automated data pipeline deployments, automated testing, version control, and monitoring for data platforms in a cloud-native environment
  • Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
  • Stay up to date with emerging data technologies and best practices, ensuring continuous improvement
Read More
Arrow Right

Senior Data Engineer

As a Senior Data Engineer, you’ll be part of the team responsible for designing ...
Location
Location
Spain
Salary
Salary:
Not provided
https://feverup.com/fe Logo
Fever
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Engineering, Data Engineering, or a related field
  • Strong proficiency in Python, SQL, Airflow, and Snowflake (or similar technologies)
  • A deep understanding of data modeling and how complex backend systems generate and expose data across products and domains
  • Proven experience building data products for external consumption, such as APIs, dashboards, and partner-facing data feeds
  • Excellent communication and collaboration skills — you can work seamlessly with business stakeholders and product managers, translating abstract needs into clear data solutions
  • You communicate clearly, think in terms of impact, and make technical decisions grounded in business context
  • You thrive in fast-paced environments, adapt quickly to change, and maintain a strong sense of ownership from concept to delivery
  • Familiarity with modern data practices: version control (Git), CI/CD, testing, and observability
  • Fluent in Spanish and English
  • you’ll communicate in Spanish with local teams and in English with global teams
Job Responsibility
Job Responsibility
  • Deeply understand Fever’s backend systems and data models, identifying the logic and transformations that connect business processes to data representations
  • Collaborate fluidly with Product Managers, Project Managers, and business stakeholders to translate ideas and reporting needs into clear technical requirements and data structures
  • Develop and optimize ETL/ELT workflows using Python, DBT, Airflow, and Snowflake, ensuring scalability, maintainability, and reliability
  • Design, build, and maintain partner-facing data products, including APIs (real-time and batch), dashboards, webhooks, and file-based exports
  • Ensure that all data delivered to partners is accurate, consistent, and aligned with the underlying business context
  • Contribute to the architecture, testing, and observability of our data ecosystem, promoting best practices and automation wherever possible
  • Take ownership from idea to delivery — you’ll scope, design, implement, and ship solutions in close collaboration with cross-functional teams
  • Support the evolution of Fever’s data mesh, helping domain teams design data products that follow common engineering and governance standards
What we offer
What we offer
  • Attractive compensation package consisting of base salary and the potential to earn a significant bonus for top performance
  • Stock options
  • Opportunity to have a real impact in a high-growth global category leader
  • 40% discount on all Fever events and experiences
  • Home office friendly
  • Responsibility from day one and professional and personal growth
  • Great work environment with a young, international team of talented people to work with
  • Health insurance and other benefits such as Flexible remuneration with a 100% tax exemption through Cobee
  • English Lessons
  • Gympass Membership
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

You will be responsible for planning and leading research and development relate...
Location
Location
United States , Orlando
Salary
Salary:
90.00 USD / Hour
inspyrsolutions.com Logo
INSPYR Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years overall experience in a data engineering development capacity using a multiple environments (Dev, QA, Prod, etc.) and DevOps procedures for code deployment/promotion
  • Experience translating project scope and high-level requirements into technical data engineering tasks
  • Experience defining solutions to sophisticated data engineering problems in support of advanced analytic processes
  • Experience with a variety of GenAI models, tools, and concepts
  • Understanding of Knowledge Graphs, Data Mesh, and other data sharing platforms
  • 3+ years using, designing and building relational databases (preferably Snowflake or PostgreSQL)
  • 3+ years of experience leading and deploying code using a source control product such as GitLab/GitHub
  • 2+ years of experience with job scheduling software like Apache Airflow, Amazon MWAA, GitLab Runners or UC4
  • Experience collaborating with multiple project teams in a fast-paced environment
  • Experience with defining and estimating level-of-effort data engineering activities
Job Responsibility
Job Responsibility
  • Planning and leading research and development related to advanced analytic data solutions, leveraging GenAI
  • Working with business and technology leaders to understand scope and requirements, business needs, and data from across the company in order to design and deliver the data pipelines necessary for our solutions
  • Partnering with the Decision Science Products, Decision Science, and client teams on critical projects
  • Planning, estimating, design, development, testing, production rollout and sustainment activities
  • Consulting and collaborating with project team members, lead design reviews, do hands-on development, and communicate with colleagues and leaders
What we offer
What we offer
  • Comprehensive medical benefits
  • Competitive pay
  • 401(k) retirement plan
Read More
Arrow Right

Senior Data Engineer

Our Senior Data Engineers enable public sector organisations to embrace a data-d...
Location
Location
United Kingdom , Bristol; London; Manchester; Swansea
Salary
Salary:
60000.00 - 80000.00 GBP / Year
madetech.com Logo
Made Tech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Enthusiasm for learning and self-development
  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies
  • Gathering and meeting the requirements of both clients and users on a data project
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments
  • Owning the cloud infrastructure underpinning data systems through a DevOps approach
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
  • Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different use cases for them
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines. With an understanding how to create reusable libraries to encourage uniformity of approach across multiple data pipelines.
  • Able to document and present an end-to-end diagram to explain a data processing system on a cloud environment, with some knowledge of how you would present diagrams (C4, UML etc.)
  • To provide guidance how one would implement a robust DevOps approach in a data project. Also would be able to talk about tools needed for DataOps in areas such as orchestration, data integration and data analytics.
Job Responsibility
Job Responsibility
  • Enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients’ needs
  • Develop, operate, and maintain these services
  • Provide maximum value to data consumers, including analysts, scientists, and business stakeholders
  • Play one or more roles according to our clients' needs
  • Support as a senior contributor for a project, focusing on both delivering engineering work as well as upskilling members of the client team
  • Play more of a technical architect role and work with the larger MadeTech team to identify growth opportunities within the account
  • Have a drive to deliver outcomes for users
  • Make sure that the wider context of a delivery is considered and maintain alignment between the operational and analytical aspects of the engineering solution
What we offer
What we offer
  • 30 days of paid annual leave + bank holidays
  • Flexible Parental Leave
  • Part time remote working for all our staff
  • Paid counselling as well as financial and legal advice
  • Flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan
  • Optional social and wellbeing calendar of events
  • Fulltime
Read More
Arrow Right