CrawlJobs Logo
C
Creative Software · IT - Software Development

Senior Data Engineer

Sri Lanka · Job Posted May 25, 2026
Apply Position
Job Link Share

Job Description

We are seeking an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines across both Azure cloud and on-premises environments. The candidate should have strong experience in ETL/ELT development, data modelling, and data warehousing, along with familiarity in Power BI and other visualization tools used to support analytics teams.

Job Responsibility

  • Build and Manage Data Pipelines
  • Design Data Models & Warehouses
  • Optimize Existing Data Solutions
  • Work Across Cloud and On-Prem Platforms
  • Support BI & Visualization Teams
  • Lead and Collaborate
  • Leverage Multi-Platform Experience

Requirements

  • 3-5 years of experience in Data Engineering or related fields
  • Strong expertise in SQL and at least one programming language (Python, Scala, or Java)
  • Hands-on experience with Azure data services such as Data Factory, Synapse, Databricks, Azure SQL, and Storage
  • Experience with on-premise data platforms, especially SQL Server and SSIS
  • Strong Power BI skills, including: Designing efficient data models (star schema, proper relationships), Writing optimized DAX measures, Applying best practices for performance, data loading, and semantic modeling, Supporting BI teams with dataset design and dashboard optimization
  • Solid experience building and maintaining ETL/ELT pipelines
  • Good understanding of data warehousing concepts, data governance, and data quality frameworks
  • Experience with version control and structured development workflows (Git, CI/CD)
  • Strong communication and ability to work with both technical and business teams
  • Excellent analytical and problem-solving abilities
  • Leadership qualities with mentoring experience
  • Ability to manage multiple projects in dynamic environments

Nice to have

  • Experience with additional visualization tools (Tableau, Oracle Analytics Cloud (OAC), etc.)
  • Exposure to Oracle, Snowflake
  • Knowledge of DataOps, DevOps, CI/CD, and version control practices
Creative Software - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Data Engineer

8 matching positions

Senior Data Engineer

*** Senior Data Engineer - 10 Months+ Contract - Hybrid -Vilnius, Lithuania*** R...
Location
Location
Lithuania , Vilnius
Salary
Salary:
Not provided
redglobal.com Logo
RED Commerce - The Global SAP Solutions Provider
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience as a Data Engineer
  • 7+ years of experience in the overall IT area
  • Strong experience with PySpark and Databricks (AWS environment)
  • Proven experience building data pipelines and implementing Medallion architecture from scratch
  • Excellent communication skills with fluent English (spoken and written)
  • Strong stakeholder management skills with the ability to gather business requirements and translate into technical solutions
  • Able to join within 2-4 weeks of offer
Read More
Arrow Right
New

Senior Data Engineer

We’re looking for a Senior Data Engineer to help scale and evolve our data platf...
Location
Location
United States
Salary
Salary:
150000.00 - 180000.00 USD / Year
helpcare.ai Logo
Helpcare AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A min of 5+ years of software engineering experience with the last 2-3 years in data engineering, ideally including early-stage or 0→1 environments
  • Strong Python programming experience
  • Advanced proficiency in SQL
  • Proven experience building ETL/ELT pipelines end-to-end
  • Experience with orchestration tools like Airflow
  • Deep understanding of the data lifecycle: ingestion → storage → processing → transformation → serving
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Experience supporting BI tools (Looker, Tableau, etc.)
  • Familiarity with modern data warehouses (Snowflake, BigQuery, Redshift)
Job Responsibility
Job Responsibility
  • Design and scale our data platform including pipelines, models, and orchestration frameworks
  • Develop scalable ETL/ELT pipelines for ingesting data from APIs, databases, and event streams
  • Define and implement systems for data ingestion, storage, processing, and transformation
  • Build and manage workflow orchestration using tools like Airflow
  • Build semantic layer as well as dashboards
  • Establish best practices for data modeling, testing, and quality
  • Partner with stakeholders to shape data requirements and enable BI and analytics use cases
  • Optimize systems for performance, scalability, and cost from day one
  • Apply software engineering principles (testing, CI/CD, modular design) to data infrastructure
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Senior Data Engineer. Must Haves: Strong hands-on experience building and suppor...
Location
Location
United States , Los Angeles
Salary
Salary:
Not provided
bhsg.com Logo
Beacon Hill
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience building and supporting production-grade data pipelines using PySpark and Apache Spark
  • Extensive experience working within Databricks environments
  • Experience with Databricks Unity Catalog migrations and modernization initiatives
  • Experience with Databricks Unity Catalog governance and security models
  • Strong understanding of ETL/ELT design, data modeling, and incremental data processing
  • Experience modernizing legacy data platforms and data migration projects
  • Experience working with large-scale datasets in cloud-based data platforms
  • Experience with workflow orchestration, scheduling, and pipeline automation
  • Knowledge of cloud data platforms such as Snowflake and/or Google Cloud
  • Experience implementing data quality checks, monitoring, logging, and alerting
Job Responsibility
Job Responsibility
  • Migrate existing data assets and pipelines to Databricks Unity Catalog
  • Refactor and optimize existing pipelines using modern engineering standards and best practices
  • Build and maintain scalable PySpark-based data pipelines
  • Develop new source-of-truth datasets and modernize legacy data workflows
  • Design and implement workflow orchestration using Databricks Jobs
  • Deploy and manage pipelines using Databricks Asset Bundles
  • Ensure data pipelines are reliable, observable, and production-ready
  • Implement data quality controls, monitoring, and operational alerting
  • Support platform migrations, testing, validation, and production cutovers
  • Partner with engineering teams to improve platform stability, scalability, and data reliability
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are seeking an experienced Senior Data Engineer to join a leading automotive ...
Location
Location
Sweden , Gothenburg
Salary
Salary:
53333.00 - 66667.00 SEK / Month
amaris.com Logo
Amaris Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with PySpark and Databricks in production environments
  • Advanced Python programming skills
  • Experience with Git/Gerrit and CI/CD pipelines (GitHub Actions, Jenkins, GitLab, or similar)
  • Solid knowledge of Docker and workflow orchestration tools such as Airflow or Databricks Jobs
  • Expertise in designing scalable, privacy-compliant data architectures and pipelines
  • Strong SQL skills and experience handling large-scale datasets
  • Experience with Azure cloud services and Snowflake (or equivalent cloud data warehouse technologies)
  • Knowledge of monitoring, observability, automated testing, and cost optimization practices
  • Familiarity with Power BI or similar BI and reporting tools
  • Understanding of automotive UDS diagnostics and vehicle signal data
Job Responsibility
Job Responsibility
  • Design and develop scalable data pipelines using PySpark and Databricks
  • Build and maintain raw and refined data products related to vehicle signals, software versions, drive cycles, distance measurements, and driver feedback
  • Optimize data processing performance, reliability, and cost efficiency
  • Implement monitoring, observability, automated testing, and usage tracking for data products
  • Collaborate with architects, engineers, Product Owners, and business stakeholders to deliver robust data solutions
  • Support documentation, knowledge transfer, and operational handovers
  • Contribute to technical leadership and best practices within the data engineering domain
What we offer
What we offer
  • An international community, bringing together 110+ different nationalities
  • An environment where trust has a central place: 70% of our key leaders started their careers at the first level of responsibilities
  • A robust training system with our internal Academy and 250+ available modules
  • A vibrant workplace that frequently gathers for internal events (afterworks, team buildings, etc.)
  • Opportunity to turn ideas into action and make a tangible impact through ESG commitments
  • WeCare Together program empowering employees to design and lead projects that create social or environmental impact
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Senior Data Engineer - Media Org (Hybrid NYC or LA). I’m working on a Senior Dat...
Location
Location
United States , New York City or Los Angeles
Salary
Salary:
Not provided
lawrenceharvey.com Logo
Lawrence Harvey
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong Data Engineering experience building production data pipelines
  • Strong PySpark and SQL expertise
  • Experience with Databricks or similar Spark-based cloud platforms
  • Experience building batch and streaming pipelines
  • Experience with orchestration tools such as Airflow or similar
  • Familiarity with AWS environments, data lakes, and modern cloud data architecture
  • Experience with modern Lakehouse design patterns, including Medallion Architecture (Bronze, Silver / Gold layers) for structuring scalable and modular data pipelines
Job Responsibility
Job Responsibility
  • Designing batch and real-time data pipelines
  • Working heavily within a Databricks environment
  • Helping shape modern lakehouse architecture
  • Partnering closely with analytics, product, and data science teams
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

At AO, we’re all about using data to make smarter decisions and create brilliant...
Location
Location
United Kingdom , Bolton
Salary
Salary:
Not provided
ao.com Logo
AO
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid experience in data engineering, building and maintaining data pipelines
  • Strong hands-on knowledge of AWS services like Redshift, Glue, Spectrum and Lambda
  • Confidence working with Python and TSQL
  • A good understanding of data modelling, ETL processes and data warehousing
  • Experience (or exposure to) Infrastructure as Code tools such as Terraform or CloudFormation
  • Familiarity with CI/CD pipelines and automated deployment practices
  • A natural problem solver who enjoys improving and optimising the way things work
  • Comfortable collaborating with different teams and bringing ideas to life together
  • Someone who’s keen to share knowledge and support others’ development
Job Responsibility
Job Responsibility
  • designing and building robust data pipelines that keep our data flowing smoothly and reliably, using AWS tools like Redshift, Glue, Spectrum and Lambda
  • Working closely with teams across AO, you’ll turn business needs into practical, scalable solutions that help unlock the value of our data
  • continuously improve performance, reliability and cost-efficiency across our data systems, while making sure everything is secure and compliant
  • setting up automated deployments using Infrastructure as Code and CI/CD pipelines, to troubleshooting issues and documenting your work, you’ll help keep things running seamlessly
  • share your knowledge with others in the team, helping to coach and support colleagues as we grow
What we offer
What we offer
  • 25 days holidays, plus bank holidays (increasing to 27 days after 2 years with us)
  • Pension
  • Contribute 5% of your annual salary and we'll do the same
  • Be a VIP at the AO Arena
  • discounted gym membership
  • an onsite spa
  • Help @ Hand scheme giving you access to virtual GP’s, Mental Health support and much more
  • exclusive discounts across our product range
  • Enhanced Maternity, Paternity and Adoption leave
  • 2 fully paid days a year to donate your time to any charity of your choice
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Are you a Senior Data professional who enjoys mentoring talent and designing hig...
Location
Location
Greece , Athens
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 10, 2026
Flip Icon
Requirements
Requirements
  • University degree in Computer Science, Statistics, Mathematics, or a related Quantitative field.
  • 5+ years of professional experience in Data Engineering with a mastery of MS SQL Server (T-SQL, SSIS, Performance Tuning).
  • Proven experience in mentoring or leading technical team members.
  • Exposure to VBM methodologies or a strong understanding of financial/business data modeling.
  • Hands-on experience with QlikSense or Qlikview (or similar BI visualization tools like Tableau/Power BI).
  • Excellent command of the English language.
  • A proactive leader with an analytical mindset and a passion for knowledge sharing.
Job Responsibility
Job Responsibility
  • Lead the design and implementation of robust data architectures using on-premise MS SQL Server technologies.
  • Mentor and guide junior developers, assisting them in technical design and ensuring best practices in database management and ETL processes.
  • Develop complex data models that drive strategic business decisions and high-level reporting.
  • Collaborate with business stakeholders to translate VBM methodologies into technical requirements.
  • Oversee the integration of data flows into visualization tools, ensuring data accuracy and top-tier performance.
Read More
Arrow Right
New

Senior Data Engineer

We're looking for an experienced Senior Data Engineer to lead the design, develo...
Location
Location
United Kingdom; Netherlands; Germany; Sweden , Luton; Rijswijk; Hanover; Stockholm
Salary
Salary:
Not provided
https://www.tui.com Logo
TUI
Expiration Date
June 22, 2026
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent professional experience in data engineering or software development
  • Master's degree in Computer Science, Data Science, or related field would be beneficial
  • Proven experience in data engineering and leading technical teams
  • Strong data engineering skills including SQL and Python, with experience managing codebases, CI/CD pipelines, and code reviews
  • Knowledge of cloud-based data systems such as Google Cloud Platform and cloud storage solutions like Snowflake/AWS
  • Deep understanding of data pipeline design, ETL processes, and data integration tools
  • Expertise in relational and NoSQL databases
  • Knowledge of data quality assurance methodologies
  • Excellent problem-solving, analytical, communication, and leadership skills
  • Professional certifications in cloud platforms
Job Responsibility
Job Responsibility
  • Lead the design and implementation of data pipelines and integration processes for customer and marketing data from digital sales channels
  • Design scalable ETL processes for analytics data
  • Develop data integration solutions between various platforms
  • Implement data transformation and enrichment processes
  • Establish and maintain data quality frameworks
  • Develop automated data quality checks and validation processes
  • Implement monitoring systems for data pipeline health
  • Create documentation and standards for data quality assurance
  • Collaborate with the Architect to implement technical designs
  • Translate architectural designs into implementation plans
What we offer
What we offer
  • Attractive remuneration
  • Discretionary bonus schemes
  • Generous travel benefits
  • Extensive health & well-being support
  • Flexible working
  • Access the TUI Learning Hub
  • Opportunities to work on global projects and teams
  • Local charity and sustainability initiatives
  • Fulltime
Read More
Arrow Right