CrawlJobs Logo
Randstad Logo Randstad · IT - Software Development

Senior Data Engineer

Malaysia, Kuala Lumpur 15000.00 - 20000.00 MYR / Month · Job Posted July 05, 2026
Apply Position
Job Link Share

Job Description

Randstad has partnered with a software solutions company, building innovative and reliable solutions for their clientele. Your future employers are building a tech team who are capable of keeping up with the latest technologies and aligned in building great solutions

Job Responsibility

  • Architecture: Design fault-tolerant, petabyte-scale distributed data architectures and define company-wide data governance standards
  • Streaming: Build high-throughput, low-latency streaming pipelines using Apache Kafka and stateful Apache Flink applications
  • Data Warehousing: Integrate diverse data streams into a centralized Cloud Data Warehouse while optimizing query performance and storage costs
  • Development: Write clean, production-grade pipeline code using Python and manage end-to-end data lifecycle orchestration
  • Optimization: Troubleshoot bottlenecks in distributed systems, ensuring high availability, system uptime, and cost efficiency
  • Leadership: Provide technical mentorship to junior engineers and collaborate with cross-functional product and data science teams

Requirements

  • 7+ years of dedicated data engineering or distributed systems experience
  • Proven production experience with Apache Kafka (including ecosystem tools) and Apache Flink for real-time processing
  • Expert-level proficiency in Python for data processing and automation
  • Hands-on experience scaling modern cloud data warehouses (e.g., Snowflake, BigQuery, Redshift)
  • Strong grasp of distributed systems architecture, microservices, and modern data lakehouse patterns (e.g., Iceberg, Delta)
  • Familiarity with orchestration (e.g., Airflow), containerization (Docker, Kubernetes), and CI/CD pipelines

What we offer

  • Career Growth Opportunities
  • Open Communication Culture
  • Good Incentives
Randstad - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Data Engineer

8 matching positions

New

Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer for an extensive 35-month c...
Location
Location
Canada , Toronto
Salary
Salary:
57.46 - 67.04 USD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
July 26, 2026
Flip Icon
Requirements
Requirements
  • 5+ years of dedicated experience in Data Engineering or Database Development for enterprise-scale solutions
  • Hands-on expertise with Azure Synapse (SQL DW), Azure Data Factory, Azure Databricks, and SQL Server 2016+
  • Proficient in SQL and Python (specifically PySpark for big data processing)
  • Proven experience implementing CI/CD pipelines using Azure DevOps
  • Demonstrated experience developing reports in Power BI
  • University degree in Computer Science or an equivalent combination of education and experience
  • Expert understanding of DW/BI implementations, data lake design, and data stewardship techniques
Job Responsibility
Job Responsibility
  • Design, develop, and document Azure Data Factory (ADF) and SSIS packages to integrate complex data from multiple source systems
  • Build and maintain Databricks notebooks and jobs using Python (PySpark) and SQL for both batch and streaming workloads
  • Implement curated, analytics-ready datasets following the Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake best practices
  • Develop complex T-SQL, stored procedures, views, triggers, and indexes to optimize performance within Azure Synapse and SQL Server environments
  • Conduct advanced data analysis to provide meaningful, data-driven insights to business stakeholders
  • Develop high-quality Power BI reports and dashboards to visualize key performance indicators and operational metrics
  • Assist in the data modeling of the data warehouse/data lake solutions to ensure scalability and alignment with business requirements
  • Design and implement rigorous data quality and cleansing processes to ensure the integrity of the enterprise data assets
  • Manage the end-to-end development lifecycle using Azure DevOps pipelines to ensure reliable and automated deployments
  • Convert business requirements into detailed technical specifications, provide accurate time estimates, and conduct knowledge transfer sessions for the team
What we offer
What we offer
  • Unmatched Stability: A 35-month contract provides rare long-term stability and the opportunity to lead a project from foundational design to mature operation
  • Enterprise Scale: Work on a massive transit data ecosystem, solving complex data problems that impact millions of users
  • Modern Cloud Stack: Deepen your expertise in the full Azure data suite, including Delta Lake, PySpark, and Synapse
  • Strategic Role: Move beyond simple coding to help model the enterprise data strategy and deliver actionable business intelligence
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are seeking Senior Data Engineers to support TCCC’s Symphony platform on a pe...
Location
Location
India , Delhi
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–10 years of hands-on data engineering experience
  • Strong understanding of Apache Spark and its core concepts
  • Proficiency in Scala and/or Java — code-first approach is mandatory
  • Advanced SQL skills
  • Hands-on experience with Azure Synapse
  • Working knowledge of GitHub for source control
  • Experience with data warehousing and multi-source data integration
  • Ability to work in an offshore delivery model
  • Must be a hands-on builder — no oversight-only profiles
  • Must be available to mobilize immediately
Job Responsibility
Job Responsibility
  • Implement and configure the Symphony platform solution for assigned market(s)
  • Develop and maintain market-specific data pipelines using Scala and SQL on Apache Spark
  • Integrate market-level marketing and data sources into the Symphony platform
  • Identify and resolve market-specific data quality issues, discrepancies, and inconsistencies
  • Support ongoing maintenance and monitoring of market-level pipelines
  • Optimize market-specific solutions for performance and scalability
  • Collaborate with the core team to ensure market implementations align with global architecture standards
  • Work within TCCC’s metadata-driven architecture — no reinvention of existing frameworks
  • Ensure pipelines are used strictly for scheduling — all ETL logic must remain in code
  • Communicate findings and technical issues clearly to the Delivery Lead and market Business Analyst
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

This role is centered on building a Centralized Data Lakehouse from scratch. The...
Location
Location
Germany , Ansbach
Salary
Salary:
Not provided
zalando.se Logo
Zalando Sverige
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience with the Databricks ecosystem (Unity Catalog, Delta Live Tables, Workflows)
  • Deep understanding of the Medallion Architecture (Bronze, Silver, Gold) and Delta Lake internals
  • Proficient in Apache Spark (PySpark) and Python for large-scale data processing
  • Several years of experience in building and maintaining scalable Streaming & Batch pipelines, specifically using CDC (Change Data Capture) from RDBMS (e.g., MySQL/BinLogs)
  • Familiar with Infrastructure as Code (Terraform), Docker, Git (trunk-based development), and DevOps principles
  • Ability to translate complex business requirements into robust, de-normalized data models optimized for Lakehouse performance
  • Good understanding of Cloud Infrastructure (AWS), REST APIs, and secure data exchange
  • Excellent verbal and written communication skills in English and the ability to accurately document designs and processes
  • Experience in aligning data strategies within a larger group ecosystem (like Zalando)
Job Responsibility
Job Responsibility
  • Take end-to-end responsibility for our Data Refinery – from ingestion (CDC) to providing business-ready data products in the Gold layer
  • Design, build, and maintain scalable ELT pipelines using Databricks Delta Live Tables (DLT)
  • Liaise with the owners of source systems (e.g., TB.One) to define and align Data Contracts
  • Implement and oversee Data Governance and security standards within the Unity Catalog
  • Perform technical analysis and root cause analysis to improve data quality and pipeline reliability
  • Build and maintain strong working relationships with the development teams and the Zalando Data Foundation
  • Record and share information on current working methods and lessons learned to foster a high-performance data culture
What we offer
What we offer
  • Employee shares program
  • 40% off fashion and beauty products sold and shipped by Zalando, 30% off Lounge by Zalando, discounts from external partners
  • 2 paid volunteering days a year
  • Hybrid working model - work where it works for you within Germany or the UK, with occasional office attendance required for moments that matter
  • Work from abroad for up to 30 working days a year
  • 27 days of vacation a year to start for full-time employees
  • Relocation assistance available (subject to prior agreement)
  • Family services, including counseling and support
  • Health and wellbeing options (including Wellhub, formerly Gympass)
  • Mental health support and coaching available
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Roku is changing how the world watches TV. Roku is the #1 TV streaming platform ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
roku.com Logo
Roku
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive SQL Skills
  • Proficiency in at least one scripting language, Python is required
  • Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
  • Proficiency in data modeling, including designing, implementing, and optimizing conceptual, logical, and physical data models to support scalable and efficient data architectures
  • Experience with AWS, GCP, Looker is a plus
  • Collaborate with cross-functional teams such as developers, analysts, and operations to execute deliverables
  • 8+ years professional experience as a data Engineer
  • BS in Computer Science
  • MS in Computer Science preferred
  • AI Literacy / AI growth mindset
Job Responsibility
Job Responsibility
  • Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 10s of terabytes of data ingested every day and petabyte-sized data warehouse
  • Build quality data solutions and refine existing diverse datasets to simplified data models encouraging self-service
  • Build data pipelines that optimise on data quality and are resilient to poor quality data sources
  • Own the data mapping, business logic, transformations and data quality
  • Low level systems debugging, performance measurement & optimization on large production clusters
  • Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures
What we offer
What we offer
  • Global access to mental health and financial wellness support and resources
  • Healthcare (medical, dental, and vision)
  • Life, accident, disability, commuter, and retirement options (401(k)/pension)
  • Time off in accordance with local leave policies
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

As a Senior Data Engineer, you'll design, build, and operate scalable, reliable ...
Location
Location
Croatia
Salary
Salary:
Not provided
mypos.com Logo
myPOS
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
  • 6+ years of experience as a Data Engineer, building and maintaining production-grade pipelines and datasets
  • Strong Python and SQL skills with a solid understanding of data structures, performance, and optimization strategies
  • Hands-on experience with orchestration (like Airflow, Dagster, Databricks Workflows) and distributed processing in a cloud environment
  • Experience with analytical data modeling (star and snowflake schemas), DWH, ETL/ELT patterns, and dimensional concepts
  • Experience building reliable incremental data ingestion pipelines from DBs and APIs
  • Familiarity with at least one major cloud provider (GCP, AWS, Azure) and deploying data solutions in the cloud
  • Familiarity with CI/CD for data pipelines, IaC (Terraform), and/or DataOps practices
  • Strong troubleshooting mindset: ability to debug issues across data, infra, pipelines, and deployments
  • Collaborative mindset and clear communication across engineering, analytics, and business stakeholders
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines for ingestion, transformation, and export across multiple sources and destinations
  • Develop and evolve scalable data architecture to meet business and performance requirements
  • Partner with analysts and data scientists to deliver curated, analysis-ready datasets and enable self-service analytics
  • Implement best practices for data quality, testing, monitoring, lineage, and reliability
  • Optimize workflows for performance, cost, and scalability (e.g., tuning Spark jobs, query optimization, partitioning strategies)
  • Ensure secure data handling and compliance with relevant data protection standards and internal policies
  • Contribute to documentation, standards, and continuous improvement of the data platform and engineering processes
  • Ensure secure, compliant handling of data and models, including access controls, auditability, and governance practices
  • Build and maintain MLOps automation: CI/CD for ML, environment management, artifact handling, versioning of data/models/code
What we offer
What we offer
  • Vibrant international team operating in hi-tech environment
  • Excellent compensation package
  • myPOS Academy for upskilling and training
  • Unlimited access to courses on LinkedIn Learning
  • Refer a friend bonus as we know that working with friends is fun
  • Teambuilding, social activities and networks on a multi-national level
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

I'm working with a leading global hedge fund that is looking to hire a Data Deve...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software and/or data engineering experience
  • Strong development experience in Python or C#, ideally both
  • Expert-level SQL skills
  • Strong experience with relational databases, data modelling and schema design
  • Experience building ETL pipelines and data-driven applications
  • Strong problem-solving ability and a genuine interest in understanding systems end-to-end
  • Excellent communication skills and the ability to work directly with business users
Job Responsibility
Job Responsibility
  • Design and develop data models, reporting solutions and analytics platforms
  • Build and enhance ETL pipelines and data processing workflows
  • Develop applications and tooling using Python
  • Design and optimise database schemas and reporting architectures
  • Create and tune complex SQL queries for reporting, reconciliation and analytics
  • Work directly with business stakeholders to gather requirements and deliver solutions
  • Support and modernise existing reporting and analytics platforms
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Well-known technology platform company is looking for a Senior Data Engineer to ...
Location
Location
United States , San Francisco
Salary
Salary:
155000.00 - 195000.00 USD / Year
strategicemployment.com Logo
Strategic Employment Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience
  • Strong Python development skills
  • Production experience with Airflow or other workflow orchestration tools
  • Experience building data pipelines in the public cloud (AWS, GCP, or Azure)
  • Strong communication (ex: push back, clarify, and manage expectations proactively)
Job Responsibility
Job Responsibility
  • Work directly with stakeholders to understand their data needs
  • Build and maintain production pipelines
  • Deliver high-quality data sets that drive business decisions
  • Be embedded within the business unit attending stakeholder meetings
  • Translate ambiguous requirements into technical specs
  • Manage your domain end to end
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Ready to lead data engineering that powers critical financial decisions at scale...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience leading small to medium sized engineering teams within agile delivery environments
  • Strong expertise in at least one server-side language such as Python, Java, Kotlin or NodeJS
  • Knowledge of serverless, event-driven, and loosely coupled architectures
  • Experience designing and integrating REST APIs and third-party services
  • Commercial experience working with React or React Native and state management libraries
  • Strong experience with CI/CD tooling such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development practices
  • Proven experience working within the energy industry
  • Ability to communicate complex technical concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Leading the day-to-day engineering capability within the Finance Data Squad
  • Delivering scalable data products and software components aligned to business priorities
  • Driving quality through code reviews, testing practices, and engineering standards
  • Mentoring and developing engineers to build capability and performance
  • Collaborating with product owners, architects, and stakeholders to deliver value-focused solutions
What we offer
What we offer
  • Competitive salary
  • Potential for an annual bonus
  • Market-leading pension scheme
  • Customisable benefits including electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
  • Fulltime
!
Read More
Arrow Right