CrawlJobs Logo

Data Engineer

Malaysia, Gelang Patah · Job Posted July 03, 2026
Apply Position
Job Link Share

Job Responsibility

  • Manage, maintain, and continuously improve a portfolio of 40+ Power BI reports connected to 100+ data sources, ensuring data accuracy, performance optimization, and alignment with business needs
  • Collaborate with business stakeholders from Operations, Production, Engineering, Quality, Planning, Procurement, Service, Logistics and IT, to gather, analyze, and document reporting requirements, translating them into technical specifications
  • Architect and create SQL views and queries to support data models, reporting layers, and downstream analytics
  • Read, interpret, and refactor complex data pipelines to improve performance, readability, and maintainability across existing data infrastructure
  • Maintain and improve Python data pipeline scripts that extract, transform, and load data between SAP, Salesforce, ServiceMax, SFTP, Email, and MES systems, ensuring reliability and performance
  • Build and publish new Power BI reports and dashboards from initial requirements through final delivery, including data modeling, DAX measures, and visual design
  • Manage, monitor and troubleshoot PowerBI gateway, report refresh failures, data discrepancies, and pipeline issues
  • drive resolution in a timely manner
  • Document data pipelines, SQL views, and report logic to ensure knowledge transfer and sustainability of the reporting environment
  • Experience designing, implementing, and configuring both public and private API endpoints to enable seamless system integrations and scalable solutions.

Requirements

  • Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field, or equivalent work experience
  • Expert-level proficiency in Microsoft SQL Server, including complex query writing, performance tuning, stored procedures, CTEs, window functions, and view creation in production environments
  • Demonstrated ability to read and interpret complex, multi-layered SQL queries and understand underlying data structures
  • 3+ years experience creating and managing Python data pipelines and ETL for analytics use cases
  • 3+ years of hands-on Power BI development experience, including report building, data modeling, DAX authoring, and managing connections across a large number of diverse data sources
  • Proven ability to gather and translate business requirements into functional data and reporting solutions.

Nice to have

  • Experience maintaining a large Power BI report portfolio (40+ reports, 100+ sources) in an enterprise environment
  • Familiarity with Power BI Service administration, including workspaces, row-level security (RLS), and scheduled refresh management
  • Strong communication skills with the ability to present data findings and technical concepts to non-technical stakeholders
  • Knowledge of SAP, SAP Business Objects, SalesForce, ServiceMax, and SFTP systems to extract and move data
  • Experience in Python for data engineering tasks, including pipeline development, automation, data transformation, and integration (e.g., pandas, pyodbc, requests)
  • Experience in VBScript for automation, scripting, and integration of tasks within the data environment
  • Detail-oriented with strong problem-solving skills and a proactive approach to identifying and resolving data quality issues.

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

As a Data Engineer in our Finance Systems and Analytics team, you’ll help design...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience building and maintaining data pipelines and scalable data products using structured and unstructured data
  • Strong knowledge of SQL, ideally within a Snowflake environment
  • Experience with at least one server-side language such as Python, Java, Kotlin or NodeJS or experience with Alteryx
  • Knowledge of event-driven, loosely coupled architectures and data processing patterns
  • Experience working with CI/CD tools such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development approaches
  • Experience with automated testing techniques within data or software engineering environments
  • Proven experience working in the energy industry
  • Ability to translate complex data concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Building and maintaining scalable data products that deliver insight across finance systems
  • Designing and optimising ETL processes to ensure data integrity and performance
  • Collaborating with engineers, analysts, and business teams to define and deliver data solutions
  • Contributing to agile delivery, including planning, retrospectives, and continuous improvement
  • Supporting the operational performance, monitoring, and reliability of data platforms
What we offer
What we offer
  • Competitive salary and potential for an annual bonus
  • Market-leading pension scheme
  • Electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
!
Read More
Arrow Right
New

Data Engineer

Design, develop, and maintain data solutions, pipelines and analytics applicatio...
Location
Location
United States , Alpharetta
Salary
Salary:
Not provided
iqzsystems.com Logo
IQZ Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • MS or foreign equivalent in Computer Science or Engineering (any) or Information Systems or Data Science or Related
  • 1 year experience in data storage, analysis and pipelines, ETL, Apache Kafka and Apache Storm
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions, pipelines and analytics applications using various tools and technologies including Hadoop, Spark, Hive, Kafka, SQL, MapReduce, Apache Kafka, Apache Storm, AWS, Snowflake etc
  • Gather & analyze requirements
  • Identify and implement process improvements
  • Assemble large, complex data sets to meet requirements
  • Implement methods to improve data reliability and data quality
  • Design and develop frameworks to stream data
  • Optimize data delivery and re-design infrastructure for greater scalability
  • Perform troubleshooting and provide issue resolution and similar duties
  • Fulltime
Read More
Arrow Right
New

Data Engineer

The Role: We are seeking a passionate Data Engineer to design scalable, robust s...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 16, 2026
Flip Icon
Requirements
Requirements
  • Deep expertise in data engineering with the ability to extend into backend services
  • Proven experience building pipelines for large-scale transactional or financial data
  • Fluency in Scala (Scio/Dataflow) and comfort with cloud-native development on GCP
  • Strong communication skills to collaborate with Finance, Product, and Engineering teams to ship auditable, reliable systems that meet regulatory scrutiny
  • Ability to thrive in fast-moving, ambiguous spaces while prioritizing long-term sustainability
Job Responsibility
Job Responsibility
  • Design scalable, robust systems that turn large-scale consumption and royalty data into accurate payouts
  • Build self-serve tools for our Finance team
  • Develop modular, easily maintainable platform capabilities
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to help shape and scale a modern cloud-based ...
Location
Location
United States , Wood Dale
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering, analytics engineering, or a closely related discipline
  • Strong practical experience with Google Cloud Platform, including deep expertise in BigQuery
  • Advanced SQL skills with a proven ability to design semantic models and curated data layers
  • Experience developing integrations and pipelines through APIs, ingestion frameworks, or ETL processes
  • Hands-on familiarity with BI and reporting platforms such as Looker Studio, Tableau, or comparable tools
  • Solid communication skills with the ability to work effectively across technical teams and business functions
  • Demonstrated success in ambiguous environments where processes, models, and standards must be built from scratch.
Job Responsibility
Job Responsibility
  • Create and refine scalable data models and curated datasets within BigQuery to support accurate analysis and reporting
  • Build, manage, and optimize ETL workflows and data pipelines that connect information from SaaS applications and other source systems
  • Develop reporting-ready data structures and dashboards that provide clear, dependable insights for business users
  • Establish data quality practices, documentation standards, and performance metrics to strengthen trust in enterprise reporting
  • Collaborate with cross-functional stakeholders to translate reporting objectives into well-structured data solutions
  • Automate repetitive data tasks through scripting and lightweight engineering approaches using tools such as Python
  • Apply governance and maintainability best practices to improve how data is organized, accessed, and supported over time
  • Contribute to modernization efforts by helping move data processes away from legacy workflows into scalable cloud-based platforms.
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays, where you'll spearhead the evolution of ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in ETL / data processing / data warehousing / data engineering / RDBMS / PySpark
  • Experience in Data Processing and ETL in On-prem and Cloud based systems
  • Preferred AWS cloud development, with a strong understanding of AWS services (e.g., EC2, S3, Lambda, RDS, DynamoDB, etc.)
  • Proficient in at least one Python programming language
  • Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform etc.
  • Experience with CI/CD tools and pipelines (Jenkins, GitLab CI, etc.) for automation and deployment
  • Good understanding of cloud security best practices and experience with IAM, VPC, security groups, and encryption mechanisms
  • Good knowledge of monitoring, logging, and troubleshooting tools (e.g. CloudWatch, CloudTrail)
  • Experience with version control systems (Git, GitHub, Bitbucket)
  • Strong communication skills and ability to work in a collaborative team environment
Job Responsibility
Job Responsibility
  • Spearhead the evolution of our digital landscape, driving innovation and excellence
  • Deliver the technology stack, using strong analytical and problem-solving skills to understand the business requirements and deliver quality solutions coming up with the ETL process design / data pipeline of the Foundational / Consolidated and Business data Products for the Tesco Tenancy on EDP
  • Work on complex technical problems that will involve detailed analytical skills and analysis
  • Develop and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools
  • Ensure that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaborate with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization's technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness
  • A place where you can belong
  • Collaborative Areas
  • More than work
  • Hybrid working
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Design, build, and optimize scalable data pipelines for ingesting, processing, a...
Location
Location
United States , Jonesboro
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field
  • 3+ years of experience in Data Engineering or related role
  • Strong SQL skills and experience working with relational databases
  • Experience building ETL/ELT pipelines using modern data tools
  • Proficiency in Python, Java, Scala, or similar programming languages
  • Experience with cloud platforms such as Amazon Web Services, Microsoft, or Google
  • Experience with data warehouses such as Snowflake, Amazon Redshift, or Google BigQuery
  • Experience with orchestration and pipeline tools such as Apache Airflow, dbt, or Apache Spark
  • Strong understanding of data architecture, data modeling, and database optimization
  • Excellent troubleshooting and problem-solving skills
Job Responsibility
Job Responsibility
  • Design, build, and optimize scalable data pipelines for ingesting, processing, and transforming large datasets
  • Develop and maintain ETL/ELT workflows from multiple structured and unstructured data sources
  • Build data models and optimize data warehouse performance for analytics and reporting
  • Ensure data quality, integrity, governance, and security across all data platforms
  • Partner with business stakeholders, analysts, data scientists, and application teams to understand data requirements
  • Monitor pipeline performance and troubleshoot data-related issues in production environments
  • Implement automation for data validation, monitoring, and alerting
  • Support cloud-based data infrastructure and architecture improvements
  • Create and maintain documentation for data flows, architecture, and processes
  • Continuously improve data engineering standards, tools, and best practices
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Technology Doesn't Change the World, People Do.® Robert Half is the world’s firs...
Location
Location
United States , Memphis
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field
  • 3+ years of experience in Data Engineering or related role
  • Strong SQL skills and experience working with relational databases
  • Experience building ETL/ELT pipelines using modern data tools
  • Proficiency in Python, Java, Scala, or similar programming languages
  • Experience with cloud platforms such as Amazon Web Services, Microsoft, or Google
  • Experience with data warehouses such as Snowflake, Amazon Redshift, or Google BigQuery
  • Experience with orchestration and pipeline tools such as Apache Airflow, dbt, or Apache Spark
  • Strong understanding of data architecture, data modeling, and database optimization
  • Excellent troubleshooting and problem-solving skills
Job Responsibility
Job Responsibility
  • Design, build, and optimize scalable data pipelines for ingesting, processing, and transforming large datasets
  • Develop and maintain ETL/ELT workflows from multiple structured and unstructured data sources
  • Build data models and optimize data warehouse performance for analytics and reporting
  • Ensure data quality, integrity, governance, and security across all data platforms
  • Partner with business stakeholders, analysts, data scientists, and application teams to understand data requirements
  • Monitor pipeline performance and troubleshoot data-related issues in production environments
  • Implement automation for data validation, monitoring, and alerting
  • Support cloud-based data infrastructure and architecture improvements
  • Create and maintain documentation for data flows, architecture, and processes
  • Continuously improve data engineering standards, tools, and best practices
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • enrollment in company 401(k) plan
  • free online training
  • Fulltime
Read More
Arrow Right
New

Data Engineer

The Data BI and Integration team develops and manages our self-serve data platfo...
Location
Location
United Kingdom , Nottingham
Salary
Salary:
Not provided
boots.com Logo
Boots
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of hands-on data engineering experience in analytics and/or data science environments
  • Strong skills in SQL and Python
  • Experience with large-scale data solutions on Microsoft Azure and Databricks
  • Experience with Spark or distributed compute frameworks
  • Proven experience in building and maintaining data pipelines and warehousing solutions
  • Knowledge of dimensional modeling is preferred
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines that support business decisions
  • Work within a multidisciplinary squad focused on domain- and project-delivery
  • Develop and manage a self-serve data platform for various business areas
  • Collaborate with the Lead Data Engineer on existing data pipelines
What we offer
What we offer
  • Boots Retirement Savings Plan (up to 6% company contribution)
  • Generous employee discounts for you and a family member
  • Enhanced maternity/paternity/adoption leave pay
  • Access to free, 24/7 counselling and support through TELUS Health, our Employee Assistance Programme
  • Flexible benefits scheme including options to buy additional holiday, discounted gym membership, life assurance, activity passes, and much more
  • Fulltime
Read More
Arrow Right