CrawlJobs Logo

Senior Data Engineer

Malaysia, Kuala Lumpur · Job Posted February 18, 2026
Apply Position
Job Link Share

Job Description

The Senior Data Engineer (ETL & PL/SQL) role involves designing and implementing scalable data solutions to meet business needs. Candidates should have at least 7 years of experience in Talend ETL development and strong proficiency in Oracle PL/SQL. The position requires collaboration with cross-functional teams and a commitment to data quality and innovation. As a Senior Data Engineer, you are responsible for designing, developing, and implementing scalable data store solutions that support both operational and strategic business needs. The role demands strong technical expertise, a proactive mindset, and a commitment to continuous improvement, compliance, and innovation in data engineering practices.

Job Responsibility

  • Design, develop, and implement data store solutions to support operational and business needs
  • Build and maintain robust ETL pipelines using Talend and implement automated deployment workflows for these ETL processes with CI/CD tools
  • Develop, optimize, and tune Oracle PL/SQL queries, procedures, and packages to ensure high performance and reliability
  • Ensure data quality, integrity, and security across all data platforms
  • Monitor, troubleshoot, and resolve data workflow and performance issues proactively
  • Translate business requirements into effective technical solutions, ensuring alignment throughout the project lifecycle
  • Prepare and maintain comprehensive documentation for technical designs, data flows, and operational procedures
  • Perform thorough testing to guarantee solution reliability and data integrity
  • Collaborate with project managers, business analysts, and cross-functional teams to ensure solutions meet business goals and stakeholder expectations
  • Support implementation activities and provide post-launch support to ensure smooth operations
  • Conduct system performance tests and implement improvements as needed
  • Work closely with the delivery team to deliver systems according to specifications, tracking assigned tasks to meet project schedules and quality standards
  • Take ownership of assigned deliverables, proactively identify areas for improvement, and implement solutions. Demonstrate initiative in addressing issues, optimizing processes, and proposing innovations to enhance data engineering practices
  • Takes accountability in considering business and regulatory compliance risks and takes appropriate steps to mitigate the risks
  • Maintains awareness of industry trends on regulatory compliance, emerging threats and technologies in order to understand the risk and better safeguard the company
  • Highlights any potential concerns /risks and proactively shares best risk management practices

Requirements

  • Minimum 7 years of hands-on experience in Talend ETL development
  • At least 5 years of end-to-end experience designing, building, and implementing data store/data marts/data warehouses
  • Strong proficiency in Oracle PL/SQL development, including performance tuning and optimization
  • Strong knowledge of key Oracle performance features such as query optimizer, execution plans, and indexes
  • Solid understanding of data modelling, data governance, and data integration best practices
  • Excellent technical skills in ETL tools for integration with Oracle and other RDBMS databases
  • Good technical skills in UNIX shell scripting and scheduling
  • Have experience working in Agile environments with distributed, cross-functional teams
  • Ability to evaluate, understand, and implement detailed business, functional, and non-functional technical requirements
  • Excellent problem-solving skills, attention to detail, and the ability to approach challenges from multiple perspectives
  • Strong communication and collaboration abilities
  • Independent team member capable of making sound judgment calls in fast-changing or ambiguous environments
  • High level of integrity, takes accountability of work and good attitude over teamwork
  • Takes initiative to improve current state of things and adaptable to embrace new changes

Nice to have

  • Experience working with Oracle Autonomous Database (ADB) is preferred
  • Experience in the financial services industry is an advantage

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer

8 matching positions

Senior Data Engineer

We are seeking a highly accomplished and innovative Senior Data Engineer for an ...
Location
Location
Canada , North York
Salary
Salary:
44.11 - 50.41 USD / Hour
https://www.randstad.com Logo
Randstad
Expiration Date
August 09, 2026
Flip Icon
Requirements
Requirements
  • 7+ years of progressive, hands-on experience in data engineering, big data analytics, or a closely related quantitative field
  • Extensive experience administering cloud data services, with a strong, dedicated focus on Google Cloud Platform (GCP) environments
  • High proficiency in SQL and Python, paired with experience in one or more big data technologies (such as Google BigQuery, Redshift, or Snowflake)
  • Demonstrated success building and maintaining complex ETL/ELT pipelines, designing stored procedures, and optimizing complex queries for large-scale datasets
  • Practical familiarity with advanced data processing frameworks and architectures, including Dataflow, Pub/Sub, PySpark, Airflow, and open table formats (such as Iceberg or StarRocks)
  • Hands-on exposure to machine learning platforms (such as Vertex AI) or applied AI/ML pipelines is highly preferred
  • Solid understanding of operational workflows within the retail domain, along with beneficial familiarity handling clickstream data applications
  • Bachelor’s degree in Computer Science, Electrical Engineering, Statistics, Applied Mathematics, or a related technical and quantitative discipline
  • Relevant industry certifications are highly beneficial (e.g., Google Professional Data Engineer, AWS Certified Big Data – Specialty, Microsoft Certified: Azure Data Engineer Associate)
  • Familiarity with structured IT frameworks, such as holding an ITIL Foundation asset designation
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data pipelines and robust ETL processes for both structured and unstructured datasets
  • Build and optimize relational tables and views explicitly structured for enterprise dashboards and self-service analytics platforms
  • Collaborate closely with business teams and data analysts to gather operational requirements and translate them into efficient data transformations
  • Partner with cross-functional business units, data scientists, and technology stakeholders to deploy reliable, unified data solutions
  • Enforce strict data quality, governance frameworks, and operational performance tuning across large-scale data repositories
  • Leverage Google BigQuery, Python, and advanced storage procedures to build automated, highly optimized data solutions
  • Streamline ingestion and transformation workflows, implementing automation strategies to maximize data integrity across user touchpoints
  • Collect, aggregate, and prepare large-scale datasets to feed executive reporting tools, interactive dashboards, and operational scorecards
  • Provide clean data extractions and actionable insights to internal teams, responding promptly to critical ad-hoc analysis requests
  • Identify process efficiencies, resolve data bottlenecks, and proactively adopt modern data engineering tools, frameworks, and table formats
What we offer
What we offer
  • Massive Data Scale: Design pipelines and optimize query frameworks processing billions of rows of transactional data
  • Modern GCP Stack: Deepen your technical footprint utilizing Google BigQuery, GCP Dataflow, Airflow, Pub/Sub, and Vertex AI
  • Hybrid Flexibility: Enjoy an excellent work-life balance through a hybrid model requiring minimal office visits
  • Strategic Business Impact: Move beyond basic reporting by building data lake and warehouse models that directly shape short- and long-term organizational strategies
Read More
Arrow Right

Senior Data Engineer

The Product Engineering Partnership pillar is the connective tissue between Data...
Location
Location
United States , Multiple Locations
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years of experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years of experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience
  • Ability to meet Microsoft, customer, and/or government security screening requirements may be required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check — this position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Own telemetry contracts and instrumentation that ship with Global Skilling products (e.g., Microsoft Learn, ASN, Skilling Catalog)
  • Design and operate experimentation data infrastructure, including A/B testing pipelines, metric definitions, and significance tooling
  • Build catalog and content management data integrations across the Global Skilling product surface
  • Lead semantic model design for product analytics in partnership with Reporting and Analytics teams
  • Build and maintain external (end-customer) reporting pipelines for ASN and partner-facing products
  • Operate Insights and Analytics feedback loops, including pipelines that surface usage patterns, customer feedback, and product signals to engineering teams
  • Mentor Data Engineer II (DE II) engineers on telemetry design, experimentation practices, and product–engineering partnership approaches
  • Partner with Microsoft-wide alignment forums to align WISE telemetry standards with broader Microsoft frameworks
  • Provide on-call leadership for product-tier pipelines (severity levels 1–3)
  • Embody our Culture and Values
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation.
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Senior Data Engineer - The Senior Data Engineer is responsible for executing the...
Location
Location
Canada , Toronto
Salary
Salary:
110000.00 - 130000.00 USD / Year
fourseasons.com Logo
Four Seasons
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 5-8 years experience Data Engineering
  • with experience in Azure using Databricks
  • Bachelor’s degree Required
  • Expert in Data Engineering in Microsoft Azure Environment + Toolsets (ADF, Synapse, Data Bricks, Cosmos DB, FunctionApps, Logic Apps etc)
  • Lakehouse experience using Databricks
  • Azure platform administration
  • Data Governance Software experience
  • Microsoft Power BI delivery and support
  • Strong SQL query skills
  • Strong history in Python, Pyspark, or Scala
Job Responsibility
Job Responsibility
  • Leading the delivery of finance domain data migration projects with clear milestones, quality controls, and operational readiness
  • Designing and maintaining reusable data ingestion and transformation frameworks aligned with enterprise engineering standards
  • Ensuring data consistency, lineage, and trustworthiness across finance and enterprise data domains
  • Collaborating with business and technical stakeholders to enable analytics, forecasting, and AI readiness for finance data
  • Driving operational excellence across engineering practices, optimizing for cost, performance, and maintainability
  • Design, develop, and maintain robust batch and streaming data pipelines across Azure Data Factory, Databricks, Informatica, and SQL environments
  • Closely work with vendors, contractors and other FS teams to operationalize the data migration process for the hotels
  • Implement and oversee CI/CD workflows, Infrastructure as Code (IaC), and automated testing frameworks
  • Operationalize data quality by integrating Informatica IDQ into finance workflows
  • Apply governance standards by embedding metadata, cataloging, and lineage practices
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

As a Data Engineer, you will join our Data Platform team and contribute to the d...
Location
Location
Poland , Cracow
Salary
Salary:
18000.00 - 23000.00 PLN / Month
medius.com Logo
Medius
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience developing with Python, including Pandas and PySpark
  • Strong SQL skills and experience working with large-scale datasets
  • Hands-on experience designing and implementing ETL/ELT processes in Data Lakehouse environments
  • Practical experience with Azure cloud services
  • Experience working with Apache Spark and Azure Databricks
  • Understanding of data modeling, data integration, and modern data engineering best practices
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data processing infrastructure and ETL/ELT pipelines on Azure
  • Build and optimize data solutions within Azure Databricks and Data Lakehouse environments
  • Deliver high-quality, reliable data to support AI/ML applications, analytics, reporting, and other data consumers
  • Ensure data governance, security, integrity, and availability across the data platform
  • Monitor, troubleshoot, and improve data workflows and platform performance
  • Collaborate with cross-functional teams to understand data requirements and implement effective solutions
  • Stay current with emerging technologies and best practices in data engineering
  • Share knowledge and contribute to continuous learning within the team
What we offer
What we offer
  • 26 days PTO
  • medical, dental, and vision coverage
  • paid time off
  • retirement benefits
  • variable compensation (performance bonus or commission)
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin
Salary
Salary:
133000.00 - 188600.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant full-time experience
  • or equivalent knowledge
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field, or equivalent practical experience.
  • Strong proficiency in Scala, Python, SQL, Spark, and Databricks, with production-quality software engineering practices.
  • Strong experience building and supporting cloud-based ETL/ELT pipelines, data platforms, and pipeline orchestration patterns for both batch and streaming operations.
  • Experience deploying machine learning models into production environments and supporting model development through operational release.
  • Strong experience with Databricks jobs, workflows, repos, Unity Catalog, and MLflow-based experimentation and model lifecycle management.
  • Experience building CI/CD pipelines with Git-based workflows, automated testing, and deployment of data or ML products.
  • Strong troubleshooting, communication, and cross-functional collaboration skills.
Job Responsibility
Job Responsibility
  • Design and develop batch and streaming ETL/ELT pipelines in Azure Databricks to support ingestion, transformation, curation, and delivery of manufacturing and enterprise data
  • Build reusable Bronze, Silver, and Gold data pipelines, data quality frameworks, and governed data products in Unity Catalog
  • Build and operationalize ML workflows for data preparation, feature engineering, model training, evaluation, deployment, batch scoring, retraining, and inference
  • Establish and maintain MLflow-based model lifecycle controls, including experiment tracking, model registration, versioning, lineage, traceability, and controlled promotion across environments
  • Implement CI/CD pipelines for data products, ML code, workflows, and deployment bundles using Git-based development practices, automated testing, and release automation
  • Build and support Databricks jobs and workflows for orchestration, scheduled execution, retraining, scoring, and downstream operational consumption
  • Improve reliability, observability, and production readiness through testing, monitoring, validation, alerting, documentation, and automation that reduce deployment risk and manual intervention
  • Partner with data scientists, data engineers, platform teams, architecture, manufacturing, and business stakeholders to productionize scalable, supportable solutions aligned to production constraints
  • Support modernization of legacy data and ML workflows into standardized cloud-native Databricks patterns and help bridge proof-of-concept work into repeatable production solutions
What we offer
What we offer
  • Medical
  • Dental
  • Vision
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Tuition assistance programs
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Ready to lead data engineering that powers critical financial decisions at scale...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience leading small to medium sized engineering teams within agile delivery environments
  • Strong expertise in at least one server-side language such as Python, Java, Kotlin or NodeJS
  • Knowledge of serverless, event-driven, and loosely coupled architectures
  • Experience designing and integrating REST APIs and third-party services
  • Commercial experience working with React or React Native and state management libraries
  • Strong experience with CI/CD tooling such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development practices
  • Proven experience working within the energy industry
  • Ability to communicate complex technical concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Leading the day-to-day engineering capability within the Finance Data Squad
  • Delivering scalable data products and software components aligned to business priorities
  • Driving quality through code reviews, testing practices, and engineering standards
  • Mentoring and developing engineers to build capability and performance
  • Collaborating with product owners, architects, and stakeholders to deliver value-focused solutions
What we offer
What we offer
  • Competitive salary
  • Potential for an annual bonus
  • Market-leading pension scheme
  • Customisable benefits including electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
  • Fulltime
!
Read More
Arrow Right

Senior Data Engineer

Well-known technology platform company is looking for a Senior Data Engineer to ...
Location
Location
United States , San Francisco
Salary
Salary:
155000.00 - 195000.00 USD / Year
strategicemployment.com Logo
Strategic Employment Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience
  • Strong Python development skills
  • Production experience with Airflow or other workflow orchestration tools
  • Experience building data pipelines in the public cloud (AWS, GCP, or Azure)
  • Strong communication (ex: push back, clarify, and manage expectations proactively)
Job Responsibility
Job Responsibility
  • Work directly with stakeholders to understand their data needs
  • Build and maintain production pipelines
  • Deliver high-quality data sets that drive business decisions
  • Be embedded within the business unit attending stakeholder meetings
  • Translate ambiguous requirements into technical specs
  • Manage your domain end to end
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

I'm working with a leading global hedge fund that is looking to hire a Data Deve...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software and/or data engineering experience
  • Strong development experience in Python or C#, ideally both
  • Expert-level SQL skills
  • Strong experience with relational databases, data modelling and schema design
  • Experience building ETL pipelines and data-driven applications
  • Strong problem-solving ability and a genuine interest in understanding systems end-to-end
  • Excellent communication skills and the ability to work directly with business users
Job Responsibility
Job Responsibility
  • Design and develop data models, reporting solutions and analytics platforms
  • Build and enhance ETL pipelines and data processing workflows
  • Develop applications and tooling using Python
  • Design and optimise database schemas and reporting architectures
  • Create and tune complex SQL queries for reporting, reconciliation and analytics
  • Work directly with business stakeholders to gather requirements and deliver solutions
  • Support and modernise existing reporting and analytics platforms
  • Fulltime
Read More
Arrow Right