CrawlJobs Logo
Airwallex Logo Airwallex · IT - Software Development

Data Platform Engineer II

Singapore, Singapore · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

In 2024, the Data Platform Engineering team is going to implement various data processing tasks on the newly built next-generation data platform. We aim to further optimize data storage, processing, application, interfaces, and other dimensions. Throughout the continuous iteration process, we will also incorporate new data components and consider new data architectures (such as Lake House) to achieve faster data scheduling, significantly reducing data latency and enabling more efficient operation of data engineering applications.

Job Responsibility

  • Design, build and maintain scalable and reliable batch and stream data pipelines for internal analytics and operational use cases
  • Participate in building data ingestion frameworks connecting internal systems with the centralized data platform using tools like Kafka, Flink, or Spark
  • Collaborate with senior engineers to define and maintain internal data engineering tools, standards, and practices
  • Contribute to automation and reliability improvements that reduce data latency and improve platform scalability
  • Assist with integration of external (third-party) data sources and handle data quality and consistency concerns
  • Work cross-functionally with product, engineering, and BI teams to translate business requirements into engineering solutions

Requirements

  • 3+ years of relevant experience as a data engineer
  • Bachelor's or Master's degree in CS/CE/CIS (or equivalent experience)
  • Knowledge of Kotlin / Java / Scala / Python / SQL
  • Knowledge of Kafka, Data Lake, Spark, Flink, DBT, Spring Boot, Hadoop, BigQuery, and Snowflake is preferred
  • Ability to work with senior/leader data platform engineers to design, build, and operate distributed systems and establishing overarching data architecture
  • Possess strong working knowledge of Real-time/Batch processing systems
  • Experience with working data at PB scale

What we offer

  • Competitive salary plus valuable equity
  • Collaborative open office space with a fully stocked kitchen
  • Regular team-building events
  • Freedom to be creative
Airwallex - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Platform Engineer II

8 matching positions

Software Engineer II - Data Platform

Tripadvisor is looking for a Software Engineer II to take this exciting opportun...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
tripadvisor.com Logo
Tripadvisor
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in commercial software development
  • A strong history of development with Java
  • Familiarity with Linux
  • Familiarity with designing infrastructure on AWS or other cloud providers
  • Bachelor of Science in Computer Science, Engineering or equivalent
  • Solid foundation in data structures, algorithms, and OO design
  • Willingness and ability to take on new technologies
  • Ability to break down complex problems into simple solutions
  • Strong analytical skills and desire to write clean, correct, and efficient code
  • Sense of ownership, urgency, and pride in your work
Job Responsibility
Job Responsibility
  • Take on projects with independence and a mandate to leave things better than you found them
  • Participate in the planning and initial steps for key changes on the site
  • Be pragmatic when solving problems with a deep understanding of the purpose and goal of your work
  • Touch code at all levels, from client ingestion to data storage, data analysis whatever is required to complete your project. Take responsibility for all aspects of software engineering, from design to implementation, QA, and maintenance
  • Have a CI/CD mindset. Most of our engineers release code to production every few days and we have a daily release cycle
  • Be integral for the code quality on your team through leadership in design and code review. Take responsibility for the quality of the code produced by you and the team
  • Operate across our evolving technology stack - we’re developing in Java, React, SQL, and more
  • Collaborate closely with Product and design teams to define feature specifications and develop high quality deliverables for our stakeholders
  • Work alongside other engineering groups located around the world
What we offer
What we offer
  • Competitive compensation packages (routinely benchmarked against the latest industry data), including base salary and annual bonuses
  • “Work your way” with flexibility to suit your lifestyle. Tripadvisor Group takes a remote-friendly approach to collaboration across a worldwide team, with the option to join on-site as often as you’d like or as required by your team
  • Flexible schedule. Work-life balance is ingrained in our culture by design. Trust and accountability make it work
  • Donation matching. Give back? Give more! We match qualifying charitable donations annually
  • Tuition assistance. Want to level up your career? We love to hear it! Receive annual support for qualified programs
  • Lifestyle benefit. An annual benefit to spend on yourself. Use it on travel, wellness, or whatever suits you
  • Generous referral scheme. Help us grow and be rewarded with generous bonuses for referring successful candidates
  • Travel perks. We believe that travel is employee development, so we provide discounts and more
  • Employee assistance program. We’re here for you with resources and programs to help you through life’s challenges
  • Health benefits. We offer great coverage and competitive premiums
Read More
Arrow Right

Software Engineer II, AI Data Platform (CoreAI)

The GenAI Infrastructure and Solutions team is building large-scale GenAI traini...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Collaborate with senior engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models
  • Design, build and improve the services with high scalability and reliability
  • Contribute to the deployment and monitoring of services in production environments
  • Participate in the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments
  • Fulltime
Read More
Arrow Right

Data Engineer II - Getting Customers Ready for AI

Security represents the most critical priorities for our customers in a world aw...
Location
Location
United States , Redmond
Salary
Salary:
102100.00 - 202200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years of software, data, or related engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer, and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years.
Job Responsibility
Job Responsibility
  • Design and build scalable data pipelines (batch and streaming) to process large volumes of security and operational data
  • Develop and optimize ETL/ELT workflows that transform raw telemetry into structured, consumable datasets
  • Implement data ingestion frameworks to integrate multi-source data from services, APIs, and event streams
  • Improve pipeline performance, reliability, and efficiency through partitioning, indexing, and optimization techniques
  • Design and evolve data models, schemas, and storage strategies for analytics and AI use cases
  • Work with distributed storage systems (e.g., data lakes, warehouses) to ensure scalability and cost efficiency
  • Maintain data partitioning, retention, and lifecycle strategies aligned to business and compliance needs
  • Ensure data is structured for downstream ML pipelines, feature engineering, and analytics workloads
  • Implement data validation, quality checks, and observability frameworks to ensure data accuracy and reliability
  • Apply best practices for data governance, lineage, and auditing across pipelines and datasets
  • Fulltime
Read More
Arrow Right

Data Engineer II

Do you have a relentless passion for data engineering and building platforms tha...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering. OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering. OR equivalent experience.
  • Ability to work and communicate effectively across disciplines and teams.
  • Familiarity with distributed data processing and analysis, such as Map-Reduce or Apache Spark.
Job Responsibility
Job Responsibility
  • Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C#.
  • Data extraction across a wide variety of data sources.
  • Data cleaning, preprocessing, and transformation for further analysis by data analysts.
  • Data Validation framework from source to endpoints ensuring data quality and integrity.
  • Enable the Data Scientists and Analysts to do more with data across all aspects of the development lifecycle.
  • Contribute to a data-driven culture as well as a culture of experimentation across the organization.
  • Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios.
  • Enable Data Scientists and other partners to do more with data across all aspects of the development lifecycle by helping democratize data.
  • Fulltime
Read More
Arrow Right

Data Engineer II

Data Engineering is the production engine behind Global Skilling's data-driven d...
Location
Location
United States , Multiple Locations
Salary
Salary:
102100.00 - 202200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years of experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience
  • Ability to meet Microsoft, customer, and/or government security screening requirements may be required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check — this position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Build and maintain production ETL pipelines ingesting data from 1st-party, 2nd-party, partner, and 3rd-party sources
  • Design and implement data-sharing patterns and access controls (RBAC) across organizational boundaries
  • Contribute to data mesh patterns, including data contracts, domain-owned datasets, and product-style publishing
  • Develop and maintain data governance solutions, including lineage, cataloging, data quality, and compliance
  • Design, build, and operate REST APIs and backend services that expose WISE datasets as data products
  • Define and manage API contracts, including schema design, versioning, and lifecycle management
  • Build serving layers supporting low-latency, request-response data access
  • Design and deliver Power BI semantic models, curated datasets, and reporting solutions
  • Build and support self-serve analytics experiences, including discoverability and performance optimization
  • Instrument pipelines and services through observability practices (metrics, logs, traces)
  • Fulltime
Read More
Arrow Right

Data Engineer II

We have a 6 month contract to hire opportunity for a hands-on Data Engineer with...
Location
Location
United States , Charlotte
Salary
Salary:
Not provided
zeektek.com Logo
Zeektek
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree
  • 2+ years of experience
  • Proven SQL experience
  • GIT
  • Teradata
Job Responsibility
Job Responsibility
  • Writes basic SELECT, INSERT, UPDATE, and DELETE statements with occasional guidance
  • Run a FastLoad or MultiLoad script with guidance
  • Independently writes multi-table joins, subqueries, and aggregations
  • Applies Teradata-specific syntax (QUALIFY, SAMPLE, DATE arithmetic) without guidance
  • Performs daily Git operations independently — commit, push, pull, branch
  • Resolves simple merge conflicts with guidance
  • Applies branching strategies (GitFlow or trunk-based) consistently
  • Performs rebases, cherry-picks, and resolves complex conflicts independently
  • Writes clear MR descriptions with context, testing notes, and linked issues
  • Gives specific, actionable review feedback
What we offer
What we offer
  • Weekly Direct Deposit
  • 401K Matching
  • Competitive medical, dental and vision insurance
  • Consistent communication throughout your project
  • ZeekTek Referral Program
  • Fulltime
Read More
Arrow Right

Software Engineer II (Data Center Packet Forwarding)

Designs, develops, troubleshoots and debugs software programs for software enhan...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent
  • Typically 2-4 years experience
  • Using software systems design tools and languages
  • Ability to apply analytical and problem solving skills
  • Designing software systems running on multiple platform types
  • Software systems testing methodology, including execution of test plans, debugging, and testing scripts and tools
  • Strong written and verbal communication skills
  • mastery in English and local language
  • Ability to effectively communicate design proposals and negotiate options
Job Responsibility
Job Responsibility
  • Designs limited enhancements, updates, and programming changes for portions and subsystems of systems software, including operating systems, compliers, networking, utilities, databases, and Internet-related tools
  • Analyzes design and determines coding, programming, and integration activities required based on specific objectives and established project guidelines
  • Executes and writes portions of testing plans, protocols, and documentation for assigned portion of application
  • identifies and debugs issues with code and suggests changes or improvements
  • Participates as a member of project team of other software systems engineers and internal and outsourced development partners to develop reliable, cost effective and high quality solutions for assigned systems portion or subsystem
  • Collaborates and communicates with internal and outsourced development partners regarding software systems design status, project progress, and issue resolution
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
Read More
Arrow Right

Data Engineer II

Microsoft is a company where passionate innovators come to collaborate, envision...
Location
Location
United States , Redmond
Salary
Salary:
102100.00 - 219200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Intermediate knowledge and experience with Microsoft data tools including Microsoft Fabric, Azure Data Factory, Azure Synapse, and Azure Databricks
  • Intermediate knowledge and experience with GIT operations and CICD flows
  • Advanced experience using a work management tool such as Azure DevOps
  • Advanced experience in time management and prioritization
  • Excellent written & verbal communication skills
  • Passion for data and the desire to learn & adopt new technologies
Job Responsibility
Job Responsibility
  • Extract and transform disparate data into actionable insights that will drive business decisions
  • Drive development projects to evolve our platform and operations, leveraging the newest Microsoft technologies
  • Contribute to the success of Azure Data by trying out and testing new products and features, contributing to design of major feature enhancements, and providing direct feedback to Product Group
  • Work directly with business stakeholders to refine requirements, iterate and finalize design, deliver proofs of concept, and develop final data solution
  • Live site and on call DRI duty for maintaining high availability of analytics solutions
  • Collaborate with peers and maintain flexibility on domain ownership
  • Work with other data teams within Microsoft on understanding their data products and onboarding them
  • Fulltime
Read More
Arrow Right