CrawlJobs Logo
Airwallex Logo Airwallex · IT - Software Development

Data Platform Engineer II

Singapore, Singapore · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

In 2024, the Data Platform Engineering team is going to implement various data processing tasks on the newly built next-generation data platform. We aim to further optimize data storage, processing, application, interfaces, and other dimensions. Throughout the continuous iteration process, we will also incorporate new data components and consider new data architectures (such as Lake House) to achieve faster data scheduling, significantly reducing data latency and enabling more efficient operation of data engineering applications.

Job Responsibility

  • Design, build and maintain scalable and reliable batch and stream data pipelines for internal analytics and operational use cases
  • Participate in building data ingestion frameworks connecting internal systems with the centralized data platform using tools like Kafka, Flink, or Spark
  • Collaborate with senior engineers to define and maintain internal data engineering tools, standards, and practices
  • Contribute to automation and reliability improvements that reduce data latency and improve platform scalability
  • Assist with integration of external (third-party) data sources and handle data quality and consistency concerns
  • Work cross-functionally with product, engineering, and BI teams to translate business requirements into engineering solutions

Requirements

  • 3+ years of relevant experience as a data engineer
  • Bachelor's or Master's degree in CS/CE/CIS (or equivalent experience)
  • Knowledge of Kotlin / Java / Scala / Python / SQL
  • Knowledge of Kafka, Data Lake, Spark, Flink, DBT, Spring Boot, Hadoop, BigQuery, and Snowflake is preferred
  • Ability to work with senior/leader data platform engineers to design, build, and operate distributed systems and establishing overarching data architecture
  • Possess strong working knowledge of Real-time/Batch processing systems
  • Experience with working data at PB scale

What we offer

  • Competitive salary plus valuable equity
  • Collaborative open office space with a fully stocked kitchen
  • Regular team-building events
  • Freedom to be creative
Airwallex - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Platform Engineer II

8 matching positions

Data Engineer II

As a Data Engineer II on our Core Engineering Data Team, you will focus on build...
Location
Location
United States , Boston
Salary
Salary:
93200.00 - 136600.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field or equivalent practical experience
  • 2+ years of experience in software engineering, data engineering, or a related field
  • Foundational knowledge of AWS or other public cloud platforms (e.g., Azure, GCP)
  • Strong SQL knowledge and experience optimizing for data warehousing technologies like AWS Athena
  • Strong knowledge of Python for use in data transformation
  • Experience with ETL/ELT, schema design, and datalake technologies
  • Familiarity with various data and table formats (JSON, Avro, Parquet, Iceberg)
  • Love of data and a passion for building reliable data products
Job Responsibility
Job Responsibility
  • Develop and maintain efficient and reliable ETL/ELT data pipelines from product and service data sources to our centralized analytical platforms
  • Implement and monitor data pipeline orchestration using tools like Airflow or Dagster to ensure timely and accurate data delivery
  • Collaborate with senior engineers and analysts to understand requirements and implement technical solutions for data workflows
  • Perform routine monitoring of pipeline performance and reliability, assisting with troubleshooting and optimizing for efficiency
  • Contribute to the optimization of table structures and data storage to support various query and usage patterns
  • Support and maintain data discovery, catalog, and analytics tooling for internal teams
  • Assist in implementing data security measures and ensuring compliance with data governance policies
  • Write and maintain data quality validation checks and unit tests to ensure the integrity and reliability of data pipelines
  • Participate in team-wide discussions to help develop and refine team norms and engineering best practices
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits
  • Fulltime
Read More
Arrow Right

Data Engineer II

PagerDuty is looking for a Data Engineer II to join their global Enterprise Data...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
https://www.pagerduty.com Logo
PagerDuty
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience working in data integration, pipelines, and data modeling
  • experience designing and deploying code in Data platforms in a cloud-based and Agile environment
  • knowledge and experience of relational databases and being capable of writing complex SQL
  • experience working with Cloud-based Data Warehousing Platform such as Snowflake or AWS, or Databricks
  • experience with Python and SQL
  • experience working with SQL, AWS S3, and ETL/Automation Workflow tools like Workato
Job Responsibility
Job Responsibility
  • translate business requirements into data models that are easy to understand
  • design, implement, and build pipelines that deliver data with measurable quality under the SLA
  • partner with business domain experts, data analysts, and engineering teams to build foundational data sets
  • be a champion of the overall strategy for data governance, security, privacy, quality, and retention
  • own and document foundational company metrics with a clear definition and data lineage
  • contribute to the data ecosystem and build a strong data foundation for the company
  • design, implement, and scale data pipelines that transform billions of records into actionable data models
  • provide hands-on technical support to build trusted and reliable domain-specific datasets and metrics
What we offer
What we offer
  • competitive salary
  • comprehensive benefits package
  • flexible work arrangements
  • company equity
  • ESPP (Employee Stock Purchase Program)
  • retirement or pension plan
  • generous paid vacation time
  • paid holidays and sick leave
  • Dutonian Wellness Days & HibernationDuty
  • paid parental leave
  • Fulltime
Read More
Arrow Right

Software Engineer II - Connector Engineering

We are seeking a resourceful and versatile Software Engineer to join the team to...
Location
Location
India , Chennai
Salary
Salary:
Not provided
arcadia.com Logo
Arcadia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong technical skills in Core Java with prior experience working in support or maintenance projects
  • Strong understanding of data structures
  • Ability to work in kanban delivery model with good exposure to process
  • Ensure best practices in coding and quality standards for delivery
  • Worked on Kanban methodologies
  • Taking full ownership of converting requirements into design, code, unit test, deployment and delivery of functionality as per agreed timelines
  • Being a good team player with strong interpersonal skills
  • Know-how of troubleshooting/debugging application and code to resolve any issues in the platform
  • Being able to review other engineers work output and provide constructive feedback for the betterment of the solutions
  • Self-starter and should be willing to plunge to the bottom of a business problem to resolve
What we offer
What we offer
  • Competitive compensation based on market standards
  • Flexible Leave Policy
  • Office is in the heart of the city in case you need to step in for any purpose
  • Medical Insurance (1+5 Family Members)
  • We provide comprehensive coverage including accident policy and life Insurance
  • Annual performance cycle
  • Quarterly team engagement activities and rewards & recognitions
  • L&D programs to foster professional growth
  • A supportive engineering culture that values diversity, empathy, teamwork, trust, and efficiency
Read More
Arrow Right

Software Engineer II, Android Engineering

As a Software Engineer on Axon’s Robotics team, you’ll be at the forefront of tr...
Location
Location
United States , Boston
Salary
Salary:
120750.00 - 193200.00 USD / Year
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of industry experience shipping Android applications to the Google Play Store
  • Understand the ins and out of mobile phones
  • expected to lead mobile design reviews as well as the implementation of their designs to release and post-release monitoring
  • Experience with modern architecture (MVVM, MVI, etc) including unit testing
  • Android experience with Retrofit, Coroutines, Okhttp, Hilt, Jetpack Compose
  • Experience working with remote data via REST and JSON
  • Understanding and experience with networking protocols such as TCP, UDP, DHCP, DNS, Server-Sent-Events, Websockets (debugging with Wireshark or Charles a plus)
Job Responsibility
Job Responsibility
  • Lead engineering architecture and design reviews to ensure high standards in software quality
  • Collaborate with the Axon product design team to turn mobile UI designs into functional, engaging solutions
  • Drive the entire mobile software lifecycle, from prototyping to commercialization and post-launch support
  • Interface with cloud services for seamless integration across platforms
  • Set a high technical standard for the team through code and design reviews
  • Partner with Product, Design, and Engineering teams to deliver integrated solutions that meet customer needs
  • Enhance engineering processes, including sprint planning, stand-ups, and long-term planning
  • Build robust and reliable mission critical software that meets high standards for stability in mission-critical applications
  • Collaborate closely with other groups to align on goals, ensuring we deliver impactful and innovative solutions
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Development Programs
  • snacks in our offices
  • Fulltime
Read More
Arrow Right

Data Engineer

Barbaricum is seeking a highly technical Data Engineer to drive the massive data...
Location
Location
United States , Tampa
Salary
Salary:
Not provided
barbaricum.com Logo
Barbaricum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BA/BS or MA/MS (preferred)
  • Years Exp: 3-10
  • CompTIA Security+ CE (or higher) to meet DoD 8570 IAT Level II requirements
  • Active Top-Secret clearance with SCI eligibility
  • Certified Kubernetes Administrator (CKA)
  • Data Discovery Expertise: Proven experience deploying and managing enterprise data discovery and governance platforms such as BigID, Varonis, NetApp BlueXP (Data Sense), or Informatica
  • Storage & Database Knowledge: Strong understanding of storage protocols (NFS, SMB/CIFS, S3) and database structures (SQL, NoSQL) to troubleshoot connectivity and scanning access
  • Containerization: Proficiency with Kubernetes and Docker, as many modern discovery collectors are deployed as containerized microservices
  • Data Handling: Experience dealing with large-scale data inventories (Petabyte scale) and understanding of data lineage and provenance concepts
Job Responsibility
Job Responsibility
  • Data Discovery Architecture: Deploy and manage BigID and NetApp BlueXP scanners across hybrid environments, including configuring dockerized collectors for air-gapped discovery on the Top-Secret network
  • Structured Data Mapping: Connect discovery tools to enterprise databases (SQL Server, Oracle, PostgreSQL) to scan schemas and columns for PII, DoD ID numbers, and other sensitive indicators without impacting database performance
  • Unstructured Data Crawling: Configure scans for massive file repositories (NetApp NAS, QNAP, SharePoint On-Premises), optimizing scan windows and throttling to prevent latency for mission users
  • Cloud Data Integration: Utilize Microsoft Purview Data Map and custom connectors to inventory data residing in AWS S3 buckets, Azure Blobs, and Data Lakes
  • Classification Tuning: Collaborate with mission owners to train Machine Learning (ML) classifiers to recognize unique USSOCOM data types (e.g., mission names, operational codes) and reduce false positive rates in the data inventory
Read More
Arrow Right

IT Engineer II

Affirm is reinventing credit to make it more honest and friendly, giving consume...
Location
Location
United States
Salary
Salary:
102000.00 - 155000.00 USD / Year
affirm.com Logo
Affirm
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3–5 years of experience in IT Engineering, Systems Administration, or Solutions Engineering within a SaaS or enterprise environment
  • Deep understanding of modern SaaS ecosystems, SSO/SCIM integrations, and identity/access management frameworks (e.g., Okta, Azure AD)
  • Hands-on experience coding and automating with APIs and scripting languages (Python, JavaScript/TypeScript)
  • Strong communication and stakeholder management skills—capable of bridging business goals with technical implementation
  • Demonstrated ability to manage multiple priorities and deliver measurable results in a dynamic, fast-paced environment
Job Responsibility
Job Responsibility
  • Technical Strategy & Systems Design: Partner with business and technical stakeholders to translate requirements into scalable, secure, and user-centric solutions. Design architectures that integrate SaaS platforms, identity systems, and automations across the enterprise
  • Automation & Integration Development: Build and maintain automations using REST APIs, scripting languages (Python, JavaScript/TypeScript), and workflow platforms (e.g., Okta Workflows, Workato, Zapier). Streamline repetitive processes and strengthen cross-system interoperability
  • AI & Emerging Technology Enablement: Leverage AI-assisted tools to accelerate development, incident response, and documentation. Experiment with generative AI and workflow intelligence to improve IT operations and knowledge management
  • Operational Reliability & Security: Enhance the reliability and resilience of critical IT services. Implement monitoring, alerting, and governance practices that protect data and maintain compliance with security standards
  • Incident Resolution & Root Cause Analysis: Troubleshoot technical issues efficiently, conduct root cause analyses, and deliver durable long-term fixes that reduce operational noise and support business continuity
  • Knowledge Sharing & Collaboration: Create and maintain technical documentation, playbooks, and process diagrams. Mentor teammates and contribute to a culture of transparency, automation, and continuous improvement
What we offer
What we offer
  • Health care coverage - Affirm covers all premiums for all levels of coverage for you and your dependents
  • Flexible Spending Wallets - generous stipends for spending on Technology, Food, various Lifestyle needs, and family forming expenses
  • Time off - competitive vacation and holiday schedules allowing you to take time off to rest and recharge
  • ESPP - An employee stock purchase plan enabling you to buy shares of Affirm at a discount
  • Fulltime
Read More
Arrow Right

Data Scientist II

At Amazon, we strive to be Earth's most customer-centric company, where customer...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amazon.de Logo
Amazon Pforzheim GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2+ years of data scientist experience
  • 3+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, etc.) experience
  • 3+ years of machine learning/statistical modeling data analysis tools and techniques, and parameters that affect their performance experience
  • Experience applying theoretical models in an applied environment
Job Responsibility
Job Responsibility
  • Analyze terabytes of data to define and deliver on complex analytical deep dives to unlock insights and build scalable solutions through Data Science to ensure security of Amazon’s platform and transactions
  • Build Machine Learning and/or statistical models that evaluate the transaction legitimacy and track impact over time
  • Ensure data quality throughout all stages of acquisition and processing, including data sourcing/collection, ground truth generation, normalization, transformation, and cross-lingual alignment/mapping
  • Define and conduct experiments to validate/reject hypotheses, and communicate insights and recommendations to Product and Tech teams
  • Develop efficient data querying infrastructure for both offline and online use cases
  • Collaborate with cross-functional teams from multidisciplinary science, engineering and business backgrounds to enhance current automation processes
  • Learn and understand a broad range of Amazon’s data resources and know when, how, and which to use and which not to use.
  • Maintain technical document and communicate results to diverse audiences with effective writing, visualizations, and presentations
Read More
Arrow Right

Software Engineer II

EnergyHub empowers utilities and their customers to create a clean, distributed ...
Location
Location
United States
Salary
Salary:
105000.00 - 125000.00 USD / Year
energyhub.com Logo
EnergyHub
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years professional software engineering experience, preferably in a small to medium-sized team, with a proven exceptional ability as a FullStack engineer or similar role
  • Strong comfortability with Kotlin/Java and familiarity with web services and RESTful APIs using Spring
  • Expertise in API ingestion and data normalization processes
  • Experience with front end languages, such as React/Typescript
  • Experience with containerized systems
  • Knowledge of modern security best practices, authentication/authorization frameworks, and system/API hardening.
Job Responsibility
Job Responsibility
  • Develop and maintain the backend services of our EV platform, ensuring that all components work together seamlessly
  • Integrate with third-party APIs to implement external services into our platform, enhancing OEM partners and other external solutions
  • Manage ingestion and storage of multivariate data sets that can scale to millions of users/connected vehicles
  • Build and enhance data lakes to provide additional data analysis for different services and consumers
  • Develop services to interact with connected vehicles at scale
  • Develop and maintain front end “web apps” to provide UIs for our various different products and services
  • Ensure proper security and data protection policies, procedures, and monitoring are in place
  • Design, develop, and maintain third-party accessible APIs for data ingest/egress within the platform
  • Write and maintain technical documentation
  • Drive and embody the “Dev Owns Quality” culture
What we offer
What we offer
  • 100% paid medical for employees
  • 401(k) with employer match
  • Casual environment
  • Flexibility to set your own schedule
  • Fully stocked fridge and pantry
  • Free Citi Bike membership
  • Secure bike rack
  • Gym subsidy
  • Paid parental leave
  • Education assistance program
  • Fulltime
Read More
Arrow Right