CrawlJobs Logo

Data Platform Engineer II

Airwallex

Location Icon

Location:
Singapore , Singapore

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

In 2024, the Data Platform Engineering team is going to implement various data processing tasks on the newly built next-generation data platform. We aim to further optimize data storage, processing, application, interfaces, and other dimensions. Throughout the continuous iteration process, we will also incorporate new data components and consider new data architectures (such as Lake House) to achieve faster data scheduling, significantly reducing data latency and enabling more efficient operation of data engineering applications.

Job Responsibility:

  • Design, build and maintain scalable and reliable batch and stream data pipelines for internal analytics and operational use cases
  • Participate in building data ingestion frameworks connecting internal systems with the centralized data platform using tools like Kafka, Flink, or Spark
  • Collaborate with senior engineers to define and maintain internal data engineering tools, standards, and practices
  • Contribute to automation and reliability improvements that reduce data latency and improve platform scalability
  • Assist with integration of external (third-party) data sources and handle data quality and consistency concerns
  • Work cross-functionally with product, engineering, and BI teams to translate business requirements into engineering solutions

Requirements:

  • 3+ years of relevant experience as a data engineer
  • Bachelor's or Master's degree in CS/CE/CIS (or equivalent experience)
  • Knowledge of Kotlin / Java / Scala / Python / SQL
  • Knowledge of Kafka, Data Lake, Spark, Flink, DBT, Spring Boot, Hadoop, BigQuery, and Snowflake is preferred
  • Ability to work with senior/leader data platform engineers to design, build, and operate distributed systems and establishing overarching data architecture
  • Possess strong working knowledge of Real-time/Batch processing systems
  • Experience with working data at PB scale
What we offer:
  • Competitive salary plus valuable equity
  • Collaborative open office space with a fully stocked kitchen
  • Regular team-building events
  • Freedom to be creative

Additional Information:

Job Posted:
February 21, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Platform Engineer II

Data Engineer II

As a data engineer in the People DE team, you will have the opportunity to apply...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 2 years professional experience as a software engineer or data engineer
  • A BS in Computer Science or equivalent experience
  • Strong programming skills (some combination of Python, Java, and Scala preferred)
  • Experience with data modeling
  • Experience in modern software development practices (Agile, TDD, CICD)
  • Knowledge of data warehousing concepts
  • Experience writing SQL, structuring data, and data storage practices
  • Experience building data pipelines, platforms, micro services, and REST APIs
  • Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data
  • A willingness to accept failure, learn and try again
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Data Engineer II

You will be part of a world-class Data Engineering team, where you will influenc...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s / Masters degree (or equivalent work experience) in a STEM field
  • 2+ Years of Experience in Data Engineering or related fields
  • Expertise in Python or other modern programming language development experience
  • Knowledge of advanced level capabilities in SQL and relational databases experience
  • Solid working knowledge of ETL (ELT), Data modeling, DataQuality, and Data Visualization/Dashboarding
  • Experience working with product analytics
Job Responsibility
Job Responsibility
  • influence product teams
  • inform Data Science and Analytics Platform teams
  • partner closely with data consumers and producers to ensure quality and usefulness of data assets
  • Defining metrics
  • Instrumenting logging
  • Acquiring/ingesting data
  • Architecting & modeling data
  • Transforming data
  • Ensuring data quality, governance, and enablement
  • Alerting, visualization, and reporting
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Data Engineer II

You will be part of a world-class Data Engineering team, where you will influenc...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s / Masters degree (or equivalent work experience) in a STEM field
  • 2+ Years of Experience in Data Engineering or related fields
  • Expertise in Python or other modern programming language development experience
  • Knowledge of advanced level capabilities in SQL and relational databases experience
  • Solid working knowledge of ETL (ELT), Data modeling, DataQuality, and Data Visualization/Dashboarding
  • Experience working with product analytics
Job Responsibility
Job Responsibility
  • influence product teams
  • inform Data Science and Analytics Platform teams
  • partner closely with data consumers and producers to ensure quality and usefulness of data assets
  • Defining metrics
  • Instrumenting logging
  • Acquiring/ingesting data
  • Architecting & modeling data
  • Transforming data
  • Ensuring data quality, governance, and enablement
  • Alerting, visualization, and reporting
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
  • Fulltime
Read More
Arrow Right

Data Engineer II

As a Data Engineer II on our Core Engineering Data Team, you will focus on build...
Location
Location
United States , Boston
Salary
Salary:
93200.00 - 136600.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field or equivalent practical experience
  • 2+ years of experience in software engineering, data engineering, or a related field
  • Foundational knowledge of AWS or other public cloud platforms (e.g., Azure, GCP)
  • Strong SQL knowledge and experience optimizing for data warehousing technologies like AWS Athena
  • Strong knowledge of Python for use in data transformation
  • Experience with ETL/ELT, schema design, and datalake technologies
  • Familiarity with various data and table formats (JSON, Avro, Parquet, Iceberg)
  • Love of data and a passion for building reliable data products
Job Responsibility
Job Responsibility
  • Develop and maintain efficient and reliable ETL/ELT data pipelines from product and service data sources to our centralized analytical platforms
  • Implement and monitor data pipeline orchestration using tools like Airflow or Dagster to ensure timely and accurate data delivery
  • Collaborate with senior engineers and analysts to understand requirements and implement technical solutions for data workflows
  • Perform routine monitoring of pipeline performance and reliability, assisting with troubleshooting and optimizing for efficiency
  • Contribute to the optimization of table structures and data storage to support various query and usage patterns
  • Support and maintain data discovery, catalog, and analytics tooling for internal teams
  • Assist in implementing data security measures and ensuring compliance with data governance policies
  • Write and maintain data quality validation checks and unit tests to ensure the integrity and reliability of data pipelines
  • Participate in team-wide discussions to help develop and refine team norms and engineering best practices
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits
  • Fulltime
Read More
Arrow Right

Data Engineer II

PagerDuty is looking for a Data Engineer II to join their global Enterprise Data...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
https://www.pagerduty.com Logo
PagerDuty
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience working in data integration, pipelines, and data modeling
  • experience designing and deploying code in Data platforms in a cloud-based and Agile environment
  • knowledge and experience of relational databases and being capable of writing complex SQL
  • experience working with Cloud-based Data Warehousing Platform such as Snowflake or AWS, or Databricks
  • experience with Python and SQL
  • experience working with SQL, AWS S3, and ETL/Automation Workflow tools like Workato
Job Responsibility
Job Responsibility
  • translate business requirements into data models that are easy to understand
  • design, implement, and build pipelines that deliver data with measurable quality under the SLA
  • partner with business domain experts, data analysts, and engineering teams to build foundational data sets
  • be a champion of the overall strategy for data governance, security, privacy, quality, and retention
  • own and document foundational company metrics with a clear definition and data lineage
  • contribute to the data ecosystem and build a strong data foundation for the company
  • design, implement, and scale data pipelines that transform billions of records into actionable data models
  • provide hands-on technical support to build trusted and reliable domain-specific datasets and metrics
What we offer
What we offer
  • competitive salary
  • comprehensive benefits package
  • flexible work arrangements
  • company equity
  • ESPP (Employee Stock Purchase Program)
  • retirement or pension plan
  • generous paid vacation time
  • paid holidays and sick leave
  • Dutonian Wellness Days & HibernationDuty
  • paid parental leave
  • Fulltime
Read More
Arrow Right

Software Engineer II - Connector Engineering

We are seeking a resourceful and versatile Software Engineer to join the team to...
Location
Location
India , Chennai
Salary
Salary:
Not provided
arcadia.com Logo
Arcadia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong technical skills in Core Java with prior experience working in support or maintenance projects
  • Strong understanding of data structures
  • Ability to work in kanban delivery model with good exposure to process
  • Ensure best practices in coding and quality standards for delivery
  • Worked on Kanban methodologies
  • Taking full ownership of converting requirements into design, code, unit test, deployment and delivery of functionality as per agreed timelines
  • Being a good team player with strong interpersonal skills
  • Know-how of troubleshooting/debugging application and code to resolve any issues in the platform
  • Being able to review other engineers work output and provide constructive feedback for the betterment of the solutions
  • Self-starter and should be willing to plunge to the bottom of a business problem to resolve
What we offer
What we offer
  • Competitive compensation based on market standards
  • Flexible Leave Policy
  • Office is in the heart of the city in case you need to step in for any purpose
  • Medical Insurance (1+5 Family Members)
  • We provide comprehensive coverage including accident policy and life Insurance
  • Annual performance cycle
  • Quarterly team engagement activities and rewards & recognitions
  • L&D programs to foster professional growth
  • A supportive engineering culture that values diversity, empathy, teamwork, trust, and efficiency
Read More
Arrow Right

Software Engineer II, Android Engineering

As a Software Engineer on Axon’s Robotics team, you’ll be at the forefront of tr...
Location
Location
United States , Boston
Salary
Salary:
120750.00 - 193200.00 USD / Year
axon.com Logo
Axon
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of industry experience shipping Android applications to the Google Play Store
  • Understand the ins and out of mobile phones
  • expected to lead mobile design reviews as well as the implementation of their designs to release and post-release monitoring
  • Experience with modern architecture (MVVM, MVI, etc) including unit testing
  • Android experience with Retrofit, Coroutines, Okhttp, Hilt, Jetpack Compose
  • Experience working with remote data via REST and JSON
  • Understanding and experience with networking protocols such as TCP, UDP, DHCP, DNS, Server-Sent-Events, Websockets (debugging with Wireshark or Charles a plus)
Job Responsibility
Job Responsibility
  • Lead engineering architecture and design reviews to ensure high standards in software quality
  • Collaborate with the Axon product design team to turn mobile UI designs into functional, engaging solutions
  • Drive the entire mobile software lifecycle, from prototyping to commercialization and post-launch support
  • Interface with cloud services for seamless integration across platforms
  • Set a high technical standard for the team through code and design reviews
  • Partner with Product, Design, and Engineering teams to deliver integrated solutions that meet customer needs
  • Enhance engineering processes, including sprint planning, stand-ups, and long-term planning
  • Build robust and reliable mission critical software that meets high standards for stability in mission-critical applications
  • Collaborate closely with other groups to align on goals, ensuring we deliver impactful and innovative solutions
What we offer
What we offer
  • Competitive salary and 401k with employer match
  • Discretionary time off
  • Paid parental leave for all
  • Medical, Dental, Vision plans
  • Fitness Programs
  • Emotional & Development Programs
  • snacks in our offices
  • Fulltime
Read More
Arrow Right

Data Engineer

Barbaricum is seeking a highly technical Data Engineer to drive the massive data...
Location
Location
United States , Tampa
Salary
Salary:
Not provided
barbaricum.com Logo
Barbaricum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BA/BS or MA/MS (preferred)
  • Years Exp: 3-10
  • CompTIA Security+ CE (or higher) to meet DoD 8570 IAT Level II requirements
  • Active Top-Secret clearance with SCI eligibility
  • Certified Kubernetes Administrator (CKA)
  • Data Discovery Expertise: Proven experience deploying and managing enterprise data discovery and governance platforms such as BigID, Varonis, NetApp BlueXP (Data Sense), or Informatica
  • Storage & Database Knowledge: Strong understanding of storage protocols (NFS, SMB/CIFS, S3) and database structures (SQL, NoSQL) to troubleshoot connectivity and scanning access
  • Containerization: Proficiency with Kubernetes and Docker, as many modern discovery collectors are deployed as containerized microservices
  • Data Handling: Experience dealing with large-scale data inventories (Petabyte scale) and understanding of data lineage and provenance concepts
Job Responsibility
Job Responsibility
  • Data Discovery Architecture: Deploy and manage BigID and NetApp BlueXP scanners across hybrid environments, including configuring dockerized collectors for air-gapped discovery on the Top-Secret network
  • Structured Data Mapping: Connect discovery tools to enterprise databases (SQL Server, Oracle, PostgreSQL) to scan schemas and columns for PII, DoD ID numbers, and other sensitive indicators without impacting database performance
  • Unstructured Data Crawling: Configure scans for massive file repositories (NetApp NAS, QNAP, SharePoint On-Premises), optimizing scan windows and throttling to prevent latency for mission users
  • Cloud Data Integration: Utilize Microsoft Purview Data Map and custom connectors to inventory data residing in AWS S3 buckets, Azure Blobs, and Data Lakes
  • Classification Tuning: Collaborate with mission owners to train Machine Learning (ML) classifiers to recognize unique USSOCOM data types (e.g., mission names, operational codes) and reduce false positive rates in the data inventory
Read More
Arrow Right