CrawlJobs Logo
Airwallex Logo Airwallex · IT - Software Development

Engineering Manager, Realtime Data Platform

Singapore, Singapore · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

As the Manager for Realtime Data Platform, a team within the Knowledge Platform, you will oversee large-scale, cross-functional initiatives that impact the entire data ecosystem. You will be responsible for defining the multi-year vision and technical roadmap for all real-time data analysis and serving needs, ensuring they are aligned with broader business objectives and product goals. A key aspect of your role will also include scaling the engineering teams, defining new roles, and establishing best practices for communication and collaboration across multiple sub-teams.

Job Responsibility

  • Provide visionary technical leadership and define a clear 1-3 year strategic roadmap for the Realtime Data Platform
  • Lead the multi-year effort to modernize our core data platform, introducing real-time analytical processing at petabyte scale
  • Partner with product teams to enable new data-driven features, such as AI-powered applications or real-time dashboards, by ensuring the underlying platform capabilities are in place
  • Successfully scale and structure the engineering teams, including hiring new talent and mentoring managers and senior individual contributors
  • Cultivate and maintain strong relationships with product and other engineering teams, serving as a trusted technical advisor on all things Data and AI

Requirements

  • A minimum of 8 years of experience in data or software engineering
  • At least 3 years in a leadership or management role
  • Proven experience successfully managing and scaling an engineering team of 10+ people, including managers and senior individual contributors
  • Demonstrated ability to define and execute a technical strategy that led to a significant business outcome or operational improvement
  • Strong command of the data and software engineering domains, with a focus on architecture and strategy
  • Deep understanding of distributed data processing technologies (e.g., Apache Spark, Databricks) and event streaming (e.g., Kafka)
  • Solid knowledge of modern data storage and serving technologies, such as CubeJS, ElasticSearch, and Clickhouse, and more
  • Familiarity with observability tooling such as Splunk, Grafana, and Prometheus

Nice to have

  • Experience within the financial domain
  • Hands-on design experience in crafting data processing patterns for a modern Lakehouse architecture
  • Excellent written and verbal communication skills tailored for diverse audiences (leadership, users, company-wide)
  • Ability to rapidly evaluate various technologies and conduct proof of concepts to drive architecture design
  • Experience thriving in a complex environment

What we offer

  • Competitive salary plus valuable equity
  • Collaborative open office space with a fully stocked kitchen
  • Regular team-building events
  • Freedom to be creative
Airwallex - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Engineering Manager, Realtime Data Platform

8 matching positions

Senior Engineering Manager, ML Platform

We’re looking for hands-on builders–intellectually curious, deeply technical lea...
Location
Location
United States , San Francisco, CA; Los Angeles, CA; New York, NY; Seattle, WA
Salary
Salary:
255000.00 - 345000.00 USD / Year
whatnot.com Logo
Whatnot
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of engineering management experience developing production machine learning systems at consumer-scale loads
  • Bachelor’s degree in Computer Science, Statistics, Applied Mathematics or a related technical field, or equivalent work experience
  • 5+ years of hands-on software engineering experience building and maintaining production systems for consumer-scale loads
  • 1+ years of professional experience developing software in Python
  • Ability to work autonomously and drive initiatives across multiple product areas and communicate findings with leadership and product teams
  • Experience with operational, search, and key-value databases such as PostgreSQL, DynamoDB, Elasticsearch, Redis
  • Experience working with with ML-specific tools and frameworks such as MLFlow, LitServe, TorchServe, Triton
  • Firm grasp of visualization tools for monitoring and logging e.g. DataDog, Grafana
  • Familiarity with cloud computing platforms and managed services such as AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Apache Kafka, Flink
  • Professionalism around collaborating in a remote working environment and well tested, reproducible work
Job Responsibility
Job Responsibility
  • Own the infrastructure powering AI and ML models across critical business surfaces–supporting growth, recommendations, trust and safety, fraud, seller tooling, and more
  • Guide the prototyping, deployment, and productionization of novel ML architectures that directly shape user experience and marketplace dynamics
  • Help design and scale inference infrastructure capable of serving large models with low latency and high throughput
  • Oversee and evolve real-time feature pipelines that feed both our online and offline stores, ensuring single-second feedback from behavioral signals, high reliability, and model training fidelity
  • Drive feature platform improvements and expand scope to cover non-ML use cases such as fraud rules where point-in-time backtesting is also critical
  • Lead the development of distributed training and inference pipelines leveraging GPUs and both model and data parallelism
  • Optimize system performance by managing resource utilization and developing intelligent feature caching strategies
  • Empower scientists to iterate faster by building abstractions, APIs, and developer tools that simplify the development of near-realtime features and model iteration
  • Roll out ever-better ergonomics around model training and deployment
  • Stretch beyond your comfort zone to take on new technical challenges as we scale AI across Whatnot’s ecosystem
What we offer
What we offer
  • Generous Holiday and Time off Policy
  • Health Insurance options including Medical, Dental, Vision
  • Work From Home Support
  • Home office setup allowance
  • Monthly allowance for cell phone and internet
  • Care benefits
  • Monthly allowance for wellness
  • Annual allowance towards Childcare
  • Lifetime benefit for family planning, such as adoption or fertility expenses
  • Retirement
  • Fulltime
Read More
Arrow Right

Engineering Manager, Core Entities & Trip Intelligence

Airbnb was born in 2007 when two hosts welcomed three guests to their San Franci...
Location
Location
United States
Salary
Salary:
212000.00 - 265000.00 USD / Year
airbnb.com Logo
Airbnb
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 9+ years of industry experience, including 3-5+ years in engineering management
  • Bachelor's, Master's, or PhD in Computer Science, Data Engineering, or a related field
  • Background in data engineering, platform engineering, or data infrastructure — you understand entity modeling, schema evolution, data contracts, and what it takes to build systems that downstream teams can rely on
  • Hands-on fluency with distributed data systems: batch and streaming pipelines, online and offline serving, or event-driven architectures — sufficient to drive design reviews and challenge engineers on tradeoffs
  • Experience building in a cross-functional platform role — you have navigated the tension between what producers can deliver and what consumers need, and you know how to make progress without direct authority over every team in the chain
  • Comfort with greenfield work: you have built something from a blank schema or an early-stage spec, not just inherited a running system
  • Strong instinct for what belongs in shared infrastructure versus what stays in a product team
  • Clear communicator: able to represent technical decisions to senior leadership and keep producers and consumers aligned across a program with many moving parts
  • Commitment to engineering excellence, diversity, and belonging
Job Responsibility
Job Responsibility
  • Drive entity onboarding with producer teams across the company — unblock teams stuck on data quality issues, resolve schema ambiguity, and close the gap between what the platform promises and what data owners actually experience
  • Lead technical design on the trip entity — data model, lifecycle event taxonomy, real-time streaming architecture, and privacy-safe handling of message and conversation data
  • Closely partner with compute and data infrastructure teams to drive the state-of-the-art for realtime data processing at Airbnb
  • Partner with proactive trip support, customer support triage, and host AI product teams to validate that the signal layer meets their actual use cases, not a spec written in isolation
  • Review designs spanning attribute serving, real-time event pipelines, and cross-system entity mapping
  • Work closely with the principal engineer and program manager on roadmap sequencing and escalation of infrastructure dependencies
  • Manage and develop a team of ~7 engineers — own their careers, not just their sprint output
  • Represent entity platform work in executive-level program reviews
  • this program is a direct priority for Airbnb's engineering leadership
What we offer
What we offer
  • Bonus
  • Equity
  • Employee Travel Credits
  • Fulltime
Read More
Arrow Right
New

Sr Engineers, Cybersecurity

At T-Mobile, we invest in YOU!  Our Total Rewards Package ensures that employees...
Location
Location
United States , Overland Park
Salary
Salary:
129217.62 - 152300.00 USD / Year
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree in Computer Science, Information Technology, or related field, and 3 years of relevant work experience
  • Bachelor’s degree in Computer Science, Information Technology, or related field, and 5 years of relevant work experience
  • Managing and configuring Web Application Firewall (WAF) using Akamai and Imperva WAF to secure business-critical web applications against Open Web Application Security Project (OWASP) Top 10 vulnerabilities, Distributed Denial of Service (DDoS) attacks, volumetric attacks and other cyber threats
  • Monitoring realtime traffic patterns to identify anomalies and Advanced Persistent Threat (APT) with Akamai Web Security Analytics and iteratively fine-tuning WAF security configurations to minimize false positives while enhancing both performance and security
  • Performing security assessment using Dynamic Application Security Testing (DAST), Static Application Security Testing (SAST), Interactive Application Security Testing (IAST), Runtime Application Self-Protection (RASP) and Software Composition Analysis (SCA) through Burp Suite, ZAP, Postman, SonarQube, Contrast Security and OWASP Dependency-Check
  • Conducting mobile application security assessments by performing threat modeling using OWASP Mobile Application Security Verification Standard (MASVS) to uncover security flaws utilizing Mobile Security Framework (MobSF), NowSecure Platform, Frida, Android Studio and JADX
  • Managing cybersecurity platforms HackerOne and Bugcrowd, including setting up the program policies and scope, handling bug triage, validation, severity assessment via the Common Vulnerability Scoring System (CVSS) and overseeing bounty payments
  • Developing automation scripts on demand to streamline security processes related to WAF management and vulnerability detection using Bash, Go, Python, PHP, HTML and Postman
  • Implementing threat modeling techniques, including STRIDE, PASTA, TRIKE, ATTACK TREE, DREAD, KILL CHAIN, CAPEC, Mobile Application threat models, Cyber Threat Tree, or data flow diagrams to identify, assess and reduce security risks
  • At least 18 years of age
Job Responsibility
Job Responsibility
  • Improve process efficiency by creating and implementing creative and sustainable changes to existing deployment methodologies
  • Lead the identification of security needs & recommends plans/resolutions
  • Implements, tests & monitors info security improvements
  • Maintain visibility inside & outside of information security at the People management level
  • Interfaces with groups such as application support, engineering ops, finance, privacy, risk management, etc
  • Lead information security policy lifecycle throughout, including intake, creation, review, approval, implementation, publishing, communication & maintenance
  • Execute security projects driven by groups both internal and external to info security
  • Mentor peers and junior team members in security technologies, enterprise solution design and facilitation and effective customer interaction
  • Act as Subject Matter Expert in multiple facets of network & information security, including Firewall policy design, SSL Certificate management, vulnerability analysis & mitigation, and other topics as assigned
  • Lead the design and integration of IP/Security solutions within wireless network architectures, ensuring alignment with advanced cybersecurity standards and best practices
What we offer
What we offer
  • Annual stock grant
  • Employee stock purchase plan
  • 401(k)
  • Access to free, year-round money coaches
  • Medical, dental and vision insurance
  • Flexible spending account
  • Paid time off
  • Up to 12 paid holidays
  • Paid parental and family leave
  • Family building benefits
  • Fulltime
Read More
Arrow Right

Python with AI Engineering - Vice President

We are seeking a highly experienced and motivated Lead Data Engineer to join our...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field
  • 10-15 years of progressive experience in Data Engineering roles within the finance industry
  • Proven expertise in Oracle SQL and PL/SQL for complex data manipulation, stored procedures, functions, and database performance optimization
  • Strong proficiency in Python for data processing, scripting, and application development, with a focus on writing high-performance, efficient code
  • Extensive experience with job scheduling tools, specifically Autosys, including job definition, dependency management, and monitoring
  • Solid understanding and hands-on experience with Unix/Linux operating systems, including shell scripting and command-line tools
  • Demonstrated experience in implementing and maintaining CI/CD pipelines for data engineering projects
  • Deep understanding of data warehousing concepts, ETL/ELT principles, and data modeling techniques
  • Methodology of AI includes Chunking, Embedding, AI Engineering, Prompt Engineering
  • Extensive Design Experience handling Large Data Volume
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable and high-performance data pipelines using various technologies to support business intelligence and analytical needs
  • Work closely with business users, analysts, and other engineering teams to understand data requirements and translate them into technical solutions
  • Develop and maintain complex SQL and PL/SQL scripts for data extraction, transformation, and loading (ETL) processes, primarily on Oracle databases, focusing on performance tuning and optimization
  • Implement and manage automation workflows using Autosys to schedule and monitor batch jobs, ensuring data availability and integrity
  • Develop and maintain data processing scripts and applications using Python, focusing on efficiency, reliability, writing performant code, and best practices
  • Manage and operate data processes within a Unix/Linux environment, including scripting for process automation, monitoring, and troubleshooting
  • Contribute to the continuous integration and continuous deployment (CI/CD) pipeline for data solutions, promoting automation and efficiency in software delivery
  • Ensure data quality, accuracy, and consistency across all data platforms
  • Explore, evaluate, and integrate Agentic AI frameworks and AI-driven tools to enhance productivity, automate routine tasks, and optimize data engineering workflows
  • Design, build, and deploy AI-driven solutions to solve complex business problems and enhance data analytics capabilities
  • Fulltime
Read More
Arrow Right

Sr. Cloud Infrastructure Engineer (Ai & Llm Platforms)

We are seeking a specialized Infrastructure Engineer to bridge the gap between o...
Location
Location
Salary
Salary:
Not provided
q6cyber.com Logo
Q6 Cyber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in DevOps, Platform Engineering, or SRE, with at least 1-2 years specifically focused on AI/ML infrastructure
  • Proven track record of building production-grade RAG pipelines or LLM-integrated applications
  • Thrives in 'day zero' environments where the tools and protocols (like MCP) are evolving weekly
  • Deep understanding of the security implications of LLMs (prompt injection, data leakage, and secure tool execution)
  • Experience working with substantial datasets (over 1bn objects, dozens or hundreds of TBs) and the challenges of leveraging AI tools with these data sets
  • Bachelor's degree or equivalent in computer science or related field
  • Cloud & Orchestration: AWS/GCP/Azure, Kubernetes, Terraform, Helm
  • AI Frameworks: LangChain, LlamaIndex, LangGraph
  • Data & Vectors: Pinecone, Milvus, Qdrant, or pgvector
  • Apache Kafka/Pulsar
Job Responsibility
Job Responsibility
  • Guide the architecture that will allow us to leverage AI tools with our large existing data stores and incoming streams of realtime intelligence
  • Work closely with other infrastructure engineers and software development teams to integrate AI tools into existing systems
  • Design, deploy, and maintain Model Context Protocol (MCP) servers to allow LLMs to securely interact with our internal databases, APIs, and external tooling
  • Build and orchestrate sandboxed, scalable environments (e.g., using Docker or specialized runtimes) where users can safely build and execute AI agents
  • Develop and manage the infrastructure for our internal RAG (Retrieval-Augmented Generation) pipeline, including vector database management (e.g., Pinecone, Weaviate, or pgvector) and automated embedding pipelines
  • Utilize Kubernetes (K8s) and Infrastructure as Code (Terraform/Pulumi) to deploy LLM-related tools, ensuring high availability and low latency for model inference and data retrieval
  • Implement strict guardrails for data privacy within LLM workflows, ensuring internal datasets remain secure while being accessible to authorized AI tools
What we offer
What we offer
  • We offer a competitive compensation package and comprehensive benefits package
  • Fulltime
Read More
Arrow Right

Voice Ai Technical Lead

Whitehall Resources are looking for a Voice AI Technical Lead. This role is hybr...
Location
Location
United Kingdom , Windsor
Salary
Salary:
Not provided
whitehallresources.com Logo
Whitehall Resources Ltd
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15 years of domain experience and 5-6 years Voice AI / IVA / voice
  • Proven track record of delivering Voice AI / IVA / voice bot solutions into production at meaningful scale – not PoCs or demos, but real services handling real customer calls
  • Strong hands-on technical background, comfortable reviewing architectures, reading code, challenging latency budgets and prototyping when needed
  • Direct experience with LLM-based voice platforms such as Amazon Nova Sonic, ElevenLabs, OpenAI Realtime, Google Gemini Live or equivalents, and a clear view on the tradeoffs between them
  • Experience integrating conversational AI with contact-centre infrastructure – IVR, CTI, telephony, CRM, billing and knowledge systems – and delivering clean, context-aware handoffs to human agents
  • Demonstrable ability to estimate, scope and size features accurately in an Agile delivery environment, and to explain and defend those estimates to stakeholders
  • Experience coaching and upskilling multidisciplinary teams – engineers, designers, BAs and QA – through pairing, mentoring, code review and written guidance, without formal line-management authority
  • Comfort working in regulated / high-compliance environments, including GDPR, PII handling, PEN testing and security governance
Job Responsibility
Job Responsibility
  • Lead the Voice AI engineering team as a hands-on technical lead. Setting direction, reviewing designs and code, pairing with engineers, and writing production code yourself
  • Drive accurate sizing and estimation by establishing the engineering building blocks, reference implementations and reusable components that let the team break new features down into well-understood units of work
  • Raise the engineering bar across the team – introduce and enforce best practice for prompt engineering, evals, regression testing, latency budgeting, observability, CI/CD and release management for LLM-driven systems – through code review, pairing, internal guilds, brown-bags and written playbooks
  • Build the evaluation and test harness that every voice agent is measured against – automated scenario coverage, regression suites, latency and load testing, live call replay – so we know objectively whether each release is better than the last
  • Integrate voice agents cleanly with our contact-centre platform, CRM, billing, knowledge and identity systems, and design the handoff patterns that let us escalate to a human agent with full context
  • Partner with Data Security, InfoSec and our governance forums to streamline the engineering path to production – resolving incident runbooks, ownership models and PEN test blockers – and shorten our cycle time for every future release
  • Confirm and communicate the capability ceiling of our current stack, identify where different tooling is needed, and feed this back into the roadmap so we scope future packages based on engineering reality
Read More
Arrow Right

Adobe Engineer

Role - Adobe Engineer Location – Remote FTEOur Job Description Job Title : AEP E...
Location
Location
United States
Salary
Salary:
250000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Marketing Technology, or related field
  • 5+ years of experience in Adobe Teck stack either in Adobe campaign, CDP
  • Minimum 2+ projects hands-on experience in Adobe Experience Platform (AEP) implementation and operations
  • Proven expertise in Real-Time CDP ( RT-CDP) segmentation, Audience, profile activation, Configuration, Realtime events _ mobile /web, websDK integration
  • Hands-on experience with API-based audience creation and management
  • Minimum 2+ Projects hands on implementation of Adobe Journey optimizer
  • Strong knowledge of Adobe Journey Optimizer, AJO-D, journeys creation & integration, and offers decisioning
  • Experience with Adobe I/O, REST APIs, JSON, and XDM schemas
  • Understanding of data governance, identity resolution, and customer data pipelines
  • Exposure to Adobe Experience Cloud tools such as Workfront, AEM, CJA
Job Responsibility
Job Responsibility
  • Configure and manage AEP schemas, datasets, and data flows to build unified customer profiles
  • Implement and maintain data ingestion pipelines for real-time and batch data sources
  • Develop and deploy API-based audience creation and activation using AEP RT-CDP
  • Automate audience workflows and enable real-time data synchronization with downstream platforms
  • Collaborate with marketing and engineering teams to design scalable REST API-based integrations for audience delivery
  • Design and operationalize event-driven customer journeys leveraging AJO Decisioning capabilities
  • Configure decision rules, eligibility logic, and offer hierarchies for personalized experiences
  • Maintain compliance with data privacy regulations and internal governance standards
  • Document solutions, integration blueprints, and workflows to support ongoing platform maturity
  • Fulltime
Read More
Arrow Right

Data Architect

Location
Location
Canada , Toronto
Salary
Salary:
Not provided
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A Data Architect designs and governs enterprise data ecosystems ensuring data is structured, integrated, high quality, secure, and available for Realtime and analytical use.
  • Core Skills ODS architecture MongoDB No SQL relational database API integration Kafka real time data streaming
  • Data modeling, governance integrity
Job Responsibility
Job Responsibility
  • Design and implement ODS, data models, and end-to-end data architecture.
  • Build and optimize relational (SQL) and nonrelational (NoSQL MongoDB) databases
  • Develop API based integrations and ensure smooth data exchange across systems.
  • Architect and manage real time streaming pipelines using Kafka.
  • Maintain data integrity, quality, lineage, and governance across platforms.
  • Collaborate with engineering, business, and cloud teams to deliver scalable data solutions.
  • Fulltime
Read More
Arrow Right