CrawlJobs Logo
HSO Logo HSO · IT - Software Development

Senior Data Platform Engineer

Australia, Sydney · Job Posted June 29, 2026
Apply Position
Job Link Share

Job Responsibility

  • Lead the design, implementation, testing, deployment and ongoing support of our modern Azure based solutions
  • Apply proven architectural patterns and best practices to deliver secure, scalable and maintainable solutions
  • Play a senior role in the delivery of software solutions, and contribute to our data platform engagements
  • Manage and oversee less experienced staff, reviewing code, overseeing the development and ensuring best-practice standards are applied to all solutions
  • Build and deploy solutions using DevOps and Infrastructure as Code practices
  • Deploy solutions using a variety of Azure services, adapting approaches based on customer context and maturity
  • Work directly with customers to understand requirements, shape solution direction and identify opportunities for innovation
  • Translate complex technical concepts into clear, business focused outcomes for non technical stakeholders
  • Facilitate customer workshops, proof of concepts and technical deep dives to support adoption and capability uplift
  • Act as a trusted technical advisor throughout the delivery lifecycle
  • Be prepared to take a technical leadership role in projects, working closely with our Project Managers to ensure projects are delivered on time, to scope and of high quality
  • Manage complex and changing requirements directly with our customers and ensure work is delivered to scope while maintaining excellent customer relationships
  • Act as a technical leader and mentor across HSO, supporting engineers to grow their skills and confidence
  • Lead by example in adopting new Microsoft technologies, tools and ways of working
  • Embrace a role that requires frequent context switching, learning and experimentation—including being willing to learn new and emerging capabilities within technologies such as Fabric, Azure Databricks and Copilot Studio
  • Identify delivery risks early and actively drive mitigation strategies
  • Contribute to standards, best practice, and continuous improvement across the HSO engineering community
  • Live HSO’s values and behaviours in everything you do
  • Foster a positive, inclusive and high performance culture
  • Take accountability for quality, outcomes and team success

Requirements

  • 5+ years’ experience building and delivering production grade data platform solutions
  • Strong experience designing and deploying solutions on Microsoft Azure
  • Hands on experience with modern data platforms (experience with Microsoft Fabric and/or Databricks will set you apart from other candidates)
  • Proven ability to lead technical delivery from design through to production
  • Strong understanding of source control, testing frameworks and modern development practices
  • Practical experience applying DevOps principles across complex solution lifecycles
  • Solid understanding of data security, privacy, governance and risk management in cloud environments
  • Demonstrate ability to accurately scope and quote work and be involved in pre-sales
  • A genuine thirst for learning, experimentation and staying current with evolving Microsoft technologies
  • Comfortable working in a highly varied role, switching between tools, technologies and problem domains
  • Strong problem solving and organisational skills, with the ability to manage competing priorities
  • High emotional intelligence and confidence engaging with a wide range of customers and stakeholders
  • Calm, professional and effective in fast paced or ambiguous environments
HSO - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Senior Data Platform Engineer

8 matching positions

Senior Data Platform Engineer

Pinecone is looking for a Senior Data Engineer to own and grow the systems that ...
Location
Location
United States , New York City
Salary
Salary:
Not provided
pinecone.io Logo
Pinecone
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years building and operating data pipelines in production
  • Strong SQL, with comfort in BigQuery (or Snowflake/Redshift) writing non-trivial analytical queries, optimizing performance, and reasoning about correctness
  • Strong coding skills, with comfort writing ETL/rETL, consuming services and integrations against REST/GraphQL APIs, and producing clean code that others can reuse and maintain
  • Experience with a modern orchestrator (Airflow, Dagster, Prefect, or similar) running containerized workloads
  • Comfort with Docker, Kubernetes, and modern cloud infrastructure best practices
  • Experience integrating systems, pulling data between APIs, databases, and warehouses
  • handling auth, pagination, schema drift, and incremental loads
  • Hands-on experience using AI coding tools (Claude Code, Cursor, or similar) as part of your workflow
  • Ability to design, build, and own systems end-to-end in a highly autonomous environment
Job Responsibility
Job Responsibility
  • Own and build the ingestion layer. Design, deploy, and scale pipelines that pull from third-party APIs, internal services, and SaaS tools into BigQuery. Add new sources as the business demands
  • Own and build the transform layer. Develop and maintain our DBT project, including staging, intermediate, and marts. Maintain core business datasets: users, organizations, indexes, accounts, usage, revenue. Write tests, snapshots, and documentation. Drive data quality and trust
  • Own and build the orchestration platform. Operate the Airflow-on-Kubernetes environment that runs our ingest and DBT workloads. Improve reliability, scalability, observability, and CI/CD
  • Establish and maintain the business-context and metrics layer. Curate metric definitions and documentation that feed both human analysts and agents
  • Manage infrastructure cost and performance. Manage BigQuery, GKE, Cloud Run, and Kafka costs, right-size compute, and make sure the platform stays efficient
  • Lead and own mission-critical company-level analyses. Partner with finance, GTM, product, and exec stakeholders to answer business questions, design metrics, run experiments and evaluations, build views in BI tools, and ship dashboards that support key business decisions as well as regular reporting to the Board of Directors
  • Enable other teams to self-serve. Onboard analysts and non-DE stakeholders onto the warehouse, help them with best practices, and create reusable models and tooling
  • Set the standard for AI-assisted data workflow. Establish best AI practices and patterns that enable a small data team to operate with outsized leverage
What we offer
What we offer
  • Comprehensive health coverage including medical, dental, vision, and mental health resources
  • 401(k) Plan
  • Equity award
  • Flexible time off
  • Paid parental leave
  • Annual Company Event
  • WFH Equipment Stipend
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adyen.com Logo
Adyen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 6+ years experience with Python object oriented programming
  • Team player with strong communication skills
  • Ability to work closely with diverse stakeholders you enable (analysts, data scientists, data engineers, etc.) and depend upon (infrastructure, security, etc)
  • Experience developing and maintaining: Distributed data and compute systems like Spark, Trino, Druid, etc
  • Data modelling tooling
  • DevOps pipelines and development ecosystems
  • Real-time and batch data pipelines (via Kafka, Spark streaming) with an eye for frameworks, and emphasis on user friendliness and quality
  • Kubernetes ecosystem (k8s, docker), and/or Hadoop ecosystems (Hive, Yarn, HDFS, Kerberos)
Job Responsibility
Job Responsibility
  • Develop and maintain scalable and high performance big data platforms
  • Work with distributed systems in all shapes and flavors (databases, filesystems, compute, etc.)
  • Identify opportunities to improve continuous release and deployment environments
  • Build or deploy tools to enhance data discoverability through the collection and presentation of metadata
  • Introduce and extend tools to enhance the quality of our data, platform-wide
  • Explore and introduce technologies and practices to reduce the time to insight for analysts and data scientists
  • Develop streaming processing applications and frameworks
  • Experience in infrastructure and large-scale private cloud systems
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

Join our Data Platform team at 10x Genomics to architect and implement our strat...
Location
Location
United States , Pleasanton
Salary
Salary:
168200.00 - 227600.00 USD / Year
10xgenomics.com Logo
10x Genomics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Management, or a related field, or equivalent experience
  • 5+ years of hands-on experience in software engineering focused on data platform development, distributed systems, or enterprise integrations
  • Proven experience designing and implementing highly scalable data platforms on major cloud environments (e.g., AWS, GCP, or Azure)
  • Deep proficiency in one or more general-purpose programming languages (e.g., Python, Java, or similar)
  • Strong foundation in computer science fundamentals, including data structures, algorithms, and system design
Job Responsibility
Job Responsibility
  • Architect and implement the canonical data layer and Event-Driven Architecture (EDA) using technologies like Apache Iceberg and Kafka to decouple applications and ensure real-time data flow
  • Design, build, and optimize high-volume, code-first data pipelines (real-time and batch) across a large application landscape (e.g., Salesforce, Oracle, Workday)
  • Establish Amazon S3 as the Single Source of Truth (SSOT) and govern data using principles like the Medallion Architecture (Silver and Gold layers) and schema evolution
  • Develop, test, and maintain robust and scalable ELT pipelines and data models in Snowflake, including leveraging advanced features like Snowpipes, Streams, and Stored Procedures
  • Develop the data presentation layer for self-service analytics, including the Natural Language Query (NLQ) interface integrated with Generative AI (e.g., Bedrock)
  • Lead technical efforts to migrate key business domains off legacy middleware and onto the new platform, eliminating the 'Integration Bottleneck'
  • Define and enforce data governance, quality, and security standards across the Unified Data Platform
  • Collaborate with the Architecture Review Board (ARB) to promote modern approaches such as serverless computing and Domain-Driven Design
  • Take ownership of the full development lifecycle, from prototyping and design through deployment, monitoring, and operational excellence
What we offer
What we offer
  • Equity grants
  • Comprehensive health and retirement benefit programs
  • Annual bonus program or sales incentive program
  • Health Package
  • Easy-to-use Benefits
  • Family oriented policies including parental leave
  • Generous Time Off
  • Award-Winning Workplace
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

As a Senior Data Platform Engineer, you will design and deliver innovative, reli...
Location
Location
New Zealand , Wellington
Salary
Salary:
Not provided
hso.com Logo
HSO
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years’ experience developing production‑grade data platform and reporting solutions
  • A degree in Information Technology or a related field
  • Strong experience with modern cloud technologies and data platforms
  • Proven experience leading projects and technical teams end to end
  • In‑depth knowledge of source control, testing frameworks and development methodologies
  • Experience applying DevOps practices across complex development lifecycles
  • Strong understanding of data security, privacy obligations and risk mitigation
  • Excellent problem‑solving and organisational skills, with the ability to manage competing priorities
  • High emotional intelligence and confidence working with diverse clients and stakeholders
  • A passion for learning emerging technologies and sharing knowledge with others
Job Responsibility
Job Responsibility
  • Lead the design, implementation, testing, support and ongoing maintenance of modern data platform solutions
  • Apply architectural patterns and best practices to create secure, scalable and maintainable solutions
  • Deliver end‑to‑end data platform projects, either independently or by leading project teams
  • Develop and continuously improve data platform lifecycles using DevOps principles
  • Work directly with customers to scope requirements, identify opportunities and deliver solutions that meet business needs
  • Clearly communicate complex technical concepts to non‑technical stakeholders
  • Deliver client workshops to upskill teams and support adoption of new technologies
  • Act as a technical leader and coach across the Aware Group, supporting team members to achieve project, customer and development goals
  • Proactively identify risks, issues and mitigation strategies throughout project delivery
  • Contribute to best practice, knowledge sharing and continuous improvement across HSO
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

As a Data Platform Engineer, you will be responsible for managing one of the lar...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adyen.com Logo
Adyen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Familiar with infrastructure automation and configuration management tools (e.g. Ansible, Terraform, Puppet)
  • Strong system administrator/platform engineer background with experience in large-scale distributed systems
  • Experienced with infrastructure and private cloud systems (on-premise)
  • A team player with strong communication skills, able to work closely with diverse stakeholders (analysts, data scientists, data engineers, infrastructure, and security teams)
  • Experience developing and maintaining: Distributed data and compute systems (Hadoop, Druid, Trino, etc)
  • Kubernetes (k8s, Docker)
  • Hadoop ecosystems (Hive, YARN, HDFS, Kerberos)
Job Responsibility
Job Responsibility
  • Design, develop, operate, and maintain scalable, reliable, fault-tolerant, and high-performance big data platforms
  • Work with distributed systems in all shapes and flavors (databases, file systems, compute, etc.)
  • Shape and maintain continuous improvements and deployment of new clusters
  • Implement observability solutions (logging, monitoring, alerting) to ensure system reliability and performance
  • Optimize performance of large-scale distributed data platforms with appropriate cluster configurations, and resource management
  • Practice sustainable incident response and blameless postmortems, with a focus on automation and root cause analysis
  • Improve security and compliance by implementing access controls, encryption, and best practices for data governance
  • Design and build automation tools to reduce toil and enhance the reliability of data platforms
  • Self-service infrastructure to empower data teams while maintaining platform stability
Read More
Arrow Right

Senior Data Platform Engineer

In 2025, the Data Platform Engineering team is going to implement various data p...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant experience as a data engineer
  • Bachelor's or Master's degree in CS/CE/CIS (or equivalent experience)
  • Knowledge of Kotlin / Java / Scala / Python / SQL
  • Knowledge of Kafka, Data Lake, Spark, Flink, DBT, Spring Boot, Hadoop, BigQuery, and Snowflake is preferred
  • Ability to take ownership of designing, building, and operating distributed systems and establishing overarching data architecture
  • Possess strong working knowledge of Real-time/Batch processing systems
  • Have experience with working data at PB scale
Job Responsibility
Job Responsibility
  • Engage in technical decision-making, custom development, integration, and performance optimization at the foundational level, extending to the development of service layer infrastructure components, application layer, and data processing, including third-party data integration
  • Develop and automate large-scale, high-performance distributed data processing systems (batch/streaming)
  • Advocate for high-quality software engineering practices to establish scalable data infrastructure and pipelines
  • Contribute to defining shared data engineering tool standards
  • Provide guidance to junior engineers
  • Take the lead in system design
  • Drive medium and large-scale projects that create an impact across the entire team
  • Provide dotted-line guidance to Data Platform Engineer II(s) to support them in driving project delivery
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

In 2025, the Data Platform Engineering team is going to implement various data p...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
airwallex.com Logo
Airwallex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant experience as a data engineer
  • Bachelor's or Master's degree in CS/CE/CIS (or equivalent experience)
  • Knowledge of Kotlin / Java / Scala / Python / SQL
  • Knowledge of Kafka, Data Lake, Spark, Flink, DBT, Spring Boot, Hadoop, BigQuery, and Snowflake is preferred
  • Ability to take ownership of designing, building, and operating distributed systems and establishing overarching data architecture
  • Possess strong working knowledge of Real-time/Batch processing systems
  • Have experience with working data at PB scale
Job Responsibility
Job Responsibility
  • Engage in technical decision-making, custom development, integration, and performance optimization at the foundational level, extending to the development of service layer infrastructure components, application layer, and data processing, including third-party data integration
  • Develop and automate large-scale, high-performance distributed data processing systems (batch/streaming)
  • Advocate for high-quality software engineering practices to establish scalable data infrastructure and pipelines
  • Contribute to defining shared data engineering tool standards
  • Provide guidance to junior engineers
  • Fulltime
Read More
Arrow Right

Senior Data Platform Engineer

We are seeking a Senior Data Platform Engineer with at least 8-10 years of exper...
Location
Location
United States
Salary
Salary:
81045.75 - 174000.00 USD / Year
stridelearning.com Logo
Stride, Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-10 years of experience in data architecture and data engineering
  • 3-5 years of hands-on experience with Snowflake in production environments
  • 3-5 years of custom python and shell script development
  • Strong expertise with AWS services, particularly those relevant to data warehousing, data lakes, and security (e.g., S3, Lambda, IAM)
  • Knowledgeable of dbt and modern ETL/ELT frameworks
  • Experience and familiarity with information security and network frameworks
  • Experience with relationship databases including PostgreSQL and Oracle
  • Solid understanding of data security, privacy regulations (FERPA, GDPR, etc.), audit (SOC) and compliance frameworks
  • Proven ability to design enterprise-scale data architecture that aligns with business strategy
  • Excellent communication and leadership skills with consultative mindset
Job Responsibility
Job Responsibility
  • Design and implement scalable, secure, and high-performance data architecture solutions using Snowflake and AWS
  • Lead architecture and design of ELT/ETL pipelines using Python, Fivetran, shell scripting and dbt
  • Collaborate cross-functionally with business partners, data engineers, analysts, product managers, compliance teams and information security to translate business needs into scalable data solutions
  • Ensure regulatory and data privacy compliance in data design and usage, particularly in the context of education data
  • Optimize cost and performance of data solutions in cloud environments
  • Ensure full lifecycle development standards are followed.
What we offer
What we offer
  • Health benefits
  • Retirement contributions
  • Paid time off
  • Eligible employees may receive a bonus.
  • Fulltime
Read More
Arrow Right