CrawlJobs Logo

Consulting Data Engineer

Australia, Sydney · Job Posted February 14, 2026
Apply Position
Job Link Share

Job Description

As a Consulting Data Engineer, you’ll design, build, and deploy scalable data pipeline and machine learning solutions that deliver real business value. You’ll use strong SQL and modern data stacks to create reliable, cost effective pipelines and support ML workloads. You will work on meaningful technical challenges with autonomy and communicate technical outcomes clearly to both technical and non-technical stakeholders. We value engineers who think creatively, communicate effectively, and engage confidently with stakeholders. We’re looking for engineers who do more than write code. You’ll listen to client challenges, dig into the core problem, help shape solutions, and explain them clearly. If you want to build something from the ground up with a team that’s already proven it can deliver meaningful outcomes, we’d like to hear from you.

Job Responsibility

  • Build and maintain scalable data pipelines for ingesting, transforming, and delivering data
  • Manage and optimise databases, warehouses, and cloud storage solutions
  • Implement data quality frameworks and testing processes to ensure reliable systems
  • Design and deliver cloud-based solutions (AWS, Azure, or GCP)
  • Take technical ownership of project components and lead small development teams
  • Engage directly with clients, translating business requirements into technical solutions
  • Champion best practices including version control, CI/CD, and infrastructure as code

Requirements

  • Hands-on data engineering experience in production environments
  • Strong proficiency in Python and SQL
  • Experience with at least one additional language (e.g. Java, Typescript/Javascript)
  • Experience with modern frameworks such as Apache Spark, Airflow, dbt, Kafka, or Flink
  • Background in building ML pipelines, MLOps practices, or feature stores is highly valued
  • Proven expertise in relational databases, data modelling, and query optimisation
  • Demonstrated ability to solve complex technical problems independently
  • Excellent communication skills with ability to engage clients and stakeholders
  • Degree in Computer Science, Engineering, Data Science, Mathematics, or a related field

Nice to have

  • Experience with at least one of Databricks, Snowflake, BigQuery, MS Fabric is required, more than one a bonus
  • Experience with tools like Spark, dbt, Dataform is a plus but not required

What we offer

  • Work with SAP’s latest technologies on cloud as S/4HANA, BTP and Joule, plus Databricks, ML/AI tools and cloud platforms
  • A flexible and supportive work environment including work from home
  • Competitive remuneration and benefits including novated lease, birthday leave, salary packaging, wellbeing programme, additional purchased leave, and company-provided laptop
  • Comprehensive training budget and paid certifications (Databricks, SAP, cloud platforms, Snowflake, BigQuery)
  • Structured career advancement pathways with mentoring from senior engineers
  • Exposure to diverse industries and client environments

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Consulting Data Engineer

8 matching positions

Fabric Data Engineer / Azure Data Engineer

Location
Location
Salary
Salary:
Not provided
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on Data Engineer with strong Microsoft Fabric experience, including Lakehouse, OneLake, Data Factory/Pipelines, Warehousing, and Fabric ecosystem services
  • Strong Python development skills for data engineering, data transformation, automation, and pipeline development
  • Experience working with Microsoft Fabric Lakehouse architecture, including data ingestion, transformation, storage, and analytics enablement
  • Strong understanding of data engineering fundamentals, including data modeling, partitioning, optimization, and performance tuning
  • Experience supporting Azure Data Platform technologies, including Azure Data Factory, Azure Synapse Analytics, Azure Storage, and related services
  • Ability to work within large-scale enterprise data environments supporting multiple business units and data domains
  • Knowledge of Medallion Architecture (Bronze, Silver, Gold) and practical implementation of modern data lakehouse solutions
  • Experience integrating and transforming structured and semi-structured data sources including APIs, databases, JSON, CSV, and cloud-based systems
  • Understanding of Fabric operational monitoring, capacity consumption monitoring, and platform governance best practices
  • Ability to clearly explain and demonstrate the distinction between Fabric Files, Tables, Lakehouses, Warehouses, and OneLake storage concepts
Job Responsibility
Job Responsibility
  • Design, build, and support scalable ETL/ELT data pipelines across enterprise Azure environments
  • Ability to support integration across multiple systems, applications, databases, and cloud platforms
Read More
Arrow Right

Senior Data Engineer / Data Analyst

N-iX is a global software development service company. Our customer is the Europ...
Location
Location
Ukraine
Salary
Salary:
Not provided
n-ix.com Logo
N-iX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of experience in analytics, sales operations, revenue insights, or data-driven consulting
  • Strong SQL skills (joins, window functions, performance tuning)
  • Production experience with Apache Airflow
  • Python skills for pipeline development
  • Ability to build and maintain database views (PostgreSQL, Snowflake, Redshift)
  • Solid ETL/ELT understanding
  • Clear communication with non-technical stakeholders
  • GitHub experience (branches, PRs, reviews)
  • English level - at least Upper-Intermediate, both spoken and written
Job Responsibility
Job Responsibility
  • Work with Salesforce objects and relationships to ensure correct ingestion, transformation, and integration into our reporting environment
  • Design, build, and maintain data pipelines using Apache Airflow (DAG creation, scheduling, monitoring, troubleshooting)
  • Write, optimize, and maintain SQL queries, stored procedures, and functions for data transformation and extraction
  • Create and manage database views to support analytics, reporting, and downstream applications
  • Ensure data quality, consistency, and reliability across pipelines and views (validation checks, monitoring)
  • Support QuickSuite dataset adjustments (new fields, logic changes, view extensions)
  • Document data flows, data models, and pipeline logic for long-term maintainability and handover
What we offer
What we offer
  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits
Read More
Arrow Right

Data Engineer - Big Data, Python, Databricks

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4 - 6 years of relevant experience in the Financial Service industry
  • Intermediate level experience in Applications Development role
  • Proficient in Big DataTechnologies - Cloudera, Hive, Python, Java/PySpark, Data Bricks
  • Proficient in Data analysis and data modelling
  • Good understanding of ETL concepts
  • Consistently demonstrates clear and concise written and verbal communication
  • Demonstrated problem-solving and decision-making skills
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Data Engineer (Big Data, Python, Databricks) - Assistant Vice President

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Chennai, Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant handson experience in Big Data technologies like Cloudera, Python, HQL, Java/PySpark
  • Knowledge on Machine Learning, AI would be added advantage
  • Experience in systems analysis, data analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Data Engineer Big Data Technology

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-6 years of hands-on experience in Hadoop, Scala, Java, Spark, Hive, Kafka, Impala, Unix Scripting and other Big data frameworks
  • 4+ years of experience with relational SQL and NoSQL databases: Oracle, MongoDB, HBase
  • Strong proficiency in Python and Spark Java with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc) and Scala and SQL
  • Data Integration, Migration & Large Scale ETL experience (Common ETL platforms such as PySpark/DataStage/)
  • 4-6 years of relevant experience in the Financial Service industry
  • Experienced in working with large and multiple datasets and data warehouses
  • Experience building and optimizing ‘big data’ data pipelines, architectures, and datasets
  • Strong analytic skills and experience working with unstructured datasets
  • Ability to effectively use complex analytical, interpretive, and problem-solving techniques
  • Experience with Confluent Kafka, Redhat JBPM, CI/CD build pipelines and toolchain – Git, BitBucket, Jira
Job Responsibility
Job Responsibility
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Technical Support Engineer - Azure Data Factory / Data Integration

Within CE&S, the Customer Service & Support (CSS) organization builds trust and ...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology (IT), or related field AND 1+ years of technical support, technical consulting experience, or information technology experience
  • OR 3+ years of technical support, technical consulting experience, or information technology experience
  • OR equivalent experience
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics / Microsoft Fabric Pipeline
  • Data Lake
  • Relational Database Management System (Microsoft SQL Server / Oracle Database / MySQL / IBM Db2 / SAP)
  • Big Data or Analytics Products (Spark / Azure HDInsight / Azure Data Lake Analytics / Azure Synapse Analytics / Databricks / Google BigQuery)
  • Pipeline and ETL/ELT Skills
  • Building and orchestrating pipelines (ADF / Synapse / Fabric)
Job Responsibility
Job Responsibility
  • Response and Resolution: You own, investigate and solve customer technical issues. You collaborate within and across teams, leveraging troubleshooting tools and practices
  • Readiness: You lead or participate in building communities with peer delivery roles and, where appropriate, share your knowledge
  • You develop specific technical and professional proficiency to enable you to resolve customer issues, through training and readiness
  • Product/Process Improvement: You identify potential product defects and escalate appropriately to resolve, contributing to Microsoft product improvements
  • Fulltime
Read More
Arrow Right
New

Solution Engineer - Data

As a Solution Engineer - Data, you will play a pivotal role in helping enterpris...
Location
Location
Brazil , São Paulo
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, Information Technology, or related field AND 4+ years technical pre-sales or technical consulting experience OR Master's Degree in Computer Science, Information Technology, or related field AND 3+ years technical pre-sales or technical consulting experience OR 5+ years technical pre-sales or technical consulting experience OR equivalent experience
  • 4+ years technical pre-sales, technical consulting, or technology delivery, or related experience OR equivalent experience
  • 2+ years experience with cloud and hybrid, or on premises infrastructures, architecture designs, migrations, industry standards, and/or technology management
  • This role requires proficiency in written, reading, and conversational Brazilian Portuguese and English
  • This is an affirmative position for People with Disabilities
Job Responsibility
Job Responsibility
  • Drive technical sales with decision makers using demos and PoCs to influence solution design and enable production deployments
  • Lead hands-on engagements—hackathons and architecture workshops—to accelerate adoption of Microsoft’s cloud platforms
  • Build trusted relationships with platform leads, co-designing secure, scalable architectures and solutions
  • Resolve technical blockers and objections, collaborating with engineering to share insights and improve products
  • Maintain deep expertise in Analytics Portfolio: Microsoft Fabric (OneLake, DW, real-time intelligence, BI, Copilot), Azure Databricks, Purview Data Governance and Azure Databases: SQL DB, Cosmos DB, PostgreSQL
  • Maintain and grow expertise in on-prem EDW (Teradata, Netezza, Exadata), Hadoop & BI solutions
  • Represent Microsoft through thought leadership in cloud Database & Analytics communities and customer forums
  • Fulltime
Read More
Arrow Right

Middle/Senior Data Engineer (Databricks)

We're looking for a Data Engineer (Databricks) who will work closely with client...
Location
Location
Poland
Salary
Salary:
Not provided
itransition.com Logo
Itransition
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of hands-on data engineering experience, ideally within a consulting or client-facing environment
  • Hands-on experience with Databricks Lakehouse Platform
  • Strong SQL skills and proficiency in Python
  • Experience designing and deploying solutions in cloud environments (Azure preferred)
  • Ability to quickly grasp diverse business domains and adapt technical solutions accordingly
  • Strong communication skills to interact with both technical and non-technical client stakeholders
  • Experience working in agile, fast-paced project environments with shifting priorities
Job Responsibility
Job Responsibility
  • Interact with client stakeholders to surface data requirements, audit existing systems, and architect scalable, future-proof solutions
  • Design, build, and maintain production-grade ELT/ETL pipelines using modern data stack tools and frameworks
  • Deploy and govern cloud-based data platforms on Azure and AWS, selecting the right approach for each engagement's unique constraints
  • Champion data governance, security, and compliance standards
  • Produce clear technical documentation and lead knowledge transfer sessions that genuinely enable client teams to operate independently
  • Support project scoping, estimation, and reporting with delivery managers and consultants
What we offer
What we offer
  • Projects for such clients as PayPal, Wargaming, Xerox, Philips, Adidas and Toyota
  • Competitive compensation that depends on your qualification and skills
  • Career development system with clear skill qualifications
  • Flexible working hours aligned to your schedule
  • Options to work remotely
  • Corporate medical insurance covering services of private and public medical centers
  • English courses online
  • Corporate parties and events for employees and their children
  • Internal conferences, workshops and meetups for learning and experience sharing
  • Gym membership compensation
  • Fulltime
Read More
Arrow Right