CrawlJobs Logo

Data Engineer

Australia, Sydney · Job Posted May 11, 2026
Apply Position
Job Link Share

Job Description

FinXL Professional Services is a leading IT consultancy that partners with clients to bridge the gap between business needs and technology capabilities. Since 2003, we've been delivering high-value ICT services across government, finance, telecommunications, and enterprise sectors. FinXL is seeking a Senior Data Engineer to join our consulting team and be deployed with a leading Banking client on a 12 months contract in Sydney.

Job Responsibility

  • Contribute to the design and development of data pipelines and platform features
  • Support transformational data initiatives within the Credit Risk technology domain
  • Create practical, well-structured solutions for complex technical challenges
  • Ensure data capabilities are accessible and aligned to emerging business needs
  • Influence outcomes through active participation in a collaborative engineering team
  • Drive the implementation of data capabilities within a Lakehouse environment

Requirements

  • Extensive experience with AWS Glue and the AWS Glue Data Catalog
  • Strong proficiency in Python or Java alongside advanced SQL skills
  • Hands-on experience with Apache Spark and Amazon S3
  • Proven expertise in data orchestration using Airflow, DBT, or Control-M
  • Familiarity with data processing and query tools like Starburst Presto
  • Experience monitoring data pipelines using tools such as Grafana or Splunk
  • Exposure to AI-based development practices for data and code analysis
  • Excellent communication and stakeholder management skills

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

We are looking for a Data Engineer to help strengthen enterprise data capabiliti...
Location
Location
United States , San Diego
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 5 years of hands-on experience in data engineering, data integration, or a closely related technical discipline
  • Strong background working with cloud data ecosystems and modern integration frameworks in production environments
  • Advanced SQL expertise, including query optimization, troubleshooting, and performance improvement
  • Proven experience creating and supporting production ETL or ELT pipelines across multiple data sources
  • Solid understanding of dimensional modeling and the design of analytics-focused datasets
  • Hands-on experience with Python, Apache Spark, or similar technologies used for large-scale data processing
  • Ability to communicate clearly, solve complex technical problems, and work effectively with both business and engineering teams
  • A bachelor’s degree in computer science, information systems, or a related field is preferred
  • relevant cloud or data certifications are a plus
Job Responsibility
Job Responsibility
  • Build and maintain robust data pipelines that move and transform information from diverse platforms into usable analytical datasets
  • Develop and support end-to-end integration workflows across multiple systems to ensure consistent and timely data delivery
  • Design data models and reporting structures that improve usability, performance, and accessibility for downstream analytics needs
  • Track data quality and platform performance, investigating issues and resolving reliability concerns before they affect business operations
  • Collaborate with cross-functional partners to translate reporting and analytics needs into scalable technical solutions
  • Maintain clear documentation and contribute to governance practices that promote accuracy, consistency, and operational discipline
  • Assist with validation, release activities, and continuous enhancements to improve the overall effectiveness of the data platform
  • Contribute to cloud-based data engineering efforts using tools such as Azure Data Factory, Azure Data Lake, Microsoft Fabric, Spark, Kafka, and Hadoop where appropriate
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • enrollment in our company 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Engineer

The Data Engineer is a seasoned subject matter expert, responsible for the trans...
Location
Location
Thailand , Bangkok
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Seasoned knowledge of the definition and management of scoping requirements, definition and prioritization activities
  • Seasoned understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models
  • Seasoned expertise in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP
  • Seasoned understanding of data architecture landscape between physical and logical data models
  • Analytical mindset with excellent business acumen skills
  • Problem-solving aptitude with the ability to communicate effectively, both written and verbal
  • Ability to build effective relationships at all levels within the organization
  • Seasoned expert in programing languages (Perl, bash, Shell Scripting, Python, etc.)
  • Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field
  • Relevant certifications preferred such as SAP, Microsoft Azure etc.
Job Responsibility
Job Responsibility
  • Creates data models in a structured data format to enable analysis thereof
  • Designs and develops scalable extract, transformation and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources
  • Participates in the transformation of object and data models into appropriate database schemas within design constraints
  • Interprets installation standards to meet project needs and produce database components as required
  • Creates test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations
  • Accountable for running data migrations across different databases and applications, for example MS Dynamics, Oracle, SAP and other ERP systems
  • Works across multiple IT and business teams to define and implement data table structures and data models based on requirements
  • Accountable for analysis, and development of ETL and migration documentation
  • Collaborates with various stakeholders to evaluate potential data requirements
  • Accountable for the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a highly motivated expert Data Engineer to design and develop...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration and performance tuning on big data processing
  • Strong understanding of AWS services
  • Ability to quickly learn, adapt, and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • Experience with streaming technologies such as Apache Kafka, Debezium, or similar platforms for real-time data processing and integration
  • Master’s /Bachelor’s degree and 5-8 years of Computer Science, IT, or related field experience
Job Responsibility
Job Responsibility
  • Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets
  • Build highly efficient data pipelines to migrate and deploy complex data across systems, with an understanding of biotech/pharma/manufacturing or related domains
  • Design and implement solutions to enable unified data access, governance, and interoperability across hybrid cloud environments
  • Ingest and transform structured and unstructured data from databases (PostgreSQL, MySQL, SQL Server, MongoDB, etc.), APIs, logs, event streams, images, PDFs, and third-party platforms
  • Ensure data integrity, accuracy, and consistency through rigorous quality checks and monitoring
  • Innovate, explore, and implement new tools and technologies to enhance efficient data processing
  • Proactively identify and implement opportunities to automate tasks and develop reusable frameworks
  • Work in an Agile and Scaled Agile (SAFe) environment, collaborating with cross-functional teams, product owners, and Scrum Masters to deliver incremental value
  • Use JIRA, Confluence, and Agile DevOps tools to manage sprints, backlogs, and user stories
  • Support continuous improvement, test automation, and DevOps practices in the data engineering lifecycle
Read More
Arrow Right

Data Engineer

We are looking for a skilled Data Engineer to join our team on a long-term contr...
Location
Location
United States , New York
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in implementing and managing Snowflake and Palantir platforms
  • Strong proficiency in programming languages such as Python for data manipulation and analysis
  • Expertise in working with Apache Spark, Hadoop, and Kafka for large-scale data processing
  • In-depth knowledge of ETL processes and tools to handle complex data workflows
  • Familiarity with building and optimizing data pipelines and architectures
  • Ability to troubleshoot and resolve data system issues in a timely manner
  • Excellent problem-solving skills and attention to detail
  • Strong communication skills to collaborate effectively with cross-functional teams
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data pipelines to support efficient data integration and processing
  • Implement and manage Snowflake-based data repositories to centralize and secure organizational data
  • Utilize Palantir to standardize and analyze data across multiple divisions, ensuring consistency and accuracy
  • Develop ETL processes to extract, transform, and load data from various sources into centralized systems
  • Collaborate with stakeholders to define data requirements and optimize system performance
  • Leverage tools like Apache Spark, Hadoop, and Kafka to build scalable data solutions
  • Monitor and troubleshoot data systems to ensure reliability and address any issues promptly
  • Deploy advanced analytics and AI models to drive operational efficiencies
  • Document processes and provide technical support to ensure smooth implementation and usage of data systems
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • company 401(k) plan
Read More
Arrow Right

Data Engineer

As a Data Engineer, you will take ownership of major parts of our data platform ...
Location
Location
Hungary , Budapest
Salary
Salary:
Not provided
lensa.com Logo
Lensa
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience in data engineering or a related field
  • Strong programming skills in Python and SQL (CTEs, window functions, complex joins, stored procedures)
  • Experience building batch and real-time data pipelines with Spark, Flink or similar frameworks
  • Solid understanding of ETL/ELT workflows, CI/CD pipelines, and production-grade deployment practices
  • Strong knowledge of data modeling, Redshift or similar MPP data warehouses, and distributed systems
  • Experience with AWS or other cloud provider services (EC2, Lambda, Step Functions, Glue, Redshift, S3)
  • Ability to operate independently, solve complex problems, and make sound technical decisions
  • Excellent communication skills and ability to work with both technical and non-technical stakeholders
  • Solid communication skills in English
Job Responsibility
Job Responsibility
  • Design data structures, batch and streaming pipelines, and processes for large-scale analytics and machine learning
  • Design, optimize and implement robust ETL/ELT workflows to feed Data Warehouse (Redshift) and other analytical layers for reporting, analytics, and operational use cases
  • Maintain, improve, and troubleshoot production pipelines, ensuring high reliability and performance
  • Own the architecture and development of core data systems end-to-end
  • Mentor Mid-Level and Junior Engineers and provide guidance on best practices, workflow standards, and troubleshooting
  • Collaborate closely with Data Scientists, Product, and Engineering teams to translate business requirements into scalable data solutions
  • Document systems, pipelines, and architecture
  • maintain runbooks and operational guides
  • Identify technical risks, propose solutions, and drive improvements in platform design, reliability, and performance
  • Participate in code reviews, provide technical mentorship, and help establish best practices
What we offer
What we offer
  • Flexible working hours with home office opportunity
  • Medicover health insurance
  • Company lunch every day in the office
  • In-house gym in the office
  • Exciting programs and team-building events
  • Recreation room with darts, ping pong, foosball, XBox, and other games
  • Modern and fancy office in Buda close to Széll Kálmán tér
  • Fulltime
Read More
Arrow Right

Data Engineer

Microsoft’s mission is to empower every person and every organization on the pla...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Formulate business problems and translate them into actionable data science projects
  • Explore, analyze, and centralize data to supply meaningful insights and create a single version of the truth
  • Design, prototype, implement, and test descriptive, predictive, forecasting, and causal inference models
  • Identify and action IT operations return to capacity success improvement
  • perform defect analysis, quantify opportunities, and set targets
  • Partner and collaborate with teams to identify opportunities for machine learning and predictive analysis
  • Build and deploy visualizations that deliver insights to decision-makers at all organizational levels
  • Communicate effectively with technical and non-technical audiences, contributing modeling expertise as a team player
  • Influence across disciplines to ensure data-driven decisions and solve critical problems for customers
  • Mentor others and foster a culture of continuous learning
  • Fulltime
Read More
Arrow Right

Data Engineer

We are seeking a Data Engineer to design and build scalable data pipelines and p...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience in cloud environments (AWS and/or Azure)
  • Hands‑on experience with Databricks, Apache Spark, and Delta Lake
  • Strong skills in Python / PySpark and SQL
  • Experience with data pipelines, ETL/ELT, and data modeling
  • Familiarity with orchestration tools (Airflow or similar) and modern data architectures
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines using Databricks, Spark, and cloud-native services
  • Develop and optimize ETL/ELT workflows for batch and streaming data across AWS and Azure environments
  • Build and manage data models, data lakes, and warehousing solutions for analytics and AI use cases
  • Ensure data quality, reliability, and governance across the data lifecycle
  • Collaborate with data science, analytics, and platform teams to deliver data solutions
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a real estate and property organizati...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Microsoft Fabric and/or Azure Data Factory, including building and optimizing pipelines
  • Proven background working with Azure data services and cloud-based data architecture
  • Advanced experience with data modeling, complex querying, and performance tuning in enterprise data platforms
  • Solid programming skills in Python, Java, Scala, or a comparable language used in data engineering
  • Experience with ETL development, relational databases, and data warehousing concepts
  • Familiarity with technologies such as Apache Spark, Hadoop, or Kafka in support of large-scale data processing
  • Ability to work effectively as an individual contributor in a lean team environment with high accountability
  • Exposure to Power BI or Tableau, along with the ability to align technical solutions with business needs
Job Responsibility
Job Responsibility
  • Design, build, and enhance end-to-end data pipelines using Microsoft Fabric and/or Azure Data Factory for production use
  • Manage and improve the data environment with a strong ownership mindset, ensuring performance, reliability, and maintainability
  • Integrate data from varied sources such as APIs, databases, and flat files into structured, usable datasets
  • Develop data models and schema designs that support reporting, analytics, and downstream business needs
  • Monitor data quality and implement validation checks, troubleshooting issues through root cause analysis and continuous optimization
  • Create scalable cloud-based data solutions within Azure that support long-term operational and analytical goals
  • Partner with cross-functional stakeholders to translate business questions into practical data engineering solutions
  • Contribute to orchestration, automation, and ongoing support of data workflows using modern engineering tools and programming languages
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right