Data Engineer (On-Prem) Job at Randstad (Brisbane)

New

Data Engineer (On-Prem)

Randstad is currently working with a Banking client to find a Data Engineer (On-...

Location

Australia , Brisbane

Salary:

120000.00 - 140000.00 AUD / Year

Randstad

Expiration Date

July 04, 2026

Requirements

Experience as a Data Engineer within an on-premise warehousing environment
Strong hands-on experience with ETL tools (preferably SSIS and WhereScape) and Change Data Capture (CDC) tools like Precisely
Advanced SQL skills alongside proficiency in the Microsoft BI stack (SSAS, SSRS, SSIS) and exposure to Power BI
Experience working with Azure DevOps (Git repositories, Azure Pipelines) and PowerShell scripting
Strong collaborative and communication skills, with a proven ability to convey complex technical concepts

Job Responsibility

Engineer and model curated Data Warehouse solutions to support business intelligence objectives and key analytics metrics
Build and maintain robust, scalable, and secure data pipelines using ETL, validation, and testing methods
Collaborate closely with business departments, analysts, and architects to evaluate requirements and implement data solutions
Identify data trends, troubleshoot issues, and communicate insights to stakeholders at all levels to create value
Maintain data model documentation, data flow mapping, and contribute to future data governance decisions

What we offer

Access to a Udemy license for ongoing learning and continuous professional development
Access to exclusive discounts across various platforms
Discounts on private health funds
3 payruns a week

Solution Architect - On-Prem Design Lead

We are seeking two highly experienced Solution Architects to join a defence-focu...

Location

United Kingdom , Lancashire

Salary:

71.28 GBP / Hour

Outsource UK

Expiration Date

Until further notice

Requirements

Strong experience designing and delivering on-premises solutions
Deep knowledge of data centre architecture including compute, storage and networking
Hands-on experience with VMware environments (including VMware Cloud Foundation desirable)
Experience with Microsoft enterprise collaboration tools in on-prem environments
Experience delivering virtual desktop infrastructure (VDI), ideally supporting engineering workloads (CAD/PLM)
Strong understanding of secure-by-design principles and defence-grade security requirements
Experience working in complex, multi-stakeholder environments

Job Responsibility

Design and architect on-premises VMware-based infrastructure solutions
Contribute to the definition and delivery of virtual desktop environments, including support for engineering tools such as CAD and PLM
Support implementation and migration activities within secure data centre environments
Provide consultancy and technical leadership within a team of architects
Ensure solutions adhere to secure-by-design principles and defence security standards
Troubleshoot and optimise platform performance and resilience
Work closely with stakeholders including contractors, government stakeholders and internal IT teams

Fulltime

Solution Data Engineer – DG Infomatica Engineer

We are seeking a hands-on Informatica Developer with strong experience in data q...

Location

United States of America , TEMPE

Salary:

Not provided

Circle K

Expiration Date

Until further notice

Requirements

3–5+ years of hands-on experience as an Informatica Developer or Data Quality Engineer
Strong experience with Informatica IDMC, including: Cloud Data Quality (CDQ)
Cloud Data Catalog (EDC/CDGC)
Experience implementing data quality validation rules, monitoring, and reporting
Hands-on experience with Snowflake and Databricks
Experience working in Azure cloud environments (AWS exposure is a plus)
Strong SQL skills and understanding of data warehousing and data modeling concepts
Experience working with on-prem and cloud data sources
Experience configuring Informatica Secure Agents and cloud connectivity
Familiarity with REST APIs and system integrations

Job Responsibility

Design, develop, and maintain data quality rules, scorecards, and dashboards using Informatica CDQ
Implement and support metadata ingestion, cataloging, and lineage using Informatica Cloud Data Catalog (EDC/CDGC)
Onboard application and data source metadata in collaboration with application owners and data engineering teams
Configure and maintain technical and business assets, custom attributes, and custom lineage within the Informatica catalog
Extract and publish metadata from cloud and on-prem data sources to support enterprise metadata management
Support data lineage and impact analysis across Snowflake, Databricks, and relational databases
Configure and manage Informatica Cloud environments, including Secure Agents and connectivity
Integrate Informatica with cloud platforms and external systems using REST APIs
Partner with data engineering and analytics teams to ensure high-quality, well-governed datasets are available for reporting and AI/ML use cases

New

Data Engineer

Join us as a Data Engineer at Barclays, responsible for supporting the successfu...

Location

India , Pune

Salary:

Not provided

Barclays

Expiration Date

Until further notice

Requirements

Experience in ETL / data processing / data warehousing / data engineering / RDBMS / PySpark
Experience in Data Processing and ETL in On-prem and Cloud based systems
Preferred AWS cloud development, with a strong understanding of AWS services (e.g., EC2, S3, Lambda, RDS, DynamoDB, etc.)
Proficient in at least one Python programming language
Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform etc.
Experience with CI/CD tools and pipelines (Jenkins, GitLab CI, etc.) for automation and deployment
Good understanding of cloud security best practices and experience with IAM, VPC, security groups, and encryption mechanisms
Good knowledge of monitoring, logging, and troubleshooting tools (e.g., CloudWatch, CloudTrail)
Experience with version control systems (Git, GitHub, Bitbucket)
Strong communication skills and ability to work in a collaborative team environment

Job Responsibility

supporting the successful delivery of location strategy projects to plan, budget, agreed quality and governance standards
spearhead the evolution of our digital landscape, driving innovation and excellence
harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences
Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
Development of processing and analysis algorithms fit for the intended data complexity and volumes
Collaboration with data scientist to build and deploy machine learning models

What we offer

Competitive holiday allowance
Life assurance
Private medical care
Pension contribution

Fulltime

Data Engineer Senior Consultant

The Data Engineer will play a crucial role in migrating data from on-prem DataLa...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
Ability to troubleshoot (SQL) and basic scripting experience
Professional proficiency in Python or Java
Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices & K8s deployment experience
Temporal Data Modeling: Managing state changes over time (e.g., SCD Type 2)
Schema Management: Expertise in Schema Evolution (Ref: Iceberg Apache) and enforcement strategies
Performance Optimization: Advanced knowledge of data partitioning and clustering
Architectural Theory: Balancing Normalization vs. Denormalization and the strategic use of Natural vs. Surrogate Keys

Job Responsibility

Perform end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
Pipeline Migration: Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
Data Transfer: Executing the physical migration of underlying datasets while ensuring data integrity
Stakeholder Engagement: Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners to ensure migrated assets meet business requirements
Consumption Pattern Migration: Code Conversion - Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg
Usage analysis: Understand usage patterns to deliver the required data products
Data Reconciliation & Quality: Work with reconciliation frameworks to build confidence that migrated data is functionally equivalent to that already used within production flows
Work with other internal data management platform and have an aptitude for learning new workflows and language constructs as necessary

Fulltime

Data Engineer

Goldman Sachs is seeking a Data Engineer to join their datastore-migration Facto...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
Ability to troubleshoot (SQL) and basic scripting experience
Professional proficiency in Python or Java
Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices & K8s deployment experience
Sophisticated understanding of Temporal Data Modeling (SCD Type 2)
Expertise in Schema Evolution (Iceberg Apache) and enforcement strategies
Advanced knowledge of data partitioning and clustering
Balancing Normalization vs. Denormalization and strategic use of Natural vs. Surrogate Keys
Candidates must demonstrate strong stakeholder engagement

Job Responsibility

Perform end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
Executing the physical migration of underlying datasets while ensuring data integrity
Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners to ensure migrated assets meet business requirements
Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg
Understanding usage patterns to deliver the required data products
Working with reconciliation frameworks to build confidence that migrated data is functionally equivalent to that already used within production flows

Fulltime

Senior Data Engineer

We are currently delivering multiple enterprise-scale data engineering projects ...

Location

Sri Lanka , Colombo

Salary:

Not provided

Creative Software

Expiration Date

Until further notice

Requirements

4+ years experience in Data Engineering or similar disciplines
Strong SQL + at least one programming language (Python / Scala / Java)
Hands-on Azure Data Factory, Synapse, Databricks, Data Lake experience
Working knowledge of SQL Server, SSIS & enterprise data warehousing
Strong Power BI data modelling + DAX optimization proficiency
Experience with ETL/ELT frameworks, data governance, QA and automation
Proficiency with Git-based version control & CI/CD workflow pipelines

Job Responsibility

Design, build & maintain scalable ETL/ELT pipelines across Azure & on-prem
Architect and implement Data Warehouse & Lakehouse models (Star/Snowflake)
Optimize pipelines for performance, cost, availability & security
Work with ADF, Synapse, Databricks, Azure SQL, ADLS
Deliver clean semantic models, DAX-ready datasets and BI-reporting layers
Implement engineering excellence - version control, CI/CD, governance frameworks
Lead problem resolution and troubleshoot complex, multi-system issues
Collaborate with BI / Product / Analytics teams & mentor junior engineers
Operate confidently across hybrid workloads (Cloud + On-Prem)

What we offer

Work on high-impact enterprise data platforms
Exposure to modernization, cloud engineering & platform architecture
Growth path to Lead Engineer → Solutions Architect
Attractive compensation + work with high-performance teams
Recreation zone, fun loving & wellness-driven culture & continuous learning environment

Fulltime

Senior Data Engineer

We are seeking an experienced Senior Data Engineer to design, build, and optimiz...

Location

Sri Lanka

Salary:

Not provided

Creative Software

Expiration Date

Until further notice

Requirements

3-5 years of experience in Data Engineering or related fields
Strong expertise in SQL and at least one programming language (Python, Scala, or Java)
Hands-on experience with Azure data services such as Data Factory, Synapse, Databricks, Azure SQL, and Storage
Experience with on-premise data platforms, especially SQL Server and SSIS
Strong Power BI skills, including: Designing efficient data models (star schema, proper relationships), Writing optimized DAX measures, Applying best practices for performance, data loading, and semantic modeling, Supporting BI teams with dataset design and dashboard optimization
Solid experience building and maintaining ETL/ELT pipelines
Good understanding of data warehousing concepts, data governance, and data quality frameworks
Experience with version control and structured development workflows (Git, CI/CD)
Strong communication and ability to work with both technical and business teams
Excellent analytical and problem-solving abilities

Job Responsibility

Build and Manage Data Pipelines
Design Data Models & Warehouses
Optimize Existing Data Solutions
Work Across Cloud and On-Prem Platforms
Support BI & Visualization Teams
Lead and Collaborate
Leverage Multi-Platform Experience

Fulltime

Select Country

Data Engineer (On-Prem)

Job Description

Job Responsibility

Requirements

What we offer

Looking for more opportunities?

Data Engineer (On-Prem)

Data Engineer (On-Prem)

Solution Architect - On-Prem Design Lead

Solution Data Engineer – DG Infomatica Engineer

Data Engineer

Data Engineer Senior Consultant

Data Engineer

Senior Data Engineer

Senior Data Engineer

Our AI answers in your language