CrawlJobs Logo

Senior Azure Data Engineer

Australia, Sydney · Job Posted January 05, 2026
Apply Position
Job Link Share

Job Description

The Department of Customer Service is seeking a highly motivated Senior Data Engineer to join their team on a contract basis. This role is pivotal in driving the end-to-end data engineering strategy, utilising the latest Microsoft technologies to transform raw data into actionable insights. You will be joining a flexible and supportive environment, working to build and maintain robust data platforms. As a creative problem solver, you will bridge the gap between complex data systems and business needs, ensuring high-quality datasets support reporting, analytics, and machine learning initiatives.

Job Responsibility

  • Drive the end-to-end data engineering strategy using Microsoft technologies
  • Build, maintain, and scale data pipelines and platforms to ensure efficient data flow
  • Design and execute ELT/ETL workflows to transform raw data from disparate systems into structured, high-quality datasets optimised for PowerBI, reporting, and machine learning
  • Work cross-functionally with Data Analysts and Business Analysts to understand database requirements, partitioning strategies, and business logic
  • Implement strong data governance and compliance measures
  • Stay abreast of industry trends and best practices to drive continuous improvement initiatives within the data engineering function
  • Utilise Excel, Power Query, and VBA to handle automation tasks and connectors where required

Requirements

  • Minimum Bachelor’s degree in Computer Science, Software Engineering, or Information Systems
  • 5+ years of professional experience as a Data Engineer
  • Hands-on experience building scalable data pipelines and ELT/ETL workflows specifically using Microsoft Fabric to optimise datasets for PowerBI
  • Strong proficiency in SQL and at least one other programming language commonly used for data engineering (e.g., Python, Java, Scala)
  • Proven background in documentation, security, and compliance, specifically with experience in Microsoft Purview and Azure Key Vault
  • Advanced skills in Excel, including Power Query, VBA automation, and connectors
  • A creative problem solver who can think critically to resolve complex data challenges
  • Ability to stay updated with industry trends and integrate new best practices
  • Strong ability to collaborate with non-technical stakeholders and technical teams alike

Nice to have

  • Microsoft Certified: Data Engineering on Microsoft Azure (DP-700 or equivalent)
  • Microsoft Certified: Administering Relational Databases on Microsoft Azure (DP-300)

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Azure Data Engineer

8 matching positions

New

Senior Azure Data Engineer

Wissen Technology is hiring for Senior Azure Data Engineer. About Wissen Technol...
Location
Location
India , Bangalore South
Salary
Salary:
Not provided
votredircom.fr Logo
Wissen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience with Azure Databricks
  • Hands-on expertise in PySpark
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS Gen2)
  • Delta Lake
  • Azure Synapse Analytics
  • Advanced SQL and Python
  • Data Modelling and Lakehouse Architecture
  • CI/CD and Git-based development
  • Must Have Skills: Azure Databricks
Job Responsibility
Job Responsibility
  • Design and develop scalable data pipelines using Azure Data Factory, Azure Databricks, and PySpark
  • Build and maintain lakehouse architecture using Azure Data Lake Storage Gen2 and Delta Lake
  • Develop ETL/ELT frameworks for large-scale data processing
  • Optimize Spark workloads for performance, reliability, and cost efficiency
  • Implement data quality, governance, security, and monitoring best practices
  • Collaborate with business stakeholders, analysts, and engineering teams to deliver data solutions
  • Drive CI/CD implementation and automation for data engineering workflows
  • Troubleshoot production issues and ensure platform stability
  • Fulltime
Read More
Arrow Right

Senior Azure Data Engineer

Senior Data Engineer Role: Senior Data Engineer ‿ Migration Execution Locati...
Location
Location
India , Pune
Salary
Salary:
Not provided
techmahindra.com Logo
Tech Mahindra
Expiration Date
July 31, 2026
Flip Icon
Requirements
Requirements
  • Strong proficiency in SQL, Python, PySpark, Apache Spark
  • Hands on experience with Databricks (Delta, DLT, Autoloader, Unity Catalog) and/or Snowflake (Snowpark, Snowpipe, Streams, Tasks)
  • Experience with AWS services ‿ S3, Redshift, Athena, Glue, EMR, Lambda
  • Hands on with Apache Airflow DAG development
  • Experience with GitLab for version control and CI/CD
  • Strong SQL performance tuning and optimization skills
  • Experience with data quality validation and reconciliation
  • A Bachelor’s or Higher Degree is the minimum entry required for the position
Job Responsibility
Job Responsibility
  • Execute automated Lift & Shift migrations ‿ schema mapping, Iceberg table creation, pipeline generation for Bronze/Silver tables
  • Develop and refactor ETL/ELT pipelines ‿ decompose monolithic PSQL/Glue jobs into modular PySpark/Snowpark patterns
  • Review, validate, and refine AI assisted code conversions (PySpark/Snowpark)
  • label AI generated lines in code comments per EchoStar Addendum
  • Configure and execute dual run validation scripts ‿ row count, hash based integrity, business rule comparisons
  • Rationalize schemas, naming conventions, and lineage for AI Factory consumption patterns and Unity Catalog / Horizon Catalog governance
  • Develop and deploy Airflow DAGs replacing Control M orchestration
  • Produce before/after metrics (complexity, runtime, cost) for Technical Debt Remediation Log
  • Create operations runbooks, SOPs, and procedural guides for each migrated workload
  • Support EchoStar FTE shadowing and reverse shadowing during KT phases
  • Fulltime
Read More
Arrow Right

Senior Azure Data Engineer

We are looking for a highly skilled and experienced Senior Azure Data Engineer w...
Location
Location
Egypt , Cairo
Salary
Salary:
Not provided
coca-colahellenic.com Logo
Coca-Cola HBC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Information Technology, Computer Science, or related field
  • 5+ years of experience in data engineering with a strong focus on Azure (Azure Data Factory, Azure Data Lake Storage, Fabric)
  • Proven experience designing and building production-grade data pipelines that handle large volumes of data reliably
  • Strong SQL skills and experience with data modelling, schema design, and query optimization
  • Hands-on experience with Databricks (PySpark / Spark SQL) for large-scale data transformation
  • Proficiency in at least one programming language: Python (preferred), Scala, or C#/.NET
  • Solid understanding of data warehouse and lakehouse concepts
  • Strong ability to work independently, manage your own priorities, and deliver under ambiguity
  • Excellent communication skills - able to translate technical concepts for business stakeholders and vice versa
  • Excellent problem-solving and debugging skills
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ELT/ETL pipelines using Azure Data Factory, ensuring reliability and performance at terabyte scale
  • Own end-to-end pipeline health: monitoring, alerting, incident response, and continuous improvement
  • Identify and resolve bottlenecks across ingestion, transformation, and serving layers
  • drive measurable performance gains
  • Contribute to the design and evolution of our medallion architecture and golden layer strategy
  • Implement data ingestion processes from multiple heterogeneous sources, ensuring accuracy, completeness, and consistency
  • Support the migration from SAP BW, ensuring data continuity and quality throughout
  • Ensure data integrity and availability through appropriate storage solutions, partitioning strategies, and access controls
  • Work autonomously to deliver complex data engineering tasks with minimal supervision, while proactively communicating progress and blockers
  • Collaborate closely with data scientists, BI analysts, and business stakeholders to understand requirements and translate them into technical solutions
  • Fulltime
Read More
Arrow Right

Senior Azure Data Engineer

Parexel is looking for changemakers who are driven by curiosity, passion, and op...
Location
Location
Canada , Remote
Salary
Salary:
Not provided
parexel.com Logo
Parexel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 7 years of experience in software development
  • Minimum of 2 years of experience in cloud computing
  • Proficiency with Cloud Platform, Azure, DataBricks, Azure Data Factory, Azure Dev Ops, and SQL
  • Python and Power BI are preferred
  • Bachelor of Science in Computer Science, Engineering, or related technical field is required
  • Solid knowledge of SDLC and medallion architecture
  • Excellent problem-solving and analytical skills
  • Impeccable communication skills
Job Responsibility
Job Responsibility
  • Using Microsoft Azure data PaaS services, design, build, modify, and support data pipelines leveraging DataBricks and PowerBI in a medallion architecture setting
  • Create prototypes to validate proposed ideas and solicit input from stakeholders
  • Collaborate with Team Leads to define/clarify business requirements, estimate development costs, and finalize work plans
  • Run unit and integration tests on all created code – Create and run unit and integration tests throughout the development lifecycle
What we offer
What we offer
  • Health, Vision & Dental Insurance
  • Tuition Reimbursement
  • Vacation/Holiday/Sick Time
  • Flexible Spending & Health Savings Accounts
  • Work/Life Balance
  • 401(k) with Company match
  • Pet Insurance
  • Opportunity to work on innovative projects at the forefront of the industry
  • Collaborative and inclusive work environment that values your expertise
  • Professional advancement and development opportunities
  • Fulltime
Read More
Arrow Right

Senior Azure Data Engineer

Seeking a Lead AI DevOps Engineer to oversee design and delivery of advanced AI/...
Location
Location
Poland
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 6 years of professional experience in the Data & Analytics area
  • 1+ years of experience (or acting as) in the Senior Consultant or above role with a strong focus on data solutions build in Azure and Databricks/Synapse/(MS Fabric is nice to have)
  • Proven experience in Azure cloud-based infrastructure, Databricks and one of SQL implementation (e.g., Oracle, T-SQL, MySQL, etc.)
  • Proficiency in programming languages such as SQL, Python, PySpark is essential (R or Scala nice to have)
  • Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders
  • Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps)
  • Experience in leading and managing a team of data engineers, providing guidance, mentorship, and technical support
  • Knowledge of data management principles and best practices, including data governance, data quality, and data integration
  • Good project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results within designated deadlines
  • Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues
Job Responsibility
Job Responsibility
  • Act as a senior member of the Data Science & AI Competency Center, AI Engineering team, guiding delivery and coordinating workstreams
  • Develop and execute a cloud data strategy aligned with organizational goals
  • Lead data integration efforts, including ETL processes, to ensure seamless data flow
  • Implement security measures and compliance standards in cloud environments
  • Continuously monitor and optimize data solutions for cost-efficiency
  • Establish and enforce data governance and quality standards
  • Leverage Azure services, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions
  • Work with cross-functional teams to understand requirements and provide data solutions
  • Maintain comprehensive documentation for data architecture and solutions
  • Mentor junior team members in cloud data architecture best practices
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Workation
  • Great Place to Work® certified employer
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
Read More
Arrow Right

Senior Azure Data Engineer

We are seeking an experienced Azure Data Engineer with Databricks expertise to j...
Location
Location
Poland , Warszawa
Salary
Salary:
150.00 - 180.00 PLN / Hour
cyclad.pl Logo
Cyclad Sp. z o.o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3+years' hands-on experience with Azure Data Factory and Databricks (modern features, including Unity Catalog and 2025 capabilities)
  • At least 5+ years' experience in data engineering or backend/full-stack software development
  • Solid software engineering background: writing unit tests in Python, proficient with Git, and CI/CD pipelines
  • Strong SQL skills and experience structuring and modelling data in both relational and non-relational formats
  • Experience with data transformation tools, Spark, and real-time analytics solutions on Azure
  • Strong verbal and written communication skills in English
Job Responsibility
Job Responsibility
  • Design, build, and deploy scalable data pipelines using Azure Databricks and the Azure Analytics stack
  • Curate structured, semi-structured, and unstructured data by creating efficient, cost-effective, and scalable pipelines
  • Create and maintain robust data pipeline architecture ensuring data quality, reliability, and scalability
  • Assemble and manage large, complex datasets to meet functional and non-functional business requirements
  • Identify, design, and implement process improvements, including automation and optimization of data delivery
  • Work with real-time and streaming analytics solutions where applicable
  • Collaborate closely with Product Owners, Scrum Masters, architects, and data leadership to ensure timely, high-quality delivery
  • Align with Data Engineering chapter standards, processes, and best practices
  • Apply solid software engineering practices, including unit testing, CI/CD, and version control
  • Troubleshoot complex data-related issues and perform root cause analysis
What we offer
What we offer
  • Private medical care with dental care (covering 70% of costs) + rehabilitation package.
  • family package option possible
  • Multisport card (also for an accompanying person)
  • Life insurance
  • Flexibility and international environment
  • Fulltime
Read More
Arrow Right

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Senior Data Engineer (Azure)

Location
Location
India , Bangalore
Salary
Salary:
Not provided
mercedes-benz.com Logo
Mercedes-Benz AG
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6 to 9 years of professional experience in data engineering or related roles
  • Proven hands-on experience with Azure Databricks and cloud-based data pipeline development
  • Strong knowledge of ETL/ELT tools and processes, preferably within Azure ecosystems
  • Expertise in data modeling (star/snowflake schema, normalization, dimensional modeling)
  • Advanced programming skills in PySpark, Python, and SQL
  • Experience working with Azure SQL Data Warehouse, Azure Synapse, and Azure Data Factory
  • Understanding of data governance, data quality, and security best practices
  • Familiarity with Power BI for report and dashboard development (preferred)
  • Excellent analytical, problem-solving, and communication skills
  • Ability to work independently and in cross-functional teams in agile environments
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust, scalable, and efficient data pipelines and ETL processes on Azure cloud platform
  • Build and optimize data workflows using Azure Data Factory, Databricks, Azure Synapse Analytics, and related tools
  • Implement data ingestion from multiple sources (databases, APIs, event streams) ensuring data quality and integrity
  • Collaborate with cross-functional teams to understand data requirements and deliver timely solutions
  • Develop and maintain data models and data warehouse solutions optimized for performance and scalability
  • Monitor and troubleshoot data pipeline failures, ensuring high availability and reliability
  • Ensure data security, compliance, and governance in line with organizational policies
What we offer
What we offer
  • Mitarbeiterrabatte möglich
  • Gesundheitsmaßnahmen
  • Mitarbeiterhandy möglich
  • Essenszulagen
  • Betriebliche Altersversorgung
  • Hybrides Arbeiten möglich
  • Mobilitätsangebote
  • Mitarbeiter Events
  • Coaching
  • Flexible Arbeitszeit möglich
  • Fulltime
Read More
Arrow Right