CrawlJobs Logo
Randstad Logo Randstad · IT - Software Development

Principal Data Engineer (Microsoft Fabric)

Australia, Brisbane · Job Posted May 28, 2026
Apply Position
Job Link Share

Job Responsibility

  • Serve as the technical authority for all Microsoft Fabric components (OneLake, Lakehouse, Data Warehouse, and Real-Time Analytics) and establish enterprise-grade governance using Microsoft Purview
  • Own the Fabric platform's operational model, including capacity planning, workspace topology design, environment lifecycle management, and rigorous cost optimization
  • Lead the design and development of modular data products, Lakehouse schemas, and scalable ETL/ELT pipelines using Data Factory and Spark Notebooks for high-volume workloads
  • Own the DataOps/CI-CD strategy and operational monitoring, leveraging Git integration and Deployment Pipelines to automate promotion across environments and maintain strict data quality SLAs
  • Set the gold standard for engineering excellence, mentoring data engineers and collaborating with data scientists to design data processing components for MLOps workflows.

Requirements

  • Mandatory, deep hands-on expertise across the entire Microsoft Fabric ecosystem alongside expert-level proficiency in Microsoft Purview for data governance and lineage
  • Expert-level coding proficiency in Python (for Spark/Notebooks) and SQL (T-SQL/Spark SQL), with strong fundamentals in distributed systems and data modelling
  • Proven experience implementing DataOps, Infrastructure-as-Code (IaC), and automated CI/CD pipelines using GitHub, Azure DevOps, or Fabric Deployment Pipelines
  • Demonstrated ability to lead with influence, drive architectural consensus, and manage multi-disciplinary stakeholders across engineering, data science, and product teams.

What we offer

  • Access to a Udemy license for ongoing learning and continuous professional development
  • Access to exclusive discounts across various platforms
  • Discounts on private health funds
  • 3 payruns a week
Randstad - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal Data Engineer (Microsoft Fabric)

8 matching positions

Principal Software Engineer

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
Canada , Vancouver
Salary
Salary:
142400.00 - 257500.00 CAD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • 5+ years professional experience with compilers and/or database systems internals
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Improve performance of data processing in a large distributed system
  • Assist customers in complicated debugging scenarios
  • Enable dbuild the Data Engineering, Data Science, and Data Integration pillars of Microsoft Fabric
  • Build the Data Engineering, Data Science, and Data Integration pillars of Microsoft Fabric
  • Handle distributed live site issues
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Principal Consultant A2- Data & AI

The Principal Consultant is a senior leader responsible for the successful techn...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 20+ years of experience in software/solution engineering, with at least 3–5 years in delivery leadership roles
  • Proven experience in leading delivery of complex, multi-disciplinary projects
  • Strong understanding of modern delivery methodologies (Agile, Scrum, DevOps, etc.)
  • Excellent communication, stakeholder management, problem-solving, and team leadership skills
  • Bachelor’s degree in computer science, Engineering, or related field (or equivalent experience)
  • Relevant certifications are a plus
  • Areas of Expertise: Enterprise Data Architecture & Modern Platforms
  • Data Engineering & Large Scale Data Processing
  • Database Platforms, Performance & Capacity Engineering
  • RealTime Analytics & Operational Intelligence
Job Responsibility
Job Responsibility
  • AI-First Delivery Leadership: Embed AI-first principles into delivery workflows
  • Lead end-to-end delivery of complex projects
  • Drive engineering excellence through reusable components, accelerators, and scalable architecture
  • Oversee technical execution across multiple projects
  • Collaborate with clients and internal stakeholders to define strategies, delivery plans, milestones, and risk mitigation approaches
  • Act as a technical point of contact for clients
  • Ensure delivery models are optimized for modern AI-native execution
  • Ability to step into at‑risk projects, quickly assess issues, and establish a credible path to recovery or exit
  • Engineering Excellence: Champion high-quality engineering practices across all delivery engagements
  • Ensure adherence to coding standards, architectural integrity, and performance benchmarks
  • Fulltime
Read More
Arrow Right

Principal Consultant - Data & AI

The Principal Consultant is a senior leader responsible for the successful techn...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 20+ years of experience in software/solution engineering, with at least 3–5 years in delivery leadership roles
  • Proven experience in leading delivery of complex, multi-disciplinary projects
  • Strong understanding of modern delivery methodologies (Agile, Scrum, DevOps, etc.)
  • Excellent communication, stakeholder management, problem-solving, and team leadership skills
  • Bachelor’s degree in computer science, Engineering, or related field (or equivalent experience)
  • Relevant certifications are a plus
  • Enterprise Data Architecture & Modern Platforms expertise
  • Data Engineering & Large Scale Data Processing expertise
  • Database Platforms, Performance & Capacity Engineering expertise
  • RealTime Analytics & Operational Intelligence expertise
Job Responsibility
Job Responsibility
  • AI-First Delivery Leadership: Embed AI-first principles into delivery workflows, leveraging automation and intelligent orchestration where applicable
  • Lead end-to-end delivery of complex projects, ensuring solutions are scalable, robust, and aligned with client business outcomes
  • Drive engineering excellence through reusable components, accelerators, and scalable architecture
  • Oversee technical execution across multiple projects, ensuring adherence to best practices, quality standards, and compliance requirements
  • Collaborate with clients and internal stakeholders to define strategies, delivery plans, milestones, and risk mitigation approaches
  • Act as a technical point of contact for clients, translating business requirements into scalable technical solutions
  • Ensure delivery models are optimized for modern AI-native execution, including integration of automation and intelligent processes
  • Ability to step into at‑risk projects, quickly assess issues, and establish a credible path to recovery or exit
  • Engineering Excellence: Champion high-quality engineering practices across all delivery engagements
  • Ensure adherence to coding standards, architectural integrity, and performance benchmarks
  • Fulltime
Read More
Arrow Right

Microsoft Elevate Worldwide Data Solutions Go to Market Director

We are seeking a forward‑thinking, impact‑driven Microsoft Elevate Worldwide Dat...
Location
Location
United States , Multiple Locations
Salary
Salary:
133000.00 - 222700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Information Technology, Engineering, Health Sciences, Supply Chain, Education, Business or related field AND 5+ years customer-facing experience in operations, enterprise-level improvement program management, product management, transportation, hospitality, automotive, consumer goods, financial services, retail, management consulting, consultative selling, public sector, technology or industry-relevant equivalent management or technical work experience
  • OR Bachelor's Degree in Computer Science, Information Technology, Engineering, Health Sciences, Supply Chain, Education, Business or related field AND 7+ years customer-facing experience in operations, enterprise-level improvement program management, product management, transportation, hospitality, automotive, consumer goods, financial services, retail, management consulting, consultative selling, public sector, technology or industry-relevant equivalent management or technical work experience
  • OR equivalent experience.
  • 5+ years proven people management and/or leadership experience.
  • 5+ years of experience in a WW GTM or Corporate function for Azure Data Solutions or comparable competitors.
  • 5+ years of experience in creating and driving programs/businesses in the field required.
  • A proven track record of successfully managing a $500M+ business
Job Responsibility
Job Responsibility
  • Champion the adoption of secure AI-powered productivity solutions, including Microsoft 365 Copilot and agent-based workflows, to help nonprofits scale their impact.
  • Lead the development of offers, programs, and investment strategies tailored to the unique needs of nonprofit organizations, with a focus on AI readiness and digital transformation.
  • Serve as the principal advocate for AI Workforce in the nonprofit ecosystem, aligning internal stakeholders, partners, and field teams to accelerate adoption and usage.
  • Drive partner-led growth by enabling a robust ecosystem of solution providers to deliver value through AI agents, Copilot Studio, and integrated Microsoft 365 experiences.
  • Own and manage key performance indicators that reflect the health, reach, and impact of the Modern Work business across the nonprofit sector.
  • Develop and lead the business strategy for Microsoft Data Solutions—including modern data platforms, analytics, data governance, and AI‑ready data foundations—across the K–12 and nonprofit sectors.
  • Track performance and long‑term sustainability of data modernization and AI‑readiness initiatives, ensuring adoption is durable, scalable, and aligned to the needs of mission‑driven organizations.
  • Hold end‑to‑end accountability for defining scorecard metrics and KPIs that reflect data maturity, platform adoption, solution impact, and organizational outcomes.
  • Partner across senior leadership using a One Microsoft approach to drive alignment, inform investments, and optimize strategic decision‑making.
  • Represent the business in Rhythm of Business, monthly, and quarterly reviews—providing insights, risks, and recommendations grounded in product truth, customer data maturity, and real operational challenges.
  • Fulltime
Read More
Arrow Right

Principal Product Manager - Data Engineering

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
Canada , Vancouver
Salary
Salary:
142400.00 - 257500.00 CAD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
  • 4+ years experience with Data Engineering in Cloud
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Own the end‑to‑end developer experience across notebooks, APIs, and AI‑assisted tooling (including MCP and CI/CD), enabling data engineers and professional developers to reliably build, scale, and operate Apache Spark workloads on Microsoft Fabric in the age of AI
  • Translate customer, partner, and field insights into clear product priorities that measurably improve usability, productivity, and operational readiness
  • Partner closely with engineering and partner teams to shape production‑grade Spark capabilities, including performance, reliability, security, and deep integration across the Microsoft Fabric ecosystem
  • Advance AI‑assisted developer workflows for data engineering, including Copilot‑powered experiences, that reduce friction and eliminate operational complexity in real‑world Spark workloads
  • Represent the Spark developer experience in cross‑team and platform‑level decision making, aligning stakeholders across Azure Data, Fabric, and Real‑Time Intelligence to deliver cohesive outcomes at scale
  • Embody Microsoft’s culture and values by operating with a growth mindset, customer obsession, accountability, and inclusive collaboration—driving impact through influence rather than people management
  • Fulltime
Read More
Arrow Right

Data Architect

We are seeking a Principal‑level Data Architect with deep expertise in enterpris...
Location
Location
Canada
Salary
Salary:
180000.00 - 250000.00 CAD / Year
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in data engineering, data architecture, or platform engineering
  • Experience designing or building enterprise data platforms on at least one of Azure, GCP, or AWS and Databricks
  • Deep expertise in SQL, Python, distributed data processing, and cloud-native data design
  • Significant experience with medallion/lakehouse architecture patterns
  • Strong knowledge of modern data platforms: Databricks, Azure Synapse, Microsoft Fabric, Delta Lake, BigQuery, etc.
  • Proven experience leading architecture across large programs and multiple concurrent projects
  • Experience with enterprise automation and integration using REST APIs
  • Strong communication skills and ability to engage confidently with senior leadership and clients
  • Experience in pre-sales, technical solutioning, or client-facing architecture leadership
Job Responsibility
Job Responsibility
  • Design and own complex, enterprise-scale data architectures across MS Fabric, Azure, GCP, AWS, or Databricks serverless or hosted environments
  • Define and enforce architectural standards, patterns, and governance frameworks across ingestion, modeling, lineage, security, and orchestration
  • Shape AI‑enabled architecture approaches, including data foundations for ML, feature engineering, and low-latency operationalization pipelines
  • Act as a principal advisor to client technical leadership, helping shape long-term strategy, roadmaps, and modernization initiatives
  • Lead architectural direction during pre-sales cycles, including solutioning, scoping, estimation, and executive-level presentations
  • Anticipate downstream impacts of architectural decisions
  • maintain ownership when delivery teams or constraints require deviation from the original design
  • Architect highly available, distributed, fault‑tolerant data pipelines supporting batch and streaming workloads
  • Oversee migration and integration of complex, diverse data sources into Fabric, Azure, GCP, or Databricks platforms
  • Define medallion/lakehouse modeling patterns across Bronze/Silver/Gold zones or cloud equivalents
What we offer
What we offer
  • A comprehensive insurance plan, where you can choose the module that best suits your needs—Gold, Silver, or Bronze. The employer may contribute up to 80% of your coverage depending on the selected module. This plan includes short- and long-term disability coverage
  • Dialogue via Sun Life provides virtual healthcare services, allowing you to consult with a healthcare professional for emergencies, prescription renewals, and more. You also have access to the Employee and Family Assistance Program, as well as a complete mental health support program
  • A $500 Personal Spending Account, which can be used for healthcare reimbursements, gym memberships, public transit passes, office supplies, or contributions to your RRSP through Valtech
  • A retirement plan where Valtech will match 100% of your RRSP contributions through a Deferred Profit Sharing Plan (DPSP), up to a maximum of 4%. You can start contributing to your RRSP immediately, and to the DPSP after 3 months. The vesting of the DPSP will be after a 24 months of service
  • Access to a flexible vacation under Valtech's policy to support your work-life balance, with 5 days available during your probation period and a prorated amount calculated for the remainder of the year
  • Personal Technology Reimbursement – $30/month for every employee-offered on day 1
  • We close during the winter holidays and offer flexible scheduling throughout the year, so you can enjoy those sunny Friday afternoons—provided your weekly hours are completed
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or Engineering or Mathematics or Physics or related technical discipline
  • 12+ years of software engineering and product development experience in industry
  • 12+ years of proven track record of shipping end-user software services or products
  • 10+ years of in-depth object-oriented programming experience in (not limited to) Java/C++/C#
  • Equal ability in reading and enhancing existing code as well as writing entirely new code from scratch
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Adopt AI-first development practices for creating, implementing, optimizing, debugging, refactoring, and reusing code to establish and enhance features, performance, maintainability, effectiveness, and return on investment (ROI)
  • Collaborate with appropriate stakeholders to determine user requirements for product scenarios
  • Drive end-to-end across multiple teams starting from identification of, documentation of design to completion of development of a feature, product, application, service, or platform
  • Leverage subject-matter expertise of product features and partner with appropriate stakeholders (e.g., product managers) in driving workgroup's project plans, release plans, and work items
  • Act as a Designated Responsible Individual (DRI) and guide other engineers in developing and following the playbook, working on call to monitor system/product/service for degradation, downtime, or interruptions, alerting stakeholders about status and initiates actions to restore system/product/service for simple and complex problems when appropriate
  • Proactively seek new knowledge and adapt to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale
  • Fulltime
Read More
Arrow Right

Principal Software Engineering

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Master's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 5+ years of software development experience building scalable, distributed services using C# or other high level languages
  • 5+ years of experience with multi-threaded/parallel programming
  • 5+ years of software development experience on Service Fabric or Kubernetes
Job Responsibility
Job Responsibility
  • Collaborate with Product managers on product specifications and requirements
  • Collaborate with the US team on technical aspects and support the local team to ramp up, contribute and support large scale business critical Azure services
  • Guide design and development of high quality software incrementally
  • Solid execution: Plan, schedule and deliver quality software incrementally
  • Maintain and operate online services
  • Review changes to product codebase and provide constructive feedback that align with industry best practices to mentor and grow junior and senior engineers
  • Participate respectfully in design, architecture, execution reviews or other team discussions
  • Listen to others perspectives and feedback and take action on valid feedback
  • Provide constructive feedback to others
  • Partner with other teams in the organization to leverage work ideas of others to deliver efficiently
  • Fulltime
Read More
Arrow Right