CrawlJobs Logo
Randstad Logo Randstad · IT - Software Development

Principal Data Engineer

New Zealand, Wellington Central · Job Posted June 29, 2026
Apply Position
Job Link Share

Job Description

We are seeking a highly accomplished Principal Data Engineer for an initial 3-month contract to drive the implementation of critical, high-visibility data platforms across multiple clients. In this role, you will act as the senior technical authority, bridging our existing data structures with next-generation capabilities. You will design, build, and optimise enterprise-scale data pipelines, ensuring maximum performance, reliability, and modern governance.

Job Responsibility

  • Drive the implementation of critical, high-visibility data platforms across multiple clients
  • Act as the senior technical authority, bridging our existing data structures with next-generation capabilities
  • Design, build, and optimise enterprise-scale data pipelines, ensuring maximum performance, reliability, and modern governance

Requirements

  • Snowflake: Advanced, hands-on experience optimising, modeling, and managing complex cloud data warehouses
  • Microsoft Fabric: Strong expertise with Fabric native capabilities, including Lakehouses, Data Factory, and Synapse-based workflows
  • Core Engineering: Advanced SQL proficiency and strong programming skills in Python
  • Enterprise Delivery: Proven track record as a Lead or Principal Engineer in large-scale cloud data transformations, with a solid grasp of CI/CD, DevOps, and data governance
  • 5 years experience
  • Bachelor Degree
Randstad - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal Data Engineer

8 matching positions

New

Principal Data Engineer

Do you want to lead the development and transformation of the data platform that...
Location
Location
Denmark , Copenhagen
Salary
Salary:
Not provided
3shape.com Logo
3Shape
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Several years of experience designing, building, and operating modern cloud-based data platforms, ideally in a large organization, technology company, or consulting environment, supported by a degree in Computer Science, Data Engineering, Software Engineering, or a related field
  • Strong experience with modern cloud-based data platforms and technologies (preferably Azure Databricks, Apache Spark, Delta Lake), combined with solid software engineering skills in Python, SQL, CI/CD, and Infrastructure as Code
  • Experience establishing scalable platform architectures, governance frameworks, and operating models that enable teams to build trusted, secure, and high-quality data products
  • Strong communication and stakeholder management skills, with the ability to engage and influence both technical and non-technical stakeholders. You enjoy enabling data domain teams, collaborating with business teams, and translating complex technical concepts into practical solutions and business value
  • A collaborative leadership style and experience driving alignment, standards, and best practices across teams in a federated environment
  • Curiosity, ambition, and a genuine passion for data, AI, and digital transformation, combined with a hands-on mindset and a drive to continuously improve platform capabilities and data excellence
Job Responsibility
Job Responsibility
  • Lead the transformation of the Databricks platform into an AI-ready foundation, strengthening platform ownership, governance, and scalability across the organization
  • Define and evolve enterprise-wide standards for data platform architecture, governance, security, and access management in close collaboration with Group IT and other key stakeholders
  • Enable and guide domain data teams through technical leadership, architectural best practices, platform capabilities, and data product standards, incl. design and establish scalable frameworks for ingesting and managing data
  • Contribute hands-on to development, working closely with engineers to design, build, and deliver robust, scalable data platform capabilities, and foster alignment and collaboration by driving platform consistency, reusable patterns, and knowledge sharing
  • Drive planning and prioritization across the end-to-end data lifecycle, aligning platform evolution with data products, analytics, and AI initiatives
  • Drive operational excellence and cost optimization of the platform, including governance of Databricks usage and consumption models
  • Identify, evaluate, and drive adoption of new platform capabilities, AI technologies, and emerging data platform opportunities
  • Drive a culture of data excellence by improving data literacy, promoting best practices, and helping teams across the organization maximize the value of data, analytics, and AI
What we offer
What we offer
  • Vibrant and international environment with social, diverse, and highly skilled and cooperative colleagues - we are more than 40 nationalities in our DK based office
  • Attractive healthcare package to keep you fit and well
  • Breakfast every day, and delicious and healthy lunch cooked by our private chefs
  • Great social work environment with many optional activities and social clubs, ranging from wine & beer, board games, running to bicycle clubs
  • Attractive offices and R&D lab spaces in downtown Copenhagen close to Kgs. Nytorv, Nyhavn, and the Copenhagen Canals
  • Purpose: Help improve dental patients on a global scale
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Our Client is seeking a Principal Data Engineer to roll up their sleeves and bui...
Location
Location
United States , New York
Salary
Salary:
175000.00 - 220000.00 USD / Year
solomonpage.com Logo
Solomon Page
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong foundation in software engineering principles, including SOLID design, modularity, and scalability.
  • Expert proficiency in Databricks, including Delta Lake, Unity Catalog, Delta Live Tables, MLflow, and Databricks Workflows.
  • Deep experience with Snowflake, including data modeling, performance optimization, and integration with upstream/downstream pipeline tooling.
  • Expert proficiency in Python for data pipeline and automation development.
  • Advanced SQL skills with experience optimizing complex queries and data models at scale.
  • Proven experience designing and maintaining cloud-native data pipelines on AWS (e.g., MWAA/Airflow, Lambda, ECS, SQS, Glue, S3, Redshift, etc.).
  • Experience implementing and managing Terraform or similar IaC frameworks.
  • Strong understanding of lakehouse architecture patterns, data ingestion, transformation, and orchestration, including familiarity with ML/AI pipeline integration patterns.
  • Familiarity with CI/CD pipelines, automated testing, and modern DevOps practices.
  • 8+ years of experience in data engineering or backend development, with a focus on scalable data solutions.
Job Responsibility
Job Responsibility
  • Build and maintain end-to-end data pipelines — from raw ingestion through transformation and delivery — across diverse data sources (APIs, web data, internal feeds, etc.).
  • Hands-on development of scalable, production-grade pipelines within Databricks, including Delta Lake table management, Workflows, and cluster optimization.
  • Build and maintain data models, schemas, and transformation logic in Snowflake, optimizing for performance and reliability.
  • Develop and manage Databricks environments including Unity Catalog, Delta Live Tables, and integration patterns that support both internal data consumers and external sharing use cases.
  • Build and manage orchestration workflows using AWS services (MWAA/Airflow, Lambda, ECS, SQS, MSK) and Databricks-native orchestration where appropriate.
  • Implement and maintain infrastructure as code (IaC) using Terraform, ensuring reproducibility and compliance with cloud standards.
  • Establish and enforce best practices in data modeling, schema design, and ETL/ELT processes for high-volume structured and semi-structured data across Snowflake and Databricks.
  • Ensure data quality, lineage, and observability through automated testing, monitoring, and alerting across all pipeline layers.
  • Collaborate closely with technology leadership to align data platform development with business strategy and product goals.
  • Stay at the forefront of industry trends in data engineering, lakehouse architecture, and cloud-native data platforms.
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Principal Data Engineer. This role has been designed as 'Onsite' with an expecta...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Data Engineering, with demonstrated architectural ownership
  • Expert-level experience with Snowflake (mandatory), including performance optimization, data modeling, security, and ecosystem components
  • Expert proficiency in SQL and strong Python skills for pipeline development and automation
  • Experience with modern orchestration tools (Airflow, Dagster, Prefect, or equivalent)
  • Strong understanding of ELT/ETL patterns, distributed processing, and data lifecycle management
  • Familiarity with streaming/event technologies (Kafka, Kinesis, Pub/Sub, etc.)
  • Experience implementing data quality, observability, and lineage solutions
  • Solid understanding of cloud infrastructure (AWS, GCP, or Azure)
  • Strong background in DataOps practices: CI/CD, testing, version control, automation
  • Proven leadership in driving architectural direction and mentoring engineering teams
Job Responsibility
Job Responsibility
  • Architecture & Strategy: Own a significant portion of the architecture of our data platform, ensuring scalability, performance, reliability, and security
  • Define standards and best practices for data modeling, transformation, orchestration, governance, and lifecycle management
  • Evaluate and integrate modern data technologies and frameworks that align with our long-term platform strategy
  • Collaborate with engineering and product leadership to shape the technical roadmap
  • Engineering & Delivery: Design, build, and manage scalable, resilient data pipelines for batch, streaming, and event-driven workloads
  • Develop clean, high-quality data models and schemas to support analytics, BI, operational systems, and ML workflows
  • Implement data quality, lineage, observability, and automated testing frameworks
  • Build ingestion patterns for APIs, event streams, files, and third-party data sources
  • Optimize compute, storage, and transformation layers for performance and cost efficiency
  • Leadership & Collaboration: Serve as a senior technical leader and mentor within the data engineering team
What we offer
What we offer
  • Health & Wellbeing: comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Personal & Professional Development: programs to help reach career goals
  • Unconditional Inclusion: inclusive work environment
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Capstone IT is seeking a Principal Data Engineer to lead enterprise-scale data e...
Location
Location
United States , Springfield
Salary
Salary:
Not provided
capstonec.com Logo
Capstone IT Staffing
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Snowflake
  • Google Cloud Platform (GCP)
  • BigQuery
  • ELT/ETL Pipeline Development
  • Kafka and/or NiFi
  • Cloud Data Architecture
  • SQL & Data Modeling
  • Real-Time Data Streaming
  • Business Intelligence & Reporting Tools
  • Executive Stakeholder Communication
Job Responsibility
Job Responsibility
  • Lead enterprise data engineering initiatives across eCommerce, customer analytics, and omnichannel data environments
  • Design, develop, and optimize scalable ELT/ETL pipelines supporting enterprise analytics and reporting
  • Build and maintain high-performance Snowflake and BigQuery data architectures
  • Develop and support real-time and batch data processing solutions using cloud-native technologies and streaming platforms
  • Partner with Product Owners, Business Analysts, marketing teams, and executive leadership to translate business requirements into scalable technical solutions
  • Deliver actionable analytics, dashboards, and executive-level reporting insights
  • Ensure data quality through governance, cleansing, transformation, integration, and validation processes
  • Drive architectural decisions related to enterprise data platforms, cloud modernization, and streaming ecosystems
  • Support BI and analytics environments utilizing tools such as Domo, Sigma, Tableau, and related visualization technologies
  • Manage offshore engineering resources and vendor relationships, including deliverables, budgeting, performance management, and capacity planning
What we offer
What we offer
  • Medical Insurance
  • Dental Insurance
  • Vision Insurance
  • Company Matching 401(k)
  • Paid Relocation Assistance
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

We are on the lookout for a Principal Data Engineer to help define and lead the ...
Location
Location
South Africa; United Kingdom; Poland
Salary
Salary:
Not provided
dotdigital.com Logo
Dotdigital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience delivering python-based projects in the data engineering space
  • Extensive experience working with SQL and NoSQL database technologies
  • Proven experience with modern data warehousing and large-scale data processing tools
  • Hands on experience with data orchestration tools
  • Experience using cloud environments (e.g. Azure, AWS, GCP) to process, store and surface large scale data
  • Experience using Kafka or similar event-based architectures
  • Strong grasp of data architecture and data modelling principles for both OLAP and OLTP workloads
  • Capable in the wider software development lifecycle in terms of agile ways of working and continuous integration/deployment of data solutions
  • Experience as a lead or Principal Engineer on large-scale data initiative or product builds
  • Demonstrated ability to architect data systems and data structures for high volume, high throughput systems
Job Responsibility
Job Responsibility
  • Lead the design and implementation of scalable, secure and resilient data systems across streaming, batch and real-time use cases
  • Architect data pipelines, model and storage solutions that power analytical and product use cases
  • using primarily Python and SQL via orchestration tooling that run workloads in the cloud
  • Leverage AI to automate both data processing and engineering processes
  • Assure and drive best practices relating to data infrastructure, governance, security and observability
  • Work with technologists across multiple teams to deliver coherent features and data outcomes
  • Support the data team to help adopt data engineering principles
  • Identify, validate and promote new tools and technologies that improve the performance and stability of data services
What we offer
What we offer
  • Parental leave
  • Medical benefits
  • Paid sick leave
  • Dotdigital day
  • Share reward
  • Wellbeing reward
  • Wellbeing Days
  • Loyalty reward
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

We are looking for a hands-on Principal Data Engineer who is passionate about so...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years’ experience of implementing data-intensive solutions using agile methodologies
  • Proficient in one or more programming languages commonly used in data engineering such as Python, Java, or Scala
  • Multiple years of experience with software engineering best practices (unit testing, automation, design patterns, peer review, etc.)
  • Strong proficiency in working with relational databases and using SQL for data querying, transformation, and manipulation
  • Expertise in Quantexa Entity resolution product, Quantexa certifications will be preferred
  • Clear understanding of Data Structures and Object Oriented Principles
  • Experience of modelling data for analytical consumers
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • Experience with Hadoop for data storage and processing is valuable, as is exposure to modern data platforms such as Snowflake and Databricks
  • Multiple years of experience architecting and building horizontally scalable, highly available, highly resilient, and low latency applications
Job Responsibility
Job Responsibility
  • Code contributing member of multiple Agile teams, working to deliver sprint goals
  • Demonstrating deep technical knowledge and expertise in software development, including programming languages, frameworks, and best practices. Providing guidance and mentorship to junior team members
  • Actively contributes to the implementation of critical features and complex technical solutions. Write clean, efficient, and maintainable code that meets the highest standards of quality
  • Collaborate with other Principal Engineers to define and evolve the overall system architecture and design
  • Provide guidance on scalable, robust, and efficient solutions that align with business requirements and industry best practices
  • Offer expert engineering guidance and support to multiple teams, helping them overcome technical challenges, make informed decisions, and deliver high-quality software solutions. Foster a culture of technical excellence and continuous improvement
  • Stay up to date with emerging technologies, tools, and industry trends. Evaluate their potential impact on the organization and provide recommendations for technology adoption and innovation
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

The Principal Data Engineer at NTT DATA is responsible for transforming data int...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field
  • Extended demonstrated experience in data engineering, data mining within a fast-paced environment
  • Extended experience in building modern data analytics solutions that delivers insights from large and complex data sets with multi-terabyte scale
  • Extended demonstrated experience with architecture and design of secure, highly available and scalable systems
  • Extended demonstrated experience in automation, scripting and proven examples of successful implementation
  • Extended demonstrated experience using scripting language (Perl, bash, Shell Scripting, Python, etc.)
  • Extended demonstrated experience with big data tools like Hadoop, Cassandra, Storm etc.
  • Extended demonstrated experience in any applicable language, preferably .NET
  • Extended demonstrated experience in SAP, SQL, MySQL databases and Microsoft SQL
  • Extended demonstrated experience working with data sets and ordering data through MS Excel functions, e.g. macros, pivots
Job Responsibility
Job Responsibility
  • Leads on designing data models in a structured data format to enable analysis thereof
  • Design. and develop. scalable extract, transformation and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources
  • Participates in the transformation of object and data models into appropriate database schemas within design constraints
  • Interprets installation standards to meet project needs and produce database components as required
  • Advises on test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations
  • Accountable for running data migrations across different databases and applications, e.g. MS Dynamics, Oracle, SAP and other ERP systems
  • Works across multiple IT and business teams to define and implement data table structures and data models based on requirements
  • Accountable for analysis, and development of ETL and migration documentation
  • Works with cross functionally stakeholders to evaluate potential data requirements
  • Owns the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Microsoft’s Path team helps customers along their journey from the initial idea ...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Design, implement, monitor, and optimize large-scale, robust data pipelines and architectures that support Microsoft Path products data analytics initiatives.
  • Develop scalable ETL/ELT workflows, ensure reliable ingestion, transformation, and storage of high-volume, high-velocity data from diverse sources with different schemas.
  • Enforce best practices for data quality, lineage, security, and compliance.
  • Collaborate with stakeholders to define trustworthy data sets and implement rigorous data validation protocols, ensuring analytics are accurate and auditable.
  • Work closely with product managers, software engineers, AI researchers, and business stakeholders to build data solutions that accomplish business goals.
  • Enable self-service analytics and empower teams by building data models, semantic layers, and tools that streamline access to trusted information.
  • Translate ambitious vision into actionable roadmaps and measurable outcomes.
  • Mentor senior data engineers and technical leads, guide complex design decisions, and foster a culture of engineering excellence, operational rigor, and continuous learning across the organization.
  • Fulltime
Read More
Arrow Right