CrawlJobs Logo
84 Recruitment Limited Logo 84 Recruitment Limited · IT - Software Development

Databricks Engineer

New Zealand, Wellington · Job Posted April 27, 2026
Apply Position
Job Link Share

Job Description

We’re working with multiple organisations across Auckland and Wellington seeking Databricks Engineers for contract opportunities. You’ll play a key role in designing and building scalable data platforms, with a strong focus on ETL/ELT pipeline development and optimisation within Databricks. Experience working with Medallion Architecture (Bronze, Silver, Gold layers) is essential.

Job Responsibility

  • Design, build, and maintain ETL/ELT pipelines on Databricks
  • Implement and optimise Medallion Architecture data layers
  • Ensure data quality, governance, and performance across pipelines
  • Collaborate with stakeholders to deliver scalable data solutions

Requirements

  • Strong hands-on experience with Databricks
  • Proven background in ETL/ELT pipeline development
  • Experience with cloud platforms (AWS, Azure, or GCP)
  • Solid understanding of modern data architecture and best practices
84 Recruitment Limited - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Databricks Engineer

8 matching positions

Databricks Engineer

Databricks Engineer (Contract) – Auckland & Wellington & Christchurch. We’re wor...
Location
Location
New Zealand , Christchurch
Salary
Salary:
Not provided
84recruitment.co.nz Logo
84 Recruitment Limited
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Databricks or similar cloud platform
  • Proven background in ETL/ELT pipeline development
  • Experience with cloud platforms (AWS, Azure, or GCP)
  • Solid understanding of modern data architecture and best practices
Job Responsibility
Job Responsibility
  • Design, build, and maintain ETL/ELT pipelines on Databricks
  • Implement and optimise Medallion Architecture data layers
  • Ensure data quality, governance, and performance across pipelines
  • Collaborate with stakeholders to deliver scalable data solutions
Read More
Arrow Right

Databricks Engineer

Databricks Engineer (Contract) – Auckland & Wellington & Christchurch. We’re wor...
Location
Location
New Zealand , Auckland; Wellington; Christchurch
Salary
Salary:
Not provided
84recruitment.co.nz Logo
84 Recruitment Limited
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Databricks or similiar cloud platform
  • Proven background in ETL/ELT pipeline development
  • Experience with cloud platforms (AWS, Azure, or GCP)
  • Solid understanding of modern data architecture and best practices
Job Responsibility
Job Responsibility
  • Design, build, and maintain ETL/ELT pipelines on Databricks
  • Implement and optimise Medallion Architecture data layers
  • Ensure data quality, governance, and performance across pipelines
  • Collaborate with stakeholders to deliver scalable data solutions
Read More
Arrow Right

Databricks Engineer

Job Title: Databricks Engineer; Location – Remote; Fulltime; Skill: Databricks E...
Location
Location
United States
Salary
Salary:
140000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 6-8 years of relevant experience
  • Develop and maintain CI/CD pipelines for Azure Databricks deployments (Azure DevOps/YAML and related tools)
  • Automate deployment and configuration of Databricks clusters, jobs, libraries, notebooks, and environment promotions
  • Implement and manage the Databricks environment for performance, cost efficiency, and scalability
  • optimize cluster sizing and autoscaling
  • Collaborate with Data Engineers/Scientists/Software Engineers to design, deploy, and scale data pipelines and models on Databricks
  • Monitor and troubleshoot clusters, pipelines, jobs, and associated workflows
  • integrate Azure Monitor/Log Analytics for visibility and metrics
  • Implement Infrastructure as Code (IaC) using Terraform, ARM templates, or Bicep to manage Azure resources and Databricks artifacts
  • Design and maintain backup, recovery, and DR strategies for Databricks environments
Job Responsibility
Job Responsibility
  • Workspace & environment engineering: Standardize Dev/UAT/Prod workspaces (network/Private Link, VNets, secure egress), service principals, secret scopes, and Key Vault integrations
  • Unity Catalog & governance: Configure catalogs/schemas, RBAC, lineage, and data access patterns aligned to our guardrails
  • CI/CD for Databricks: Implement YAML based Azure DevOps pipelines to automate notebook/job deployments, dependencies, environment promotions, and approvals/compliance checks
  • IaC for Databricks & Azure: Author reusable Bicep/Terraform modules for workspaces, clusters/pools, UC objects, and supporting Azure resources
  • Observability & reliability: Establish monitoring/alerting for jobs, clusters, SLAs, autoscaling, and cost controls
  • and automation for disaster recovery scenarios
  • Documentation & handover: Patterns, pipeline templates, IaC modules, and operational runbooks for BAU, plus KT during the first two releases
  • Fulltime
Read More
Arrow Right

Databricks Engineer

Our client is revolutionizing the field of cell therapy manufacturing by develop...
Location
Location
Salary
Salary:
Not provided
coherentsolutions.com Logo
Coherent Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in Data Engineering with strong technical expertise
  • Proven hands-on experience with the Databricks Data Platform and Delta Lake
  • Experience building and managing Databricks Lakehouse solutions
  • Knowledge of Delta Live Tables or similar frameworks for real-time data ingestion is a strong plus
  • Ability to define processes from scratch and establish development workflows in a new or evolving team
  • Familiarity with data testing best practices and collaboration with QA teams to ensure data quality
  • Strong problem-solving mindset, initiative, and readiness to work in a dynamic, evolving environment
  • Ability to work with a time shift, ensuring overlap with the client until approximately 10:30 AM Pacific Time for meetings and collaboration
  • English level: Upper-Intermediate (written and spoken)
Job Responsibility
Job Responsibility
  • Design, build, and maintain data pipelines using Databricks and Delta Live Tables for real-time and batch data processing
  • Collaborate with cross-functional teams to ensure smooth data flow from diverse log-based sources
  • Participate in both individual and collaborative work, ensuring scalability, reliability, and performance of data solutions
  • Define and implement best practices for data development and deployment processes on the Databricks platform
  • Proactively address technical challenges in a project environment, proposing and implementing effective solutions
What we offer
What we offer
  • Technical and non-technical training for professional and personal growth
  • Internal conferences and meetups to learn from industry experts
  • Support and mentorship from an experienced employee to help you professional grow and development
  • Internal startup incubator
  • Health insurance
  • English courses
  • Sports activities to promote a healthy lifestyle
  • Flexible work options, including remote and hybrid opportunities
  • Referral program for bringing in new talent
  • Work anniversary program and additional vacation days
Read More
Arrow Right

Databricks Engineer

We are seeking a Databricks Engineer to design, build, and operate a Data & AI p...
Location
Location
United States , Leesburg
Salary
Salary:
Not provided
wintrio.com Logo
WINTrio
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience with Databricks, Delta Lake, and Apache Spark
  • Deep understanding of ELT pipeline development, orchestration, and monitoring in cloud-native environments
  • Experience implementing Medallion Architecture (Bronze/Silver/Gold) and working with data versioning and schema enforcement in enterprise grade environments
  • Strong proficiency in SQL, Python, or Scala for data transformations and workflow logic
  • Proven experience integrating enterprise platforms (e.g., PeopleSoft, Salesforce, D2L) into centralized data platforms
  • Familiarity with data governance, lineage tracking, and metadata management tools
Job Responsibility
Job Responsibility
  • Data & AI Platform Engineering (Databricks-Centric): Design, implement, and optimize end-to-end data pipelines on Databricks, following the Medallion Architecture principles
  • Build robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake to transform raw (bronze) data into trusted curated (silver) and analytics-ready (gold) data layers
  • Operationalize Databricks Workflows for orchestration, dependency management, and pipeline automation
  • Apply schema evolution and data versioning to support agile data development
  • Platform Integration & Data Ingestion: Connect and ingest data from enterprise systems such as PeopleSoft, D2L, and Salesforce using APIs, JDBC, or other integration frameworks
  • Implement connectors and ingestion frameworks that accommodate structured, semi-structured, and unstructured data
  • Design standardized data ingestion processes with automated error handling, retries, and alerting
  • Data Quality, Monitoring, and Governance: Develop data quality checks, validation rules, and anomaly detection mechanisms to ensure data integrity across all layers
  • Integrate monitoring and observability tools (e.g., Databricks metrics, Grafana) to track ETL performance, latency, and failures
  • Implement Unity Catalog or equivalent tools for centralized metadata management, data lineage, and governance policy enforcement
Read More
Arrow Right

Staff Engineer I – Azure Databricks Engineer

Location
Location
United States , Irving
Salary
Salary:
Not provided
softwareresources.com Logo
Software Resources
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of related experience in data analytics administration and development
  • 2+ years of Databricks related experience
  • Bachelor's degree in related field required
  • Hands-on experience in Azure Databricks (Workspace management, Clusters, Jobs, Unity Catalog, Delta Lake, User access management, Rest APIs and SDKs)
  • Understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking
  • Experience with CI/CD pipelines (Azure DevOps preferred)
  • Strong programming skills in SQL, Python, and/or PySpark
  • Proven experience in leading cross-functional teams and managing multiple projects simultaneously
  • Intermediate to advanced ability to see the big picture and align projects with organizational goals
  • Capable of leading and motivating cross-functional teams
Job Responsibility
Job Responsibility
  • Delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data
  • Building, optimizing, streamlining and automating the Azure Databricks platform to enable analytical workloads like Machine learning (ML), Model Development, Data Insights, Data Science etc
  • Partner with ML engineers, data scientists, data analysts, and enterprise architects to enforce best practices, train and enable users using the Azure Databricks platform
  • Take assignments that can be worked on individually without supervision and manage work effort from concept to completion
  • Build, optimize and maintain the Azure Databricks platform, ensuring scalability, security, governance and performance
  • Implement and manage Azure Databricks workspaces, clusters, jobs, access management
  • Implement and manage policies, monitoring and observability for the Azure Databricks platform
  • Ensure compliance with IT policies, procedures, and industry standards, including reviewing and refining IT control enhancements
  • Work closely with business and analytics teams to ensure reliable and governed data access for data needed for analytics
  • Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services
What we offer
What we offer
  • Competitive salaries
  • An ownership stake in the company
  • Medical and dental insurance
  • Time off
  • A great 401k matching program
  • Tuition assistance program
  • An employee volunteer program
  • A wellness program
Read More
Arrow Right

Staff Engineer I – Azure Databricks Engineer

Software Resources has an immediate, direct hire job opportunity for a Staff Eng...
Location
Location
United States , Irving, Dallas
Salary
Salary:
Not provided
softwareresources.com Logo
Software Resources
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of related experience in data analytics administration and development
  • 2+ years of Databricks related experience
  • Bachelor’s degree in related field required
  • Hands-on experience in Azure Databricks (Workspace management, Clusters, Jobs, Unity Catalog, Delta Lake, User access management, Rest APIs and SDKs)
  • Understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking
  • Experience with CI/CD pipelines (Azure DevOps preferred)
  • Strong programming skills in SQL, Python, and/or PySpark
  • Proven experience in leading cross-functional teams and managing multiple projects simultaneously
  • Intermediate to advanced ability to see the big picture and align projects with organizational goals. Capable of leading and motivating cross-functional teams. Expertise in resolving conflicts and addressing challenges as well as skilled at identifying and mitigating risks at the project level
  • Good communication skills, excellent teamwork experience
Job Responsibility
Job Responsibility
  • Responsible for delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data
  • Work in a mid-level role with proficiency needed in building, optimizing, streamlining and automating the Azure Databricks platform to enable analytical workloads like Machine learning (ML), Model Development, Data Insights, Data Science etc
  • Partner with ML engineers, data scientists, data analysts, and enterprise architects to enforce best practices, train and enable users using the Azure Databricks platform
  • Take assignments that can be worked on individually without supervision and manage work effort from concept to completion
  • Build, optimize and maintain the Azure Databricks platform, ensuring scalability, security, governance and performance
  • Implement and manage Azure Databricks workspaces, clusters, jobs, access management
  • Implement and manage policies, monitoring and observability for the Azure Databricks platform
  • Ensure compliance with IT policies, procedures, and industry standards, including reviewing and refining IT control enhancements
  • Work closely with business and analytics teams to ensure reliable and governed data access for data needed for analytics
  • Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services
What we offer
What we offer
  • Competitive salaries
  • An ownership stake in the company
  • Medical and dental insurance
  • Time off
  • A great 401k matching program
  • Tuition assistance program
  • An employee volunteer program
  • A wellness program
  • Opportunity to bolster your business knowledge, learning the ins and outs of how successful companies operate and manage their finances, giving you invaluable hands-on experience to help grow your career
  • Fulltime
Read More
Arrow Right

Senior Data Engineer – Databricks & SaaS Integrations

We are seeking a Senior Data Engineer with strong Databricks and backend integra...
Location
Location
India , Pune
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong experience with Databricks, Apache Spark, and data pipelines
  • Backend development experience (Python, Java, or Scala)
  • Experience integrating data platforms with SaaS application backends
  • Strong knowledge of REST APIs and event-driven architectures
  • Experience working with AWS or Azure cloud platforms
  • Understanding of enterprise security (authN, authZ, RBAC)
  • Experience with spec-driven development and coding agents
Job Responsibility
Job Responsibility
  • Design and implement integrations between Databricks workflows and SaaS application backends
  • Enable batch and streaming data flows, event triggers, and API-based communication
  • Build backend services such as REST APIs, webhooks, and data interfaces
  • Implement data quality, validation, monitoring, and observability mechanisms
  • Design secure and auditable pipelines including authN, authZ, and RBAC
  • Troubleshoot pipeline failures, performance bottlenecks, and data inconsistencies
  • Collaborate with application, platform, and data engineering teams
  • Fulltime
Read More
Arrow Right