Azure Databricks Developer Job at Realign (Toronto)

Ai focused databricks developer (digital engineering)

Location

Salary:

Not provided

Coherent Solutions

Expiration Date

Until further notice

Requirements

3+ years of experience as a Data Engineer
Strong experience with Databricks ecosystem (Architecture, Unity Catalog, Delta tables, lineage, permissions, Databricks Genie, notebooks)
Strong experience with Python
Solid proficiency in SQL
Experience working in Azure cloud environment
Experience with Databricks pipelines AI automation (Mosaic AI or AWS Agentcore)

Job Responsibility

Develop and maintain data pipelines within the Azure-based data platform
Work with the Databricks ecosystem (Delta Tables, Unity Catalog, notebooks) to process and manage data
Build and optimize data transformations using Python and SQL
Develop and support AI-driven data pipelines and automation using Databricks (Mosaic AI or similar tools)
Support and enhance existing production data systems
Collaborate with a team of engineers on Databricks-based solutions
Ensure data quality, consistency, and reliability across data pipelines

What we offer

Technical and non-technical training for professional and personal growth
Internal conferences and meetups to learn from industry experts
Support and mentorship from an experienced employee to help you professional grow and development
Health insurance
English courses
Sports activities to promote a healthy lifestyle
Flexible work options, including remote and hybrid opportunities
Referral program for bringing in new talent
Work anniversary program and additional vacation days

Fulltime

EDW ETL Developer - Azure Data Engineer

We are seeking a Senior Azure Data Engineer to help design, build, and operate o...

Location

United States , Springfield

Salary:

50.00 - 53.00 USD / Hour

Myticas Consulting

Expiration Date

Until further notice

Requirements

Deep hands-on expertise with Azure Data Factory: pipelines, datasets, linked services, triggers, parameterization, mapping data flows, and all three Integration Runtime types (Azure, Selfhosted, SSIS)
Strong Experience in Data Bricks and PySpark
Production experience with one or more of: Azure Synapse Analytics (Dedicated and Serverless SQL Pools, Spark Pools) OR Azure Databricks (Delta Lake, Unity Catalog) OR Microsoft Fabric (Warehouse, Lakehouse, OneLake)
Strong working knowledge of Azure Data Lake Storage Gen2 (hierarchical namespace, RBAC + ACLs, lifecycle management, security)
Experience with Azure Key Vault, Azure AD / Entra ID (including managed identities and service principals), and private networking (VNet integration, private endpoints)
Monitoring and troubleshooting with Azure Monitor, Log Analytics, and KQL
Advanced SQL — window functions, CTEs, query optimization, execution plan analysis, performance tuning
Strong Python for data engineering — pandas, PySpark, REST API integration, unit testing (pytest)
Proficient in T-SQL
familiarity with Spark SQL, KQL, PowerShell, and Bash shell scripting

Job Responsibility

Design and build robust, reusable, parameter-driven ingestion and transformation pipelines using Azure Data Factory, Synapse Pipelines, Data Bricks and/or Microsoft Fabric Data Factory
Implement medallion architecture (Bronze / Silver / Gold) on Azure Data Lake Storage Gen2 using Delta Lake, Parquet, and structured streaming patterns
Build performant ELT workflows that leverage pushdown to source systems (Synapse Dedicated SQL Pool, Azure SQL, Teradata) where appropriate
Develop and optimize PySpark notebooks and jobs on Azure Databricks or Synapse Spark
Design dimensional models (Kimball star/snowflake) and data vault patterns for analytics consumption
Implement Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data patterns
Tune distributed SQL workloads in Synapse Dedicated SQL Pool / Fabric Warehouse, including distribution keys, partitioning, and clustered column store indexes
Implement CI/CD for data pipelines using Azure DevOps (YAML pipelines, ARM/Bicep/Terraform) across Dev / SIT / UAT / Prod environments
Instrument pipelines with robust logging, auditing, and monitoring using Azure Monitor, Log Analytics, and KQL
Define and enforce coding standards, code review practices, branching strategies, and release management

Fulltime

Staff Engineer I – Azure Databricks Engineer

Location

United States , Irving

Salary:

Not provided

Software Resources

Expiration Date

Until further notice

Requirements

5+ years of related experience in data analytics administration and development
2+ years of Databricks related experience
Bachelor's degree in related field required
Hands-on experience in Azure Databricks (Workspace management, Clusters, Jobs, Unity Catalog, Delta Lake, User access management, Rest APIs and SDKs)
Understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking
Experience with CI/CD pipelines (Azure DevOps preferred)
Strong programming skills in SQL, Python, and/or PySpark
Proven experience in leading cross-functional teams and managing multiple projects simultaneously
Intermediate to advanced ability to see the big picture and align projects with organizational goals
Capable of leading and motivating cross-functional teams

Job Responsibility

Delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data
Building, optimizing, streamlining and automating the Azure Databricks platform to enable analytical workloads like Machine learning (ML), Model Development, Data Insights, Data Science etc
Partner with ML engineers, data scientists, data analysts, and enterprise architects to enforce best practices, train and enable users using the Azure Databricks platform
Take assignments that can be worked on individually without supervision and manage work effort from concept to completion
Build, optimize and maintain the Azure Databricks platform, ensuring scalability, security, governance and performance
Implement and manage Azure Databricks workspaces, clusters, jobs, access management
Implement and manage policies, monitoring and observability for the Azure Databricks platform
Ensure compliance with IT policies, procedures, and industry standards, including reviewing and refining IT control enhancements
Work closely with business and analytics teams to ensure reliable and governed data access for data needed for analytics
Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services

What we offer

Competitive salaries
An ownership stake in the company
Medical and dental insurance
Time off
A great 401k matching program
Tuition assistance program
An employee volunteer program
A wellness program

Databricks Developer (Digital Engineering)

The project focuses on a production system managing clients and life insurance p...

Location

Salary:

Not provided

Coherent Solutions

Expiration Date

Until further notice

Requirements

3+ years of experience as a Data Engineer
Strong experience with Databricks ecosystem (architecture, Unity Catalog, Delta tables, lineage, permissions)
Solid knowledge of SQL
Strong experience with Python
Experience working in Azure cloud environment
Good understanding of data pipelines and data platform architecture
Strong analytical and problem-solving skills
Excellent communication skills
English level: B2 (Upper-Intermediate) or higher

Job Responsibility

Support and new feature development
Building and optimizing data pipelines
Working within a modern Azure-based data platform

What we offer

Technical and non-technical training for professional and personal growth
Internal conferences and meetups to learn from industry experts
Support and mentorship from an experienced employee
Health insurance
English courses
Sports activities
Flexible work options
Referral program
Work anniversary program and additional vacation days

Data Engineer - Azure Databricks

The Data Engineer - Azure Databricks role involves building and maintaining scal...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Strong hands-on experience in Databricks
Python scripting for data engineering workloads
Good experience with Azure Data Factory
Solid understanding of Azure Cloud fundamentals
Experience in data pipeline development and ETL frameworks
Strong communication and stakeholder interaction skills
Experience working in Agile / Scrum teams
Total Experience: 7–10+ years
Relevant Data Engineering Experience: 5+ years
Databricks Experience: 3+ years

Job Responsibility

Develop and maintain data pipelines using Databricks and Python
Build and orchestrate ETL/ELT workflows using Azure Data Factory (ADF)
Work with Azure cloud data services to support data ingestion, transformation, and processing
Optimize and monitor Databricks jobs and data pipelines for performance and reliability
Collaborate with architects, analysts, and business stakeholders to implement scalable data solutions
Ensure best practices in data engineering, code quality, and documentation
Participate in code reviews, troubleshooting, and production support activities

Technical Lead – Azure Databricks with ETL (Informatica)

We are seeking an experienced Technical Lead specializing in Azure Databricks an...

Location

Canada , Toronto

Salary:

150000.00 USD / Year

Realign

Expiration Date

Until further notice

Requirements

Strong experience with Azure Databricks and big data processing
Expertise in ETL development using Informatica
Proficiency in SQL, Python, or Scala for data processing
Experience with data modeling, data warehousing, and analytics pipelines
Strong leadership, mentoring, and communication skills
Experience working in Agile development environments

Job Responsibility

Lead the design and implementation of ETL pipelines using Informatica
Develop and maintain data processing workflows in Azure Databricks
Collaborate with architects, data engineers, and business analysts to define technical solutions
Ensure data quality, performance, and scalability of ETL and data workflows
Mentor and guide team members on best practices in data engineering
Troubleshoot and resolve technical issues related to ETL and data processing
Document technical designs, processes, and procedures

Fulltime

Senior Data Developer (Azure)

We are looking for a highly skilled and experienced Senior Azure Data Developer ...

Location

Egypt , Cairo

Salary:

Not provided

Coca-Cola HBC

Expiration Date

Until further notice

Requirements

Bachelor's or Master’s degree in computer science, information technology, data science, or a related field (or an equivalent of 7+ years of practical experience in a tech-domain)
Hands-on experience with MS Power BI, MS PowerApps, MS Azure Data Factory, MS Azure Data Lake Store, SQL Database (T-SQL), DAX & Power Query M (3+ years)
Proven track record of implementing proof-of-concept (POC) backend solutions
Expert knowledge with cloud platforms (Azure, Google Cloud Storage, Amazon), preferably Microsoft Azure – with a focus on data warehousing & backend development
Strong programming skills in languages such as C#, .NET, Python, Scala or Java
Experience with big data architectures and large data volumes technologies (partitioned tables with billions of records, files with hundreds of GBs)
Familiarity with big data technologies such as Hadoop, Spark, and Hive as well as strong knowledge with data manipulation frameworks such a PySpark
Strong analytical & problem-solving abilities, as well as good communication skills
Strong willingness to learn and adapt to new technologies and tools
Good proficiency in English as a day-to-day business language is a must.

Job Responsibility

Assist in the design, development, and maintenance of ETL (Extract, Transform, Load) processes using Azure Data Factory
Implement data ingestion processes from various data sources into Azure data storage solutions
Work with Azure SQL Database, Azure Data Lake Storage, and Hive & Databricks to store and manage large datasets (Terabytes of data)
Ensure data integrity and availability by implementing appropriate storage solutions
Integrate data from various sources, ensuring accuracy, completeness, and consistency
Collaborate with data scientists and analysts to understand data requirements and provide necessary support
Contribute to the strategy, design and development of our Enterprise and Operational Reporting, providing insights and supporting decision making for end users
Integrate & transform data from various data systems into structures that are suitable for building analytical solutions
Design, develop and implement Azure-based solutions connecting certified and validated data sources to Power BI front-end visualizations and creating a single source of truth for reporting

What we offer

Development opportunities
Equal opportunity employer
IT Equipment
Learning programs
Work with iconic brands
Supportive team
Volunteering Opportunities
Wellbeing program

Data Engineer - Azure Databricks

The Data Engineer - Azure Databricks role involves building and maintaining scal...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Strong hands-on experience in Databricks
Python scripting for data engineering workloads
Good experience with Azure Data Factory
Solid understanding of Azure Cloud fundamentals
Experience in data pipeline development and ETL frameworks
Strong communication and stakeholder interaction skills
Experience working in Agile / Scrum teams
Total Experience: 7–10+ years
Relevant Data Engineering Experience: 5+ years
Databricks Experience: 3+ years

Job Responsibility

Develop and maintain data pipelines using Databricks and Python
Build and orchestrate ETL/ELT workflows using Azure Data Factory (ADF)
Work with Azure cloud data services to support data ingestion, transformation, and processing
Optimize and monitor Databricks jobs and data pipelines for performance and reliability
Collaborate with architects, analysts, and business stakeholders to implement scalable data solutions
Ensure best practices in data engineering, code quality, and documentation
Participate in code reviews, troubleshooting, and production support activities

Fulltime

Select Country

Azure Databricks Developer

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?