CrawlJobs Logo

Senior Software Engineering - Azure Databricks

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
Australia , Multiple Locations

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

Do you love working with data, AI, and large distributed systems? Do you enjoy solving complex technical challenges and delighting customers while pushing the boundaries of cutting-edge technology at immense scale? Azure Databricks is a Azure service jointly developed and operated by Databricks and Microsoft. It offers the same core Databricks platform but with deep integration into Azure’s ecosystem with a mission to simplify and democratize data and artificial intelligence. From foundational analytics to the bleeding edge of generative AI, our platform is trusted by customers to unlock the value of their data—securely, reliably, and at scale. We're not just building software—we're shaping the future of intelligent systems. We are looking for a senior software engineer to join our Azure Databricks team with a specialized focus on building scalable services, developing high-quality features, and delivering a world-class experience to customers. This is a unique opportunity to work at the intersection of distributed systems, cloud platforms, and customer impact. You won’t be just writing features—you’ll be designing and optimizing services at scale, crafting solutions that anticipate customer needs, and directly collaborating with Databricks to understand their scenarios and create lasting value.

Job Responsibility:

  • Designing and building distributed systems that interact between different cloud technology services and infrastructures
  • Conducting research and maintain an awareness of industry knowledge and identifies ways the information can be applied
  • Mentoring other teammates and cross teams, providing technical direction for the engineering organization
  • Writing high quality documentations including design documents, troubleshooting guides and software specs
  • Participating in onboarding, code/design reviews, and regular meetings with the engineering teams that develop and manage those products
  • Designs, develops, and maintains telemetry pipelines and monitoring tools that detail operations metrics
  • Conduct deployment of the software products through Azure DevOps and CI/CD (continuous integration/continuous delivery) process
  • Responds to incidents during regular on-call rotations. Improves and optimizes supportability of the product through innovative ideas
  • Monitor performance and reliability of services and troubleshoot problem areas as needed

Requirements:

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C#, Java, and JavaScript
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Nice to have:

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C#, Java, and JavaScript
  • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C#, Java, and JavaScript
  • OR equivalent experience
  • 5+ years of Azure development experience

Additional Information:

Job Posted:
March 03, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Software Engineering - Azure Databricks

Senior Software Engineer

We are looking for a highly skilled Senior Software Engineer to join our team on...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
bentley.com Logo
Bentley Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert-level proficiency in C# and .NET Framework/Core, including advanced software design patterns
  • Proven experience building high-performance back-end systems and API-driven architectures
  • Strong hands-on experience with Azure Cloud Services and cloud-native development
  • Practical knowledge of big data ecosystems, including data lakes and distributed data processing
  • Proficiency in Databricks, SQL, and Entity Framework
  • Solid understanding of async/await, Task-based programming, and concurrency patterns
  • Familiarity with Git and modern version control practices
  • Excellent problem-solving skills and ability to work in a fast-paced, agile environment
Job Responsibility
Job Responsibility
  • Architect and develop robust back-end services using C# and .NET, ensuring high performance and scalability
  • Design and optimize big data pipelines and ETL/ELT workflows leveraging Databricks and Azure Data Lake
  • Build and maintain RESTful APIs, integrating seamlessly with internal and external systems
  • Collaborate with DevOps to enhance CI/CD pipelines and deployment automation
  • Deploy and manage containerized applications using Kubernetes (k8s) for scalable cloud environments
  • Ensure code quality and maintainability through Git workflows, code reviews, and automated testing
  • Actively participate in Agile ceremonies, contributing to sprint planning, retrospectives, and daily stand-ups
What we offer
What we offer
  • A great team and culture
  • An exciting career as part of a world-leading software company providing solutions for architecture, engineering, and construction
  • An attractive salary and benefits package designed to reward your expertise
  • A commitment to inclusion, belonging, and well-being through global initiatives and resource groups
  • A mission-driven company dedicated to advancing the world’s infrastructure for a better quality of life
Read More
Arrow Right

Senior Software Engineer

We are looking for a highly skilled Senior Software Engineer to join our team on...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
bentley.com Logo
Bentley Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert-level proficiency in C# and .NET Framework/Core, including advanced software design patterns
  • Proven experience building high-performance back-end systems and API-driven architectures
  • Strong hands-on experience with Azure Cloud Services and cloud-native development
  • Practical knowledge of big data ecosystems, including data lakes and distributed data processing
  • Proficiency in Databricks, SQL, and Entity Framework
  • Solid understanding of async/await, Task-based programming, and concurrency patterns
  • Familiarity with Git and modern version control practices
  • Excellent problem-solving skills and ability to work in a fast-paced, agile environment
Job Responsibility
Job Responsibility
  • Architect and develop robust back-end services using C# and .NET, ensuring high performance and scalability
  • Design and optimize big data pipelines and ETL/ELT workflows leveraging Databricks and Azure Data Lake
  • Build and maintain RESTful APIs, integrating seamlessly with internal and external systems
  • Collaborate with DevOps to enhance CI/CD pipelines and deployment automation
  • Deploy and manage containerized applications using Kubernetes (k8s) for scalable cloud environments
  • Ensure code quality and maintainability through Git workflows, code reviews, and automated testing
  • Actively participate in Agile ceremonies, contributing to sprint planning, retrospectives, and daily stand-ups
What we offer
What we offer
  • A great team and culture
  • An exciting career as part of a world-leading software company providing solutions for architecture, engineering, and construction
  • An attractive salary and benefits package designed to reward your expertise
  • A commitment to inclusion, belonging, and well-being through global initiatives and resource groups
  • A mission-driven company dedicated to advancing the world’s infrastructure for a better quality of life
Read More
Arrow Right

Senior Data Engineer

At Ingka Investments (Part of Ingka Group – the largest owner and operator of IK...
Location
Location
Netherlands , Leiden
Salary
Salary:
Not provided
https://www.ikea.com Logo
IKEA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Formal qualifications (BSc, MSc, PhD) in computer science, software engineering, informatics or equivalent
  • Minimum 3 years of professional experience as a (Junior) Data Engineer
  • Strong knowledge in designing efficient, robust and automated data pipelines, ETL workflows, data warehousing and Big Data processing
  • Hands-on experience with Azure data services like Azure Databricks, Unity Catalog, Azure Data Lake Storage, Azure Data Factory, DBT and Power BI
  • Hands-on experience with data modeling for BI & ML for performance and efficiency
  • The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration
  • Experience in driving new data engineering developments (e.g. apply new cutting edge data engineering methods to improve performance of data integration, use new tools to improve data quality and etc.)
  • Knowledge of DevOps practices and tools including CI/CD pipelines and version control systems (e.g., Git)
  • Proficiency in programming languages such as Python, SQL, PySpark and others relevant to data engineering
  • Hands-on experience to deploy code artifacts into production
Job Responsibility
Job Responsibility
  • Contribute to the development of D&A platform and analytical tools, ensuring easy and standardized access and sharing of data
  • Subject matter expert for Azure Databrick, Azure Data factory and ADLS
  • Help design, build and maintain data pipelines (accelerators)
  • Document and make the relevant know-how & standard available
  • Ensure pipelines and consistency with relevant digital frameworks, principles, guidelines and standards
  • Support in understand needs of Data Product Teams and other stakeholders
  • Explore ways create better visibility on data quality and Data assets on the D&A platform
  • Identify opportunities for data assets and D&A platform toolchain
  • Work closely together with partners, peers and other relevant roles like data engineers, analysts or architects across IKEA as well as in your team
What we offer
What we offer
  • Opportunity to develop on a cutting-edge Data & Analytics platform
  • Opportunities to have a global impact on your work
  • A team of great colleagues to learn together with
  • An environment focused on driving business and personal growth together, with focus on continuous learning
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

The Data Engineer is responsible for designing, building, and maintaining robust...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
ibvogt.com Logo
ib vogt GmbH
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in Computer Science, Data Engineering, or related field
  • 5+ years of experience in data engineering or similar roles
  • experience in renewable energy, engineering, or asset-heavy industries is a plus
  • Strong experience with modern data stack (e.g., PowerPlatform, Azure Data Factory, Databricks, Airflow, dbt, Synapse, Snowflake, BigQuery, etc.)
  • Proficiency in Python and SQL for data transformation and automation
  • Experience with APIs, message queues (Kafka, Event Hub), data streaming and knowledge of data lakehouse and data warehouse architectures
  • Familiarity with CI/CD pipelines, DevOps practices, and containerization (Docker, Kubernetes)
  • Understanding of cloud environments (preferably Microsoft Azure, PowerPlatform)
  • Strong analytical mindset and problem-solving attitude paired with a structured, detail-oriented, and documentation-driven work style
  • Team-oriented approach and excellent communication skills in English
Job Responsibility
Job Responsibility
  • Design, implement, and maintain efficient ETL/ELT data pipelines connecting internal systems (M365, Sharepoint, ERP, CRM, SCADA, O&M, etc.) and external data sources
  • Integrate structured and unstructured data from multiple sources into the central data lake / warehouse / Dataverse
  • Build data models and transformation workflows to support analytics, reporting, and AI/ML use cases
  • Implement data quality checks, validation rules, and metadata management according to the company’s data governance framework
  • Automate workflows, optimize performance, and ensure scalability of data pipelines and processing infrastructure
  • Work closely with Data Scientists, Software Engineers, and Domain Experts to deliver reliable datasets for Digital Twin and AI applications
  • Maintain clear documentation of data flows, schemas, and operational processes
What we offer
What we offer
  • Competitive remuneration and motivating benefits
  • Opportunity to shape the data foundation of ib vogt’s digital transformation journey
  • Work on cutting-edge data platforms supporting real-world renewable energy assets
  • A truly international working environment with colleagues from all over the world
  • An open-minded, collaborative, dynamic, and highly motivated team
  • Fulltime
Read More
Arrow Right

Senior Azure Data Engineer with Databricks

Location
Location
Poland
Salary
Salary:
Not provided
dcg.pl Logo
DCG Sp. z o. o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years’ experience with Azure Data Factory and Databricks
  • 5+ years’ experience with data engineering or backend/fullstack software development
  • Strong SQL skills
  • Python scripting proficiency
  • Experience with data transformation tools - Databricks and Spark
  • Experience in structuring and modelling data in both relational and non-relational forms
  • Experience with CI/CD tooling
  • Working knowledge of Git
  • English level: B2, C1
Job Responsibility
Job Responsibility
  • Being responsible for at-scale infrastructure design, build and deployment with a focus on distributed systems
  • Building and maintaining architecture patterns for data processing, workflow definitions, and system to system integrations using Big Data and Cloud technologies
  • Evaluating and translating technical design to workable technical solutions/code and technical specifications at par with industry standards
  • Driving creation of re-usable artifacts
  • Establishing scalable, efficient, automated processes for data analysis, data model development, validation, and implementation
  • Working closely with analysts/data scientists to understand impact to the downstream data models
  • Writing efficient and well-organized software to ship products in an iterative, continual release environment
  • Contributing and promoting good software engineering practices across the team
  • Communicating clearly and effectively to technical and non-technical audiences
  • Defining data retention policies
What we offer
What we offer
  • Private medical care
  • Co-financing for the sports card
  • Constant support of dedicated consultant
  • Employee referral program
Read More
Arrow Right

Senior Azure Data Engineer

We are seeking an experienced Azure Data Engineer with Databricks expertise to j...
Location
Location
Poland , Warszawa
Salary
Salary:
150.00 - 180.00 PLN / Hour
cyclad.pl Logo
Cyclad Sp. z o.o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3+years' hands-on experience with Azure Data Factory and Databricks (modern features, including Unity Catalog and 2025 capabilities)
  • At least 5+ years' experience in data engineering or backend/full-stack software development
  • Solid software engineering background: writing unit tests in Python, proficient with Git, and CI/CD pipelines
  • Strong SQL skills and experience structuring and modelling data in both relational and non-relational formats
  • Experience with data transformation tools, Spark, and real-time analytics solutions on Azure
  • Strong verbal and written communication skills in English
Job Responsibility
Job Responsibility
  • Design, build, and deploy scalable data pipelines using Azure Databricks and the Azure Analytics stack
  • Curate structured, semi-structured, and unstructured data by creating efficient, cost-effective, and scalable pipelines
  • Create and maintain robust data pipeline architecture ensuring data quality, reliability, and scalability
  • Assemble and manage large, complex datasets to meet functional and non-functional business requirements
  • Identify, design, and implement process improvements, including automation and optimization of data delivery
  • Work with real-time and streaming analytics solutions where applicable
  • Collaborate closely with Product Owners, Scrum Masters, architects, and data leadership to ensure timely, high-quality delivery
  • Align with Data Engineering chapter standards, processes, and best practices
  • Apply solid software engineering practices, including unit testing, CI/CD, and version control
  • Troubleshoot complex data-related issues and perform root cause analysis
What we offer
What we offer
  • Private medical care with dental care (covering 70% of costs) + rehabilitation package.
  • family package option possible
  • Multisport card (also for an accompanying person)
  • Life insurance
  • Flexibility and international environment
  • Fulltime
Read More
Arrow Right

Traineeship Data Engineering

This is a traineeship program in data engineering offered by Sopra Steria in Bru...
Location
Location
Belgium , Brussels
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You like to solve complex (data) problems and theorems and are solution and result oriented
  • Fascinated by new trends and best practices, you make a point of working carefully and independently
  • You have recently graduated or are about to graduate with a bachelor's or master's degree in a data-related field
  • You are eager to learn and excited to expand your knowledge across various data domains
  • You have strong communication skills and enjoy working in a consultancy environment
  • You are analytical, critical, and enjoy collaborating with others to find solutions
  • You have an interest in data cloud platforms
  • You are enthusiastic about technologies like Azure, SQL, Python, and AWS
  • You are fluent in Dutch and English
  • knowledge of French is a plus
Job Responsibility
Job Responsibility
  • You will become Cloud Certified (Azure (Fabric), AWS, Databricks, Google,…)
  • You will become proficient in querying databases through SQL
  • You will start building, implementing and maintaining scalable data pipelines
  • You will learn how to program in Python, aligned with best practices
  • Data modelling will have no more secrets for you anymore
  • You will learn software development and participate in an Agile environment, using the Scrum principles
  • You will be learning how to gather requirements from various stakeholders
  • In time, you will become an experienced designer of data solutions
  • You will follow a dedicated training program designed and given by our own colleagues
  • Throughout and after the program, you can rely on the support of our senior colleagues
What we offer
What we offer
  • Access to our Sopra Steria training and personal development academy
  • A company car lease or mobility budget
  • A company laptop and smartphone
  • Monthly office drinks
  • Insurance coverage
  • Meal vouchers
  • A competitive salary with an indefinite contract
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in...
Location
Location
United Kingdom , Any UK Office Hub (Bristol / London / Manchester / Swansea)
Salary
Salary:
80000.00 - 96000.00 GBP / Year
madetech.com Logo
Made Tech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
  • Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines
  • You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines
  • Able to document and present end-to-end diagrams to explain a data processing system on a cloud environment
  • Some knowledge of how you would present diagrams (C4, UML, etc.)
  • Enthusiasm for learning and self-development
  • You have experience of working on agile delivery-lead projects and can apply agile practices such as Scrum, XP, Kanban
Job Responsibility
Job Responsibility
  • Define, shape and perfect data strategies in central and local government
  • Help public sector teams understand the value of their data, and make the most of it
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP
  • Contribute to our recruitment efforts and take on line management responsibilities
  • Help implement efficient data pipelines & storage
What we offer
What we offer
  • 30 days of paid annual leave
  • Flexible parental leave options
  • Part time remote working for all our staff
  • Paid counselling as well as financial and legal advice
  • 7% employer matched pension
  • Flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan
  • Optional social and wellbeing calendar of events
  • Fulltime
Read More
Arrow Right