CrawlJobs Logo
Wissen Logo Wissen · IT - Software Development

Databricks Engineer- Azure Fabric

India, Bangalore South · Job Posted April 20, 2026
Apply Position
Job Link Share

Job Description

We are seeking a highly skilled Databricks Engineer – Azure Fabric with 6–8 years of experience in data engineering to design, build, and maintain scalable data platforms on Microsoft Fabric and Azure. The ideal candidate will have strong hands‑on experience with Python, SQL, Microsoft Fabric (OneLake, Lakehouse, Data Factory), and Delta Lake, along with the ownership mindset to deliver regulatory‑grade, enterprise data solutions. This role involves close collaboration with global engineering, data, compliance, and business teams and supports advanced analytics and AI‑enabled data products.

Job Responsibility

  • Design, build, and maintain scalable, distributed, and fault‑tolerant data pipelines on Microsoft Fabric
  • Develop lakehouse architectures using OneLake and Delta Lake, including incremental merge workflows and Change Data Feed
  • Build pipelines to ingest, normalize, transform, and publish large volumes of financial market data
  • Design and implement bitemporal data models (valid‑time and system‑time) for regulatory‑grade time‑series datasets
  • Participate in cross‑functional discussions with engineering, compliance, research, and business stakeholders globally
  • Build and maintain testing frameworks (unit, regression, UAT) for data pipelines and transformations
  • Own end‑to‑end delivery of solutions, including ingestion pipelines, QA processes, correction handling, and audit trails
  • Collaborate on shared platform services and reusable components instead of siloed implementations
  • Apply business understanding of financial reference data (equities and other asset classes)
  • Support AI enablement use cases such as AI‑assisted ingestion, anomaly detection, and semantic search over lakehouse data

Requirements

  • 6–8 years of experience in data engineering
  • Strong proficiency in Python for data pipelines, transformations, and automation
  • Advanced SQL skills including window functions, partitioning, and time‑series query patterns
  • Hands‑on experience with Microsoft Fabric: OneLake, Fabric Data Factory pipelines, Fabric Lakehouse, Fabric Warehouse (SQL endpoint)
  • Strong working knowledge of Delta Lake: Table creation and management, Incremental merges, Z‑ordering, Change Data Feed (CDF)
  • Experience using AI‑assisted development tools (e.g., GitHub Copilot, Cursor)
  • Proficient with Git for code versioning, branching strategies, and pull‑request workflows
  • Experience working with REST APIs for data ingestion and system integration
  • Familiarity with Azure services such as Azure Data Factory, Azure SQL, Azure Key Vault, and RBAC
  • Strong ownership, problem‑solving, and collaboration skills

Nice to have

  • Experience with pandas, PySpark, or similar data processing libraries
  • Knowledge of columnar storage and time‑series analytics (e.g., ClickHouse or equivalent)
  • Familiarity with Microsoft Purview for data lineage, cataloging, and data classification
  • Understanding of bitemporal modeling for financial and regulatory datasets
  • Knowledge of financial reference data: equities, identifiers, corporate actions, index data
  • Exposure to CI/CD pipelines and automated data platform deployments
Wissen - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Databricks Engineer- Azure Fabric

8 matching positions

Data Engineer with Azure Fabric

The Data Engineer will focus on developing scalable, high-performance data proce...
Location
Location
Romania , Cluj
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3–8 years in data engineering, data warehousing, or data architecture roles
  • At least 3+ years working with Fabric
  • BSc/MSc in Computer Science, Data Engineering, or related field
  • Proven experience in data engineering and pipeline development on Fabric, Azure and cloud-native platforms
  • Familiarity with Fabric Workflows and other orchestration tools
  • Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent
  • Strong SQL and Python (or equivalent language) skills for data manipulation and automation
  • Exposure to AI/ML workloads desirable
  • Proficiency in cloud ecosystems (Specifically Azure, optionally AWS and GCP are an advantage) and infrastructure-as-code (e.g., Terraform)
  • Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon)
Job Responsibility
Job Responsibility
  • Client Engagement & Delivery
  • Data Pipeline Development (Batch and Streaming)
  • Fabric and Azure Architectures
  • Data Modelling & Optimisation
  • Collaboration & Best Practices
  • Quality, Governance & Security
  • Client stakeholders up to Head of Data Engineering, Chief Data Architect, and Analytics leadership
  • Delivery of high-performing, scalable, and secure data pipelines aligned to client requirements
  • High client satisfaction and successful adoption of Fabric and Azure based solutions
  • Improve data engineering practices
What we offer
What we offer
  • Smooth integration and a supportive mentor
  • Pick your working style: choose from Remote, Hybrid or Office work opportunities
  • Projects have different working hours to suit your needs
  • Sponsored certifications, trainings and top e-learning platforms
  • Private Health Insurance
  • Individual coaching sessions or joining our accredited Coaching School
  • Epic parties or themed events
Read More
Arrow Right

Senior Azure Data Engineer with Fabric

Senior Azure Data Engineer with Microsoft Fabric Experience
Location
Location
United States , Newark
Salary
Salary:
130000.00 USD / Year
realign-llc.com Logo
Realign
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 10+ years experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, Microsoft Fabric etc.
  • Azure experience is preferred over other cloud platforms
  • Minimum 10 + years of proven experience with SQL, schema design and dimensional data modelling
  • Solid knowledge of data warehouse best practices, development standards and methodologies
  • Experience with ETL/ELT tools like ADF, Azure, MS Fabric etc., and data warehousing technologies like Azure Synapse, Azure SQL, ADLS etc.
  • Strong experience with big data tools(Microsoft Fabric, Databricks , Spark etc..) and programming skills in PySpark and Spark SQL
  • Be an independent self-learner with a let s get this done approach and ability to work in Fast paced and Dynamic environment
  • Knowledge in Microsoft Fabric Data Platform
  • Expertise in designing application solution on Azure Data Platform for complex business needs
  • Serves as key technical expert engaged on designing, architecting, deploying and maintaining cloud solutions, Data Management & Analytics
Job Responsibility
Job Responsibility
  • Build and maintain new and existing applications in preparation for a large-scale architectural migration within an Agile function
  • Align with the Product Owner and Scrum Master in assessing business needs and transforming them into scalable applications
  • Build and maintain code to manage data received from heterogenous data formats including web- based sources, internal/external databases, flat files, heterogenous data formats (binary, ASCII)
  • Help build new enterprise Datawarehouse and maintain the existing one
  • Design and support effective storage and retrieval of very large internal and external data set and be forward think about the convergence strategy with our Azure cloud migration
  • Assess the impact of scaling up and scaling out and ensure sustained data management and data delivery performance
  • Fulltime
Read More
Arrow Right

Cloud Operations Engineer (Azure)

The Cloud Operations Engineer (Azure) will manage software releases and cloud pl...
Location
Location
Thailand , Bangkok
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3–5 years of experience in Microsoft Azure cloud systems support
  • Hands-on experience with Azure DevOps tools and pipelines
  • Strong understanding of Azure environments (PaaS & IaaS), including: VMs, Storage, Event Hub, Service Fabric Cluster, AKS, IoT Hub, Cosmos DB, SQL Server, Databricks, Key Vault, Data Lake
  • Experience in CI/CD tools (Octopus, Bamboo, Terraform, Azure DevOps, Jenkins, GitHub, Ansible)
  • Familiarity with IoT concepts: telemetry ingestion, processing, data storage, reporting
  • Knowledge of container orchestration (Kubernetes)
  • Ability to script with PowerShell and Python
  • Understanding of SQL vs NoSQL databases and operational maintenance
  • Knowledge of monitoring/logging systems (Log Analytics, Splunk, ELK, Prometheus, Nagios, Zabbix)
  • Strong analytical thinking and proactive troubleshooting mindset
Job Responsibility
Job Responsibility
  • Manage software releases across QA → Load Test → Stage → Production environments
  • Execute and support OTA firmware releases
  • Launch and maintain mobile app releases to App Store and Google Play
  • Work with agile teams to build, test, and maintain CI/CD pipeline components
  • Support product NPI onboarding and participate in early sprint planning
  • Administer and troubleshoot Microsoft Azure environments
  • Perform L1.5–L2 support activities including monitoring, deployments, rollbacks, and platform health checks
  • Manage migrations across platforms or service providers
  • Ensure proactive performance monitoring and SLA compliance
  • Maintain system documentation, runbooks, and operational best practices
  • Fulltime
Read More
Arrow Right

Cloud Operations Engineer (Azure)

The Cloud Operations Engineer (Azure) is responsible for managing software relea...
Location
Location
Thailand , Bangkok
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3–5 years of experience in Microsoft Azure cloud systems support
  • Hands-on experience with Azure DevOps tools and pipelines
  • Strong understanding of Azure environments (PaaS & IaaS), including: VMs, Storage, Event Hub, Service Fabric Cluster, AKS, IoT Hub, Cosmos DB, SQL Server, Databricks, Key Vault, Data Lake
  • Experience in CI/CD tools (Octopus, Bamboo, Terraform, Azure DevOps, Jenkins, GitHub, Ansible)
  • Familiarity with IoT concepts: telemetry ingestion, processing, data storage, reporting
  • Knowledge of container orchestration (Kubernetes)
  • Ability to script with PowerShell and Python
  • Understanding of SQL vs NoSQL databases and operational maintenance
  • Knowledge of monitoring/logging systems (Log Analytics, Splunk, ELK, Prometheus, Nagios, Zabbix)
  • Strong analytical thinking and proactive troubleshooting mindset
Job Responsibility
Job Responsibility
  • Manage software releases across QA → Load Test → Stage → Production environments
  • Execute and support OTA firmware releases
  • Launch and maintain mobile app releases to App Store and Google Play
  • Work with agile teams to build, test, and maintain CI/CD pipeline components
  • Support product NPI onboarding and participate in early sprint planning
  • Administer and troubleshoot Microsoft Azure environments
  • Perform L1.5–L2 support activities including monitoring, deployments, rollbacks, and platform health checks
  • Manage migrations across platforms or service providers
  • Ensure proactive performance monitoring and SLA compliance
  • Maintain system documentation, runbooks, and operational best practices
  • Fulltime
Read More
Arrow Right

Cloud Operations Engineer (Azure)

The Cloud Operations Engineer (Azure) will manage software releases and cloud op...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3–5 years of experience in Microsoft Azure cloud systems support
  • Hands-on experience with Azure DevOps tools and pipelines
  • Strong understanding of Azure environments (PaaS & IaaS), including: VMs, Storage, Event Hub, Service Fabric Cluster, AKS, IoT Hub, Cosmos DB, SQL Server, Databricks, Key Vault, Data Lake
  • Experience in CI/CD tools (Octopus, Bamboo, Terraform, Azure DevOps, Jenkins, GitHub, Ansible)
  • Familiarity with IoT concepts: telemetry ingestion, processing, data storage, reporting
  • Knowledge of container orchestration (Kubernetes)
  • Ability to script with PowerShell and Python
  • Understanding of SQL vs NoSQL databases and operational maintenance
  • Knowledge of monitoring/logging systems (Log Analytics, Splunk, ELK, Prometheus, Nagios, Zabbix)
  • Strong analytical thinking and proactive troubleshooting mindset
Job Responsibility
Job Responsibility
  • Manage software releases across QA → Load Test → Stage → Production environments
  • Execute and support OTA firmware releases
  • Launch and maintain mobile app releases to App Store and Google Play
  • Work with agile teams to build, test, and maintain CI/CD pipeline components
  • Support product NPI onboarding and participate in early sprint planning
  • Administer and troubleshoot Microsoft Azure environments
  • Perform L1.5–L2 support activities including monitoring, deployments, rollbacks, and platform health checks
  • Manage migrations across platforms or service providers
  • Ensure proactive performance monitoring and SLA compliance
  • Maintain system documentation, runbooks, and operational best practices
Read More
Arrow Right

Technical Support Engineer - Azure Data Factory / Data Integration

Within CE&S, the Customer Service & Support (CSS) organization builds trust and ...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology (IT), or related field AND 1+ years of technical support, technical consulting experience, or information technology experience
  • OR 3+ years of technical support, technical consulting experience, or information technology experience
  • OR equivalent experience
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics / Microsoft Fabric Pipeline
  • Data Lake
  • Relational Database Management System (Microsoft SQL Server / Oracle Database / MySQL / IBM Db2 / SAP)
  • Big Data or Analytics Products (Spark / Azure HDInsight / Azure Data Lake Analytics / Azure Synapse Analytics / Databricks / Google BigQuery)
  • Pipeline and ETL/ELT Skills
  • Building and orchestrating pipelines (ADF / Synapse / Fabric)
Job Responsibility
Job Responsibility
  • Response and Resolution: You own, investigate and solve customer technical issues. You collaborate within and across teams, leveraging troubleshooting tools and practices
  • Readiness: You lead or participate in building communities with peer delivery roles and, where appropriate, share your knowledge
  • You develop specific technical and professional proficiency to enable you to resolve customer issues, through training and readiness
  • Product/Process Improvement: You identify potential product defects and escalate appropriately to resolve, contributing to Microsoft product improvements
  • Fulltime
Read More
Arrow Right
New

EDW ETL Developer - Azure Data Engineer

We are seeking a Senior Azure Data Engineer to help design, build, and operate o...
Location
Location
United States , Springfield
Salary
Salary:
50.00 - 53.00 USD / Hour
myticas.com Logo
Myticas Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep hands-on expertise with Azure Data Factory: pipelines, datasets, linked services, triggers, parameterization, mapping data flows, and all three Integration Runtime types (Azure, Selfhosted, SSIS)
  • Strong Experience in Data Bricks and PySpark
  • Production experience with one or more of: Azure Synapse Analytics (Dedicated and Serverless SQL Pools, Spark Pools) OR Azure Databricks (Delta Lake, Unity Catalog) OR Microsoft Fabric (Warehouse, Lakehouse, OneLake)
  • Strong working knowledge of Azure Data Lake Storage Gen2 (hierarchical namespace, RBAC + ACLs, lifecycle management, security)
  • Experience with Azure Key Vault, Azure AD / Entra ID (including managed identities and service principals), and private networking (VNet integration, private endpoints)
  • Monitoring and troubleshooting with Azure Monitor, Log Analytics, and KQL
  • Advanced SQL — window functions, CTEs, query optimization, execution plan analysis, performance tuning
  • Strong Python for data engineering — pandas, PySpark, REST API integration, unit testing (pytest)
  • Proficient in T-SQL
  • familiarity with Spark SQL, KQL, PowerShell, and Bash shell scripting
Job Responsibility
Job Responsibility
  • Design and build robust, reusable, parameter-driven ingestion and transformation pipelines using Azure Data Factory, Synapse Pipelines, Data Bricks and/or Microsoft Fabric Data Factory
  • Implement medallion architecture (Bronze / Silver / Gold) on Azure Data Lake Storage Gen2 using Delta Lake, Parquet, and structured streaming patterns
  • Build performant ELT workflows that leverage pushdown to source systems (Synapse Dedicated SQL Pool, Azure SQL, Teradata) where appropriate
  • Develop and optimize PySpark notebooks and jobs on Azure Databricks or Synapse Spark
  • Design dimensional models (Kimball star/snowflake) and data vault patterns for analytics consumption
  • Implement Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data patterns
  • Tune distributed SQL workloads in Synapse Dedicated SQL Pool / Fabric Warehouse, including distribution keys, partitioning, and clustered column store indexes
  • Implement CI/CD for data pipelines using Azure DevOps (YAML pipelines, ARM/Bicep/Terraform) across Dev / SIT / UAT / Prod environments
  • Instrument pipelines with robust logging, auditing, and monitoring using Azure Monitor, Log Analytics, and KQL
  • Define and enforce coding standards, code review practices, branching strategies, and release management
  • Fulltime
Read More
Arrow Right

Azure Data Engineer

We are seeking a highly skilled and experienced Azure Data Engineer to join our ...
Location
Location
India , Pune
Salary
Salary:
Not provided
vidushiinfotech.com Logo
Vidushi Infotech SSP Pvt. Ltd.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on experience as a Data Engineer, primarily focused on the Microsoft Azure data stack
  • Expert-level proficiency in Databricks (Spark SQL/PySpark), Python, and SQL
  • Strong, practical knowledge of core Azure data services, including Azure Data Lake Storage (Gen2) and Azure Synapse Analytics (or Azure SQL Data Warehouse)
  • Deep understanding and experience with modern ETL/ELT principles and tools (e.g., Azure Data Factory)
  • Solid understanding of the capabilities and architecture of Microsoft Fabric
  • Proven experience with code versioning (Git), unit testing frameworks, and principles of writing production-ready, clean, and well-documented code
  • Demonstrated ability to identify and implement performance and cost optimization techniques across data storage and processing layers
  • Excellent analytical and problem-solving skills with a track record of successfully refactoring complex or legacy data infrastructure
Job Responsibility
Job Responsibility
  • Design, development, and implementation of robust and scalable ETL/ELT processes using Azure services and Databricks
  • Act as a subject matter expert for Databricks, leveraging its capabilities for large-scale data processing, advanced analytics, and machine learning workloads
  • Write, optimize, and maintain high-quality code primarily in Python and SQL for data transformation, cleaning, and aggregation
  • Utilize a comprehensive suite of Azure services including Azure Data Lake Storage (Gen2), AzureSynapse Analytics, Azure Data Factory, and Azure Key Vault to build and manage end-to-end data solutions
  • Demonstrate and apply strong working knowledge of Microsoft Fabric to unify data, analytics, and AI workloads, contributing to the modernization of our data platform
  • Refactor legacy code for improved performance, readability, and maintainability
  • Implement optimization techniques to significantly improve the performance and reduce the cost of existing and new data solutions, especially within Databricks and Synapse
  • Apply best practices for code versioning using tools like Git (e.g., GitHub, Azure DevOps) within a structured CI/CD environment
  • Work closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical specifications
  • Fulltime
Read More
Arrow Right