CrawlJobs Logo

Senior Azure Data Engineer

India, Bangalore South · Job Posted June 28, 2026
Apply Position
Job Link Share

Job Description

Wissen Technology is hiring for Senior Azure Data Engineer. About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset—ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia. Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge technology expertise, and a relentless focus on quality. We don’t just meet expectations—we exceed them by ensuring faster time-to-market, reduced rework, and greater alignment with client objectives. We have a proven track record of building mission-critical systems across industries, including financial services, healthcare, retail, manufacturing, and more. Wissen stands apart through its unique delivery models. Our outcome-based projects ensure predictable costs and timelines, while our agile pods provide clients with the flexibility to adapt to their evolving business needs. Wissen leverages its thought leadership and technology prowess to drive superior business outcomes. Our success is powered by top-tier talent. Our mission is clear: to be the partner of choice for building world-class custom products that deliver exceptional impact—the first time, every time. Job Summary: We are seeking a highly skilled Senior Azure Data Engineer to design, develop, and optimize enterprise-scale data platforms on Microsoft Azure. The ideal candidate should have strong hands-on experience in Azure Data Engineering, Databricks, PySpark, and modern lakehouse architectures.

Job Responsibility

  • Design and develop scalable data pipelines using Azure Data Factory, Azure Databricks, and PySpark
  • Build and maintain lakehouse architecture using Azure Data Lake Storage Gen2 and Delta Lake
  • Develop ETL/ELT frameworks for large-scale data processing
  • Optimize Spark workloads for performance, reliability, and cost efficiency
  • Implement data quality, governance, security, and monitoring best practices
  • Collaborate with business stakeholders, analysts, and engineering teams to deliver data solutions
  • Drive CI/CD implementation and automation for data engineering workflows
  • Troubleshoot production issues and ensure platform stability

Requirements

  • Strong experience with Azure Databricks
  • Hands-on expertise in PySpark
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS Gen2)
  • Delta Lake
  • Azure Synapse Analytics
  • Advanced SQL and Python
  • Data Modelling and Lakehouse Architecture
  • CI/CD and Git-based development
  • Must Have Skills: Azure Databricks
  • PySpark
  • Azure Data Factory
  • ADLS Gen2
  • SQL
  • Python
  • Data Engineering Architecture
  • ETL/ELT Development
  • Soft Skills: Strong communication skills
  • Ownership mindset
  • Problem-solving ability
  • Stakeholder management
  • Collaborative team player

Nice to have

  • Microsoft Fabric
  • Azure Event Hub
  • Kafka
  • Azure ML
  • Terraform
  • Power BI
  • Databricks Workflows

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Azure Data Engineer

8 matching positions

Senior Azure Data Engineer

Senior Data Engineer Role: Senior Data Engineer ‿ Migration Execution Locati...
Location
Location
India , Pune
Salary
Salary:
Not provided
techmahindra.com Logo
Tech Mahindra
Expiration Date
July 31, 2026
Flip Icon
Requirements
Requirements
  • Strong proficiency in SQL, Python, PySpark, Apache Spark
  • Hands on experience with Databricks (Delta, DLT, Autoloader, Unity Catalog) and/or Snowflake (Snowpark, Snowpipe, Streams, Tasks)
  • Experience with AWS services ‿ S3, Redshift, Athena, Glue, EMR, Lambda
  • Hands on with Apache Airflow DAG development
  • Experience with GitLab for version control and CI/CD
  • Strong SQL performance tuning and optimization skills
  • Experience with data quality validation and reconciliation
  • A Bachelor’s or Higher Degree is the minimum entry required for the position
Job Responsibility
Job Responsibility
  • Execute automated Lift & Shift migrations ‿ schema mapping, Iceberg table creation, pipeline generation for Bronze/Silver tables
  • Develop and refactor ETL/ELT pipelines ‿ decompose monolithic PSQL/Glue jobs into modular PySpark/Snowpark patterns
  • Review, validate, and refine AI assisted code conversions (PySpark/Snowpark)
  • label AI generated lines in code comments per EchoStar Addendum
  • Configure and execute dual run validation scripts ‿ row count, hash based integrity, business rule comparisons
  • Rationalize schemas, naming conventions, and lineage for AI Factory consumption patterns and Unity Catalog / Horizon Catalog governance
  • Develop and deploy Airflow DAGs replacing Control M orchestration
  • Produce before/after metrics (complexity, runtime, cost) for Technical Debt Remediation Log
  • Create operations runbooks, SOPs, and procedural guides for each migrated workload
  • Support EchoStar FTE shadowing and reverse shadowing during KT phases
  • Fulltime
Read More
Arrow Right

Senior Azure Data Engineer

We are looking for a highly skilled and experienced Senior Azure Data Engineer w...
Location
Location
Egypt , Cairo
Salary
Salary:
Not provided
coca-colahellenic.com Logo
Coca-Cola HBC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Information Technology, Computer Science, or related field
  • 5+ years of experience in data engineering with a strong focus on Azure (Azure Data Factory, Azure Data Lake Storage, Fabric)
  • Proven experience designing and building production-grade data pipelines that handle large volumes of data reliably
  • Strong SQL skills and experience with data modelling, schema design, and query optimization
  • Hands-on experience with Databricks (PySpark / Spark SQL) for large-scale data transformation
  • Proficiency in at least one programming language: Python (preferred), Scala, or C#/.NET
  • Solid understanding of data warehouse and lakehouse concepts
  • Strong ability to work independently, manage your own priorities, and deliver under ambiguity
  • Excellent communication skills - able to translate technical concepts for business stakeholders and vice versa
  • Excellent problem-solving and debugging skills
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ELT/ETL pipelines using Azure Data Factory, ensuring reliability and performance at terabyte scale
  • Own end-to-end pipeline health: monitoring, alerting, incident response, and continuous improvement
  • Identify and resolve bottlenecks across ingestion, transformation, and serving layers
  • drive measurable performance gains
  • Contribute to the design and evolution of our medallion architecture and golden layer strategy
  • Implement data ingestion processes from multiple heterogeneous sources, ensuring accuracy, completeness, and consistency
  • Support the migration from SAP BW, ensuring data continuity and quality throughout
  • Ensure data integrity and availability through appropriate storage solutions, partitioning strategies, and access controls
  • Work autonomously to deliver complex data engineering tasks with minimal supervision, while proactively communicating progress and blockers
  • Collaborate closely with data scientists, BI analysts, and business stakeholders to understand requirements and translate them into technical solutions
  • Fulltime
Read More
Arrow Right

Senior Azure Data Engineer

Parexel is looking for changemakers who are driven by curiosity, passion, and op...
Location
Location
Canada , Remote
Salary
Salary:
Not provided
parexel.com Logo
Parexel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 7 years of experience in software development
  • Minimum of 2 years of experience in cloud computing
  • Proficiency with Cloud Platform, Azure, DataBricks, Azure Data Factory, Azure Dev Ops, and SQL
  • Python and Power BI are preferred
  • Bachelor of Science in Computer Science, Engineering, or related technical field is required
  • Solid knowledge of SDLC and medallion architecture
  • Excellent problem-solving and analytical skills
  • Impeccable communication skills
Job Responsibility
Job Responsibility
  • Using Microsoft Azure data PaaS services, design, build, modify, and support data pipelines leveraging DataBricks and PowerBI in a medallion architecture setting
  • Create prototypes to validate proposed ideas and solicit input from stakeholders
  • Collaborate with Team Leads to define/clarify business requirements, estimate development costs, and finalize work plans
  • Run unit and integration tests on all created code – Create and run unit and integration tests throughout the development lifecycle
What we offer
What we offer
  • Health, Vision & Dental Insurance
  • Tuition Reimbursement
  • Vacation/Holiday/Sick Time
  • Flexible Spending & Health Savings Accounts
  • Work/Life Balance
  • 401(k) with Company match
  • Pet Insurance
  • Opportunity to work on innovative projects at the forefront of the industry
  • Collaborative and inclusive work environment that values your expertise
  • Professional advancement and development opportunities
  • Fulltime
Read More
Arrow Right

Senior Azure Data Engineer

Seeking a Lead AI DevOps Engineer to oversee design and delivery of advanced AI/...
Location
Location
Poland
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least 6 years of professional experience in the Data & Analytics area
  • 1+ years of experience (or acting as) in the Senior Consultant or above role with a strong focus on data solutions build in Azure and Databricks/Synapse/(MS Fabric is nice to have)
  • Proven experience in Azure cloud-based infrastructure, Databricks and one of SQL implementation (e.g., Oracle, T-SQL, MySQL, etc.)
  • Proficiency in programming languages such as SQL, Python, PySpark is essential (R or Scala nice to have)
  • Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders
  • Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps)
  • Experience in leading and managing a team of data engineers, providing guidance, mentorship, and technical support
  • Knowledge of data management principles and best practices, including data governance, data quality, and data integration
  • Good project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results within designated deadlines
  • Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues
Job Responsibility
Job Responsibility
  • Act as a senior member of the Data Science & AI Competency Center, AI Engineering team, guiding delivery and coordinating workstreams
  • Develop and execute a cloud data strategy aligned with organizational goals
  • Lead data integration efforts, including ETL processes, to ensure seamless data flow
  • Implement security measures and compliance standards in cloud environments
  • Continuously monitor and optimize data solutions for cost-efficiency
  • Establish and enforce data governance and quality standards
  • Leverage Azure services, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions
  • Work with cross-functional teams to understand requirements and provide data solutions
  • Maintain comprehensive documentation for data architecture and solutions
  • Mentor junior team members in cloud data architecture best practices
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Workation
  • Great Place to Work® certified employer
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
Read More
Arrow Right

Senior Azure Data Engineer

The Department of Customer Service is seeking a highly motivated Senior Data Eng...
Location
Location
Australia , Sydney
Salary
Salary:
Not provided
darumatic.com Logo
Darumatic
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum Bachelor’s degree in Computer Science, Software Engineering, or Information Systems
  • 5+ years of professional experience as a Data Engineer
  • Hands-on experience building scalable data pipelines and ELT/ETL workflows specifically using Microsoft Fabric to optimise datasets for PowerBI
  • Strong proficiency in SQL and at least one other programming language commonly used for data engineering (e.g., Python, Java, Scala)
  • Proven background in documentation, security, and compliance, specifically with experience in Microsoft Purview and Azure Key Vault
  • Advanced skills in Excel, including Power Query, VBA automation, and connectors
  • A creative problem solver who can think critically to resolve complex data challenges
  • Ability to stay updated with industry trends and integrate new best practices
  • Strong ability to collaborate with non-technical stakeholders and technical teams alike
Job Responsibility
Job Responsibility
  • Drive the end-to-end data engineering strategy using Microsoft technologies
  • Build, maintain, and scale data pipelines and platforms to ensure efficient data flow
  • Design and execute ELT/ETL workflows to transform raw data from disparate systems into structured, high-quality datasets optimised for PowerBI, reporting, and machine learning
  • Work cross-functionally with Data Analysts and Business Analysts to understand database requirements, partitioning strategies, and business logic
  • Implement strong data governance and compliance measures
  • Stay abreast of industry trends and best practices to drive continuous improvement initiatives within the data engineering function
  • Utilise Excel, Power Query, and VBA to handle automation tasks and connectors where required
Read More
Arrow Right

Senior Azure Data Engineer

We are seeking an experienced Azure Data Engineer with Databricks expertise to j...
Location
Location
Poland , Warszawa
Salary
Salary:
150.00 - 180.00 PLN / Hour
cyclad.pl Logo
Cyclad Sp. z o.o.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3+years' hands-on experience with Azure Data Factory and Databricks (modern features, including Unity Catalog and 2025 capabilities)
  • At least 5+ years' experience in data engineering or backend/full-stack software development
  • Solid software engineering background: writing unit tests in Python, proficient with Git, and CI/CD pipelines
  • Strong SQL skills and experience structuring and modelling data in both relational and non-relational formats
  • Experience with data transformation tools, Spark, and real-time analytics solutions on Azure
  • Strong verbal and written communication skills in English
Job Responsibility
Job Responsibility
  • Design, build, and deploy scalable data pipelines using Azure Databricks and the Azure Analytics stack
  • Curate structured, semi-structured, and unstructured data by creating efficient, cost-effective, and scalable pipelines
  • Create and maintain robust data pipeline architecture ensuring data quality, reliability, and scalability
  • Assemble and manage large, complex datasets to meet functional and non-functional business requirements
  • Identify, design, and implement process improvements, including automation and optimization of data delivery
  • Work with real-time and streaming analytics solutions where applicable
  • Collaborate closely with Product Owners, Scrum Masters, architects, and data leadership to ensure timely, high-quality delivery
  • Align with Data Engineering chapter standards, processes, and best practices
  • Apply solid software engineering practices, including unit testing, CI/CD, and version control
  • Troubleshoot complex data-related issues and perform root cause analysis
What we offer
What we offer
  • Private medical care with dental care (covering 70% of costs) + rehabilitation package.
  • family package option possible
  • Multisport card (also for an accompanying person)
  • Life insurance
  • Flexibility and international environment
  • Fulltime
Read More
Arrow Right

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Senior Data Engineer (Azure)

Location
Location
India , Bangalore
Salary
Salary:
Not provided
mercedes-benz.com Logo
Mercedes-Benz AG
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6 to 9 years of professional experience in data engineering or related roles
  • Proven hands-on experience with Azure Databricks and cloud-based data pipeline development
  • Strong knowledge of ETL/ELT tools and processes, preferably within Azure ecosystems
  • Expertise in data modeling (star/snowflake schema, normalization, dimensional modeling)
  • Advanced programming skills in PySpark, Python, and SQL
  • Experience working with Azure SQL Data Warehouse, Azure Synapse, and Azure Data Factory
  • Understanding of data governance, data quality, and security best practices
  • Familiarity with Power BI for report and dashboard development (preferred)
  • Excellent analytical, problem-solving, and communication skills
  • Ability to work independently and in cross-functional teams in agile environments
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust, scalable, and efficient data pipelines and ETL processes on Azure cloud platform
  • Build and optimize data workflows using Azure Data Factory, Databricks, Azure Synapse Analytics, and related tools
  • Implement data ingestion from multiple sources (databases, APIs, event streams) ensuring data quality and integrity
  • Collaborate with cross-functional teams to understand data requirements and deliver timely solutions
  • Develop and maintain data models and data warehouse solutions optimized for performance and scalability
  • Monitor and troubleshoot data pipeline failures, ensuring high availability and reliability
  • Ensure data security, compliance, and governance in line with organizational policies
What we offer
What we offer
  • Mitarbeiterrabatte möglich
  • Gesundheitsmaßnahmen
  • Mitarbeiterhandy möglich
  • Essenszulagen
  • Betriebliche Altersversorgung
  • Hybrides Arbeiten möglich
  • Mobilitätsangebote
  • Mitarbeiter Events
  • Coaching
  • Flexible Arbeitszeit möglich
  • Fulltime
Read More
Arrow Right