Senior Azure Data Engineer Job at Tech Mahindra (Pune)

New

Senior Azure Data Engineer

Wissen Technology is hiring for Senior Azure Data Engineer. About Wissen Technol...

Location

India , Bangalore South

Salary:

Not provided

Wissen

Expiration Date

Until further notice

Requirements

Strong experience with Azure Databricks
Hands-on expertise in PySpark
Azure Data Factory (ADF)
Azure Data Lake Storage (ADLS Gen2)
Delta Lake
Azure Synapse Analytics
Advanced SQL and Python
Data Modelling and Lakehouse Architecture
CI/CD and Git-based development
Must Have Skills: Azure Databricks

Job Responsibility

Design and develop scalable data pipelines using Azure Data Factory, Azure Databricks, and PySpark
Build and maintain lakehouse architecture using Azure Data Lake Storage Gen2 and Delta Lake
Develop ETL/ELT frameworks for large-scale data processing
Optimize Spark workloads for performance, reliability, and cost efficiency
Implement data quality, governance, security, and monitoring best practices
Collaborate with business stakeholders, analysts, and engineering teams to deliver data solutions
Drive CI/CD implementation and automation for data engineering workflows
Troubleshoot production issues and ensure platform stability

Fulltime

Senior Azure Data Engineer

Senior Data Engineer Role: Senior Data Engineer â€¿ Migration Execution Locati...

Location

India , Pune

Salary:

Not provided

Tech Mahindra

Expiration Date

July 31, 2026

Requirements

Strong proficiency in SQL, Python, PySpark, Apache Spark
Hands on experience with Databricks (Delta, DLT, Autoloader, Unity Catalog) and/or Snowflake (Snowpark, Snowpipe, Streams, Tasks)
Experience with AWS services â€¿ S3, Redshift, Athena, Glue, EMR, Lambda
Hands on with Apache Airflow DAG development
Experience with GitLab for version control and CI/CD
Strong SQL performance tuning and optimization skills
Experience with data quality validation and reconciliation
A Bachelor’s or Higher Degree is the minimum entry required for the position

Job Responsibility

Execute automated Lift & Shift migrations â€¿ schema mapping, Iceberg table creation, pipeline generation for Bronze/Silver tables
Develop and refactor ETL/ELT pipelines â€¿ decompose monolithic PSQL/Glue jobs into modular PySpark/Snowpark patterns
Review, validate, and refine AI assisted code conversions (PySpark/Snowpark)
label AI generated lines in code comments per EchoStar Addendum
Configure and execute dual run validation scripts â€¿ row count, hash based integrity, business rule comparisons
Rationalize schemas, naming conventions, and lineage for AI Factory consumption patterns and Unity Catalog / Horizon Catalog governance
Develop and deploy Airflow DAGs replacing Control M orchestration
Produce before/after metrics (complexity, runtime, cost) for Technical Debt Remediation Log
Create operations runbooks, SOPs, and procedural guides for each migrated workload
Support EchoStar FTE shadowing and reverse shadowing during KT phases

Fulltime

Senior Azure Data Engineer

Senior Data Engineer Role: Senior Data Engineer Migration Execution Location: ...

Location

India , Pune

Salary:

Not provided

Tech Mahindra

Expiration Date

July 31, 2026

Requirements

Strong proficiency in SQL, Python, PySpark, Apache Spark
Hands on experience with Databricks (Delta, DLT, Autoloader, Unity Catalog) and/or Snowflake (Snowpark, Snowpipe, Streams, Tasks)
Experience with AWS services - S3, Redshift, Athena, Glue, EMR, Lambda
Hands on with Apache Airflow DAG development
Experience with GitLab for version control and CI/CD
Strong SQL performance tuning and optimization skills
Experience with data quality validation and reconciliation

Job Responsibility

Execute automated Lift & Shift migrations - schema mapping, Iceberg table creation, pipeline generation for Bronze/Silver tables
Develop and refactor ETL/ELT pipelines - decompose monolithic PSQL/Glue jobs into modular PySpark/Snowpark patterns
Review, validate, and refine AI assisted code conversions (PySpark/Snowpark)
label AI generated lines in code comments per EchoStar Addendum
Configure and execute dual run validation scripts - row count, hash based integrity, business rule comparisons
Rationalize schemas, naming conventions, and lineage for AI Factory consumption patterns and Unity Catalog / Horizon Catalog governance
Develop and deploy Airflow DAGs replacing Control M orchestration
Produce before/after metrics (complexity, runtime, cost) for Technical Debt Remediation Log
Create operations runbooks, SOPs, and procedural guides for each migrated workload
Support EchoStar FTE shadowing and reverse shadowing during KT phases

Fulltime

Senior Azure Data Engineer

We are looking for a highly skilled and experienced Senior Azure Data Engineer w...

Location

Egypt , Cairo

Salary:

Not provided

Coca-Cola HBC

Expiration Date

Until further notice

Requirements

Bachelor's degree in Information Technology, Computer Science, or related field
5+ years of experience in data engineering with a strong focus on Azure (Azure Data Factory, Azure Data Lake Storage, Fabric)
Proven experience designing and building production-grade data pipelines that handle large volumes of data reliably
Strong SQL skills and experience with data modelling, schema design, and query optimization
Hands-on experience with Databricks (PySpark / Spark SQL) for large-scale data transformation
Proficiency in at least one programming language: Python (preferred), Scala, or C#/.NET
Solid understanding of data warehouse and lakehouse concepts
Strong ability to work independently, manage your own priorities, and deliver under ambiguity
Excellent communication skills - able to translate technical concepts for business stakeholders and vice versa
Excellent problem-solving and debugging skills

Job Responsibility

Design, build, and maintain scalable ELT/ETL pipelines using Azure Data Factory, ensuring reliability and performance at terabyte scale
Own end-to-end pipeline health: monitoring, alerting, incident response, and continuous improvement
Identify and resolve bottlenecks across ingestion, transformation, and serving layers
drive measurable performance gains
Contribute to the design and evolution of our medallion architecture and golden layer strategy
Implement data ingestion processes from multiple heterogeneous sources, ensuring accuracy, completeness, and consistency
Support the migration from SAP BW, ensuring data continuity and quality throughout
Ensure data integrity and availability through appropriate storage solutions, partitioning strategies, and access controls
Work autonomously to deliver complex data engineering tasks with minimal supervision, while proactively communicating progress and blockers
Collaborate closely with data scientists, BI analysts, and business stakeholders to understand requirements and translate them into technical solutions

Fulltime

Senior Azure Data Engineer

Parexel is looking for changemakers who are driven by curiosity, passion, and op...

Location

Canada , Remote

Salary:

Not provided

Parexel

Expiration Date

Until further notice

Requirements

Minimum of 7 years of experience in software development
Minimum of 2 years of experience in cloud computing
Proficiency with Cloud Platform, Azure, DataBricks, Azure Data Factory, Azure Dev Ops, and SQL
Python and Power BI are preferred
Bachelor of Science in Computer Science, Engineering, or related technical field is required
Solid knowledge of SDLC and medallion architecture
Excellent problem-solving and analytical skills
Impeccable communication skills

Job Responsibility

Using Microsoft Azure data PaaS services, design, build, modify, and support data pipelines leveraging DataBricks and PowerBI in a medallion architecture setting
Create prototypes to validate proposed ideas and solicit input from stakeholders
Collaborate with Team Leads to define/clarify business requirements, estimate development costs, and finalize work plans
Run unit and integration tests on all created code – Create and run unit and integration tests throughout the development lifecycle

What we offer

Health, Vision & Dental Insurance
Tuition Reimbursement
Vacation/Holiday/Sick Time
Flexible Spending & Health Savings Accounts
Work/Life Balance
401(k) with Company match
Pet Insurance
Opportunity to work on innovative projects at the forefront of the industry
Collaborative and inclusive work environment that values your expertise
Professional advancement and development opportunities

Fulltime

Senior Azure Data Engineer

Seeking a Lead AI DevOps Engineer to oversee design and delivery of advanced AI/...

Location

Poland

Salary:

Not provided

Lingaro

Expiration Date

Until further notice

Requirements

At least 6 years of professional experience in the Data & Analytics area
1+ years of experience (or acting as) in the Senior Consultant or above role with a strong focus on data solutions build in Azure and Databricks/Synapse/(MS Fabric is nice to have)
Proven experience in Azure cloud-based infrastructure, Databricks and one of SQL implementation (e.g., Oracle, T-SQL, MySQL, etc.)
Proficiency in programming languages such as SQL, Python, PySpark is essential (R or Scala nice to have)
Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders
Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps)
Experience in leading and managing a team of data engineers, providing guidance, mentorship, and technical support
Knowledge of data management principles and best practices, including data governance, data quality, and data integration
Good project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results within designated deadlines
Excellent problem-solving and analytical skills, with the ability to identify and resolve complex data engineering issues

Job Responsibility

Act as a senior member of the Data Science & AI Competency Center, AI Engineering team, guiding delivery and coordinating workstreams
Develop and execute a cloud data strategy aligned with organizational goals
Lead data integration efforts, including ETL processes, to ensure seamless data flow
Implement security measures and compliance standards in cloud environments
Continuously monitor and optimize data solutions for cost-efficiency
Establish and enforce data governance and quality standards
Leverage Azure services, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions
Work with cross-functional teams to understand requirements and provide data solutions
Maintain comprehensive documentation for data architecture and solutions
Mentor junior team members in cloud data architecture best practices

What we offer

Stable employment
“Office as an option” model
Workation
Great Place to Work® certified employer
Flexibility regarding working hours and your preferred form of contract
Comprehensive online onboarding program with a “Buddy” from day 1
Cooperation with top-tier engineers and experts
Unlimited access to the Udemy learning platform from day 1
Certificate training programs
Upskilling support

Senior Azure Data Engineer

The Department of Customer Service is seeking a highly motivated Senior Data Eng...

Location

Australia , Sydney

Salary:

Not provided

Darumatic

Expiration Date

Until further notice

Requirements

Minimum Bachelor’s degree in Computer Science, Software Engineering, or Information Systems
5+ years of professional experience as a Data Engineer
Hands-on experience building scalable data pipelines and ELT/ETL workflows specifically using Microsoft Fabric to optimise datasets for PowerBI
Strong proficiency in SQL and at least one other programming language commonly used for data engineering (e.g., Python, Java, Scala)
Proven background in documentation, security, and compliance, specifically with experience in Microsoft Purview and Azure Key Vault
Advanced skills in Excel, including Power Query, VBA automation, and connectors
A creative problem solver who can think critically to resolve complex data challenges
Ability to stay updated with industry trends and integrate new best practices
Strong ability to collaborate with non-technical stakeholders and technical teams alike

Job Responsibility

Drive the end-to-end data engineering strategy using Microsoft technologies
Build, maintain, and scale data pipelines and platforms to ensure efficient data flow
Design and execute ELT/ETL workflows to transform raw data from disparate systems into structured, high-quality datasets optimised for PowerBI, reporting, and machine learning
Work cross-functionally with Data Analysts and Business Analysts to understand database requirements, partitioning strategies, and business logic
Implement strong data governance and compliance measures
Stay abreast of industry trends and best practices to drive continuous improvement initiatives within the data engineering function
Utilise Excel, Power Query, and VBA to handle automation tasks and connectors where required

Senior Azure Data Engineer

We are seeking an experienced Azure Data Engineer with Databricks expertise to j...

Location

Poland , Warszawa

Salary:

150.00 - 180.00 PLN / Hour

Cyclad Sp. z o.o.

Expiration Date

Until further notice

Requirements

Minimum 3+years' hands-on experience with Azure Data Factory and Databricks (modern features, including Unity Catalog and 2025 capabilities)
At least 5+ years' experience in data engineering or backend/full-stack software development
Solid software engineering background: writing unit tests in Python, proficient with Git, and CI/CD pipelines
Strong SQL skills and experience structuring and modelling data in both relational and non-relational formats
Experience with data transformation tools, Spark, and real-time analytics solutions on Azure
Strong verbal and written communication skills in English

Job Responsibility

Design, build, and deploy scalable data pipelines using Azure Databricks and the Azure Analytics stack
Curate structured, semi-structured, and unstructured data by creating efficient, cost-effective, and scalable pipelines
Create and maintain robust data pipeline architecture ensuring data quality, reliability, and scalability
Assemble and manage large, complex datasets to meet functional and non-functional business requirements
Identify, design, and implement process improvements, including automation and optimization of data delivery
Work with real-time and streaming analytics solutions where applicable
Collaborate closely with Product Owners, Scrum Masters, architects, and data leadership to ensure timely, high-quality delivery
Align with Data Engineering chapter standards, processes, and best practices
Apply solid software engineering practices, including unit testing, CI/CD, and version control
Troubleshoot complex data-related issues and perform root cause analysis

What we offer

Private medical care with dental care (covering 70% of costs) + rehabilitation package.
family package option possible
Multisport card (also for an accompanying person)
Life insurance
Flexibility and international environment

Fulltime

Select Country

Senior Azure Data Engineer

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?

Senior Azure Data Engineer

Senior Azure Data Engineer

Senior Azure Data Engineer

Senior Azure Data Engineer

Senior Azure Data Engineer

Senior Azure Data Engineer

Senior Azure Data Engineer

Senior Azure Data Engineer

Senior Azure Data Engineer

Our AI answers in your language