Data Engineer - Azure Databricks Job at NTT DATA (Bangalore)

Data Engineer - Azure Databricks

The Data Engineer - Azure Databricks role involves building and maintaining scal...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Strong hands-on experience in Databricks
Python scripting for data engineering workloads
Good experience with Azure Data Factory
Solid understanding of Azure Cloud fundamentals
Experience in data pipeline development and ETL frameworks
Strong communication and stakeholder interaction skills
Experience working in Agile / Scrum teams
Total Experience: 7–10+ years
Relevant Data Engineering Experience: 5+ years
Databricks Experience: 3+ years

Job Responsibility

Develop and maintain data pipelines using Databricks and Python
Build and orchestrate ETL/ELT workflows using Azure Data Factory (ADF)
Work with Azure cloud data services to support data ingestion, transformation, and processing
Optimize and monitor Databricks jobs and data pipelines for performance and reliability
Collaborate with architects, analysts, and business stakeholders to implement scalable data solutions
Ensure best practices in data engineering, code quality, and documentation
Participate in code reviews, troubleshooting, and production support activities

Fulltime

Senior Azure Data Engineer with Databricks

Location

Poland

Salary:

Not provided

DCG Sp. z o. o.

Expiration Date

Until further notice

Requirements

3+ years’ experience with Azure Data Factory and Databricks
5+ years’ experience with data engineering or backend/fullstack software development
Strong SQL skills
Python scripting proficiency
Experience with data transformation tools - Databricks and Spark
Experience in structuring and modelling data in both relational and non-relational forms
Experience with CI/CD tooling
Working knowledge of Git
English level: B2, C1

Job Responsibility

Being responsible for at-scale infrastructure design, build and deployment with a focus on distributed systems
Building and maintaining architecture patterns for data processing, workflow definitions, and system to system integrations using Big Data and Cloud technologies
Evaluating and translating technical design to workable technical solutions/code and technical specifications at par with industry standards
Driving creation of re-usable artifacts
Establishing scalable, efficient, automated processes for data analysis, data model development, validation, and implementation
Working closely with analysts/data scientists to understand impact to the downstream data models
Writing efficient and well-organized software to ship products in an iterative, continual release environment
Contributing and promoting good software engineering practices across the team
Communicating clearly and effectively to technical and non-technical audiences
Defining data retention policies

What we offer

Private medical care
Co-financing for the sports card
Constant support of dedicated consultant
Employee referral program

Staff Engineer I – Azure Databricks Engineer

Location

United States , Irving

Salary:

Not provided

Software Resources

Expiration Date

Until further notice

Requirements

5+ years of related experience in data analytics administration and development
2+ years of Databricks related experience
Bachelor's degree in related field required
Hands-on experience in Azure Databricks (Workspace management, Clusters, Jobs, Unity Catalog, Delta Lake, User access management, Rest APIs and SDKs)
Understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking
Experience with CI/CD pipelines (Azure DevOps preferred)
Strong programming skills in SQL, Python, and/or PySpark
Proven experience in leading cross-functional teams and managing multiple projects simultaneously
Intermediate to advanced ability to see the big picture and align projects with organizational goals
Capable of leading and motivating cross-functional teams

Job Responsibility

Delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data
Building, optimizing, streamlining and automating the Azure Databricks platform to enable analytical workloads like Machine learning (ML), Model Development, Data Insights, Data Science etc
Partner with ML engineers, data scientists, data analysts, and enterprise architects to enforce best practices, train and enable users using the Azure Databricks platform
Take assignments that can be worked on individually without supervision and manage work effort from concept to completion
Build, optimize and maintain the Azure Databricks platform, ensuring scalability, security, governance and performance
Implement and manage Azure Databricks workspaces, clusters, jobs, access management
Implement and manage policies, monitoring and observability for the Azure Databricks platform
Ensure compliance with IT policies, procedures, and industry standards, including reviewing and refining IT control enhancements
Work closely with business and analytics teams to ensure reliable and governed data access for data needed for analytics
Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services

What we offer

Competitive salaries
An ownership stake in the company
Medical and dental insurance
Time off
A great 401k matching program
Tuition assistance program
An employee volunteer program
A wellness program

Staff Engineer I – Azure Databricks Engineer

Software Resources has an immediate, direct hire job opportunity for a Staff Eng...

Location

United States , Irving, Dallas

Salary:

Not provided

Software Resources

Expiration Date

Until further notice

Requirements

5+ years of related experience in data analytics administration and development
2+ years of Databricks related experience
Bachelor’s degree in related field required
Hands-on experience in Azure Databricks (Workspace management, Clusters, Jobs, Unity Catalog, Delta Lake, User access management, Rest APIs and SDKs)
Understanding of Azure infrastructure and data services, including Azure Data Lake, Azure Data Factory, Azure SQL, Azure Synapse Analytics, Azure Key Vault, Azure Monitor, networking
Experience with CI/CD pipelines (Azure DevOps preferred)
Strong programming skills in SQL, Python, and/or PySpark
Proven experience in leading cross-functional teams and managing multiple projects simultaneously
Intermediate to advanced ability to see the big picture and align projects with organizational goals. Capable of leading and motivating cross-functional teams. Expertise in resolving conflicts and addressing challenges as well as skilled at identifying and mitigating risks at the project level
Good communication skills, excellent teamwork experience

Job Responsibility

Responsible for delivery and operations of technologies and platforms required to model, transform, analyze, report, visualize data
Work in a mid-level role with proficiency needed in building, optimizing, streamlining and automating the Azure Databricks platform to enable analytical workloads like Machine learning (ML), Model Development, Data Insights, Data Science etc
Partner with ML engineers, data scientists, data analysts, and enterprise architects to enforce best practices, train and enable users using the Azure Databricks platform
Take assignments that can be worked on individually without supervision and manage work effort from concept to completion
Build, optimize and maintain the Azure Databricks platform, ensuring scalability, security, governance and performance
Implement and manage Azure Databricks workspaces, clusters, jobs, access management
Implement and manage policies, monitoring and observability for the Azure Databricks platform
Ensure compliance with IT policies, procedures, and industry standards, including reviewing and refining IT control enhancements
Work closely with business and analytics teams to ensure reliable and governed data access for data needed for analytics
Troubleshoot platform issues, optimize performance, and ensure uptime for critical Databricks services

What we offer

Competitive salaries
An ownership stake in the company
Medical and dental insurance
Time off
A great 401k matching program
Tuition assistance program
An employee volunteer program
A wellness program
Opportunity to bolster your business knowledge, learning the ins and outs of how successful companies operate and manage their finances, giving you invaluable hands-on experience to help grow your career

Fulltime

Technical Support Engineer - Azure Data Factory / Data Integration

Within CE&S, the Customer Service & Support (CSS) organization builds trust and ...

Location

Malaysia , Kuala Lumpur

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Information Technology (IT), or related field AND 1+ years of technical support, technical consulting experience, or information technology experience
OR 3+ years of technical support, technical consulting experience, or information technology experience
OR equivalent experience
Azure Data Factory (ADF)
Azure Synapse Analytics / Microsoft Fabric Pipeline
Data Lake
Relational Database Management System (Microsoft SQL Server / Oracle Database / MySQL / IBM Db2 / SAP)
Big Data or Analytics Products (Spark / Azure HDInsight / Azure Data Lake Analytics / Azure Synapse Analytics / Databricks / Google BigQuery)
Pipeline and ETL/ELT Skills
Building and orchestrating pipelines (ADF / Synapse / Fabric)

Job Responsibility

Response and Resolution: You own, investigate and solve customer technical issues. You collaborate within and across teams, leveraging troubleshooting tools and practices
Readiness: You lead or participate in building communities with peer delivery roles and, where appropriate, share your knowledge
You develop specific technical and professional proficiency to enable you to resolve customer issues, through training and readiness
Product/Process Improvement: You identify potential product defects and escalate appropriately to resolve, contributing to Microsoft product improvements

Fulltime

New

Senior Azure Data Engineer

Senior Data Engineer Role: Senior Data Engineer â€¿ Migration Execution Locati...

Location

India , Pune

Salary:

Not provided

Tech Mahindra

Expiration Date

July 31, 2026

Requirements

Strong proficiency in SQL, Python, PySpark, Apache Spark
Hands on experience with Databricks (Delta, DLT, Autoloader, Unity Catalog) and/or Snowflake (Snowpark, Snowpipe, Streams, Tasks)
Experience with AWS services â€¿ S3, Redshift, Athena, Glue, EMR, Lambda
Hands on with Apache Airflow DAG development
Experience with GitLab for version control and CI/CD
Strong SQL performance tuning and optimization skills
Experience with data quality validation and reconciliation
A Bachelor’s or Higher Degree is the minimum entry required for the position

Job Responsibility

Execute automated Lift & Shift migrations â€¿ schema mapping, Iceberg table creation, pipeline generation for Bronze/Silver tables
Develop and refactor ETL/ELT pipelines â€¿ decompose monolithic PSQL/Glue jobs into modular PySpark/Snowpark patterns
Review, validate, and refine AI assisted code conversions (PySpark/Snowpark)
label AI generated lines in code comments per EchoStar Addendum
Configure and execute dual run validation scripts â€¿ row count, hash based integrity, business rule comparisons
Rationalize schemas, naming conventions, and lineage for AI Factory consumption patterns and Unity Catalog / Horizon Catalog governance
Develop and deploy Airflow DAGs replacing Control M orchestration
Produce before/after metrics (complexity, runtime, cost) for Technical Debt Remediation Log
Create operations runbooks, SOPs, and procedural guides for each migrated workload
Support EchoStar FTE shadowing and reverse shadowing during KT phases

Fulltime

New

Data Engineer – Azure Cloud Infrastructure

Location

Netherlands , Amsterdam

Salary:

Not provided

Levy Professionals

Expiration Date

Until further notice

Requirements

Proven experience with Azure data services such as Data Factory, Synapse, and Key Vault
Proficiency in Infrastructure as Code tools like Terraform, ARM, or Bicep
Hands-on experience with CI/CD tools, preferably Azure DevOps
Experience with MSSQL and Databricks
Understanding of data modelling and data warehouse concepts
Experience in financial or regulatory reporting environments
Relevant certifications such as Azure DevOps Engineer or Azure Data Engineer
Experience with cloud migration or hybrid cloud setups

Job Responsibility

Design and deliver end-to-end data pipelines for reporting and analytics
Develop and manage Azure infrastructure using Infrastructure as Code (Terraform, ARM, Bicep)
Build and maintain CI/CD pipelines for infrastructure and data deployments
Collaborate with engineers and business stakeholders to ensure secure, compliant solutions
Automate monitoring, testing, and deployment processes to improve operational reliability

New

Sr. Azure Data Engineer

Senior Data Engineer. Role: Senior Data Engineer and Migration Execution. Locati...

Location

India , Pune

Salary:

Not provided

Tech Mahindra

Expiration Date

July 14, 2026

Requirements

Bachelor's degree
SQL
Python
Azure
Databricks
Total Experience: 4.00 to 7.00 Years
Strong proficiency in SQL, Python, PySpark, Apache Spark
Hands-on experience with Databricks (Delta, DLT, Autoloader, Unity Catalog) and/or Snowflake (Snowpark, Snowpipe, Streams, Tasks)
Experience with AWS services S3, Redshift, Athena, Glue, EMR, Lambda
Hands on with Apache Airflow DAG development

Job Responsibility

Execute automated Lift & Shift migrations schema mapping, Iceberg table creation, pipeline generation for Bronze/Silver tables
Develop and refactor ETL/ELT pipelines decompose monolithic PSQL/Glue jobs into modular PySpark/Snowpark patterns
Review, validate, and refine AI assisted code conversions (PySpark/Snowpark)
label AI generated lines in code comments per EchoStar Addendum
Configure and execute dual run validation scripts row count, hash-based integrity, business rule comparisons
Rationalize schemas, naming conventions, and lineage for AI Factory consumption patterns and Unity Catalog / Horizon Catalog governance
Develop and deploy Airflow DAGs replacing Control M orchestration
Produce before/after metrics (complexity, runtime, cost) for Technical Debt Remediation Log
Create operations runbooks, SOPs, and procedural guides for each migrated workload
Support EchoStar FTE shadowing and reverse shadowing during KT phases

Select Country

Data Engineer - Azure Databricks

Job Description

Job Responsibility

Requirements

Looking for more opportunities?

Data Engineer - Azure Databricks

Data Engineer - Azure Databricks

Senior Azure Data Engineer with Databricks

Staff Engineer I – Azure Databricks Engineer

Staff Engineer I – Azure Databricks Engineer

Technical Support Engineer - Azure Data Factory / Data Integration

Senior Azure Data Engineer

Data Engineer – Azure Cloud Infrastructure

Sr. Azure Data Engineer

Our AI answers in your language