Azure Data Engineer Job at ACI Infotech

New

Azure Data Engineer

We are looking for a highly skilled and experienced Azure Data Engineer with sig...

Location

Egypt , Cairo

Salary:

Not provided

Coca-Cola HBC

Expiration Date

Until further notice

Requirements

Bachelor's degree in Information Technology, Computer Science, or related field
3+ years of experience in data engineering with hands-on exposure to Azure (Azure Data Factory, Azure Data Lake Storage, Fabric)
Proven experience designing and building production-grade data pipelines that handle large volumes of data reliably
Strong SQL skills and experience with data modelling, schema design, and query optimization
Hands-on experience with Databricks (PySpark / Spark SQL) for large-scale data transformation
Working proficiency in Python
Understanding of data warehouse and lakehouse concepts
Ability to manage your own tasks within a defined sprint scope and deliver consistently
Good communication skills - able to translate technical concepts for business stakeholders and vice versa
Excellent problem-solving and debugging skills

Job Responsibility

Design, build, and maintain scalable ELT/ETL pipelines using Azure Data Factory, ensuring reliability and performance at terabyte scale
Contribute to end-to-end pipeline health: monitoring, alerting, incident response, and continuous improvement
Identify and resolve bottlenecks across ingestion, transformation, and serving layers
Implement and extend existing medallion architecture patterns
Develop data ingestion processes from multiple sources, ensuring accuracy, completeness, and consistency
Support the migration from SAP BW, ensuring data continuity and quality throughout
Ensure data integrity and availability through appropriate storage solutions, partitioning strategies, and access controls
Work independently on clearly scoped tasks, communicating progress and blockers regularly with your team
Collaborate with data scientists, BI analysts, and business stakeholders to understand requirements and translate them into technical solutions
Participate in agile ceremonies, contribute to sprint planning, and own your backlog items end-to-end

Fulltime

Azure Data Engineer

Location

United States , Shrewsbury

Salary:

Not provided

Ventois

Expiration Date

Until further notice

Requirements

Bachelor's degree or its equivalent in computer science, computer information systems, information technology, or a combination of education and experience equating to the U.S. equivalent of a bachelor's degree in one of the aforementioned subjects
Analyze, manipulate, and process large sets of structured and semi-structured data including healthcare datasets (claims, patient, and provider data) using Python (PySpark), SQL, and Spark SQL within the Azure data platform
Apply data mining, data modeling, and statistical analysis techniques to extract and analyze information from large datasets stored in Azure Data Lake Storage (ADLS) and Delta Lake across Bronze, Silver, and Gold layers
Identify business problems and management objectives that can be addressed through data analysis
translate business requirements into analytical workflows and data solutions using Azure Data Factory and Azure Databricks
Develop and maintain data models and analytical datasets to support reporting, business intelligence, and downstream data consumption
identify relationships, trends, and factors that could affect the results of analysis
Apply feature selection and data profiling methods to identify patterns, anomalies, and data quality issues that may impact analytical outcomes
recommend data-driven improvements
Clean, manipulate, and prepare raw data for analysis using ETL/ELT processes

Job Responsibility

Analyze, manipulate, and process large sets of structured and semi-structured data including healthcare datasets (claims, patient, and provider data) using Python (PySpark), SQL, and Spark SQL within the Azure data platform
Apply data mining, data modeling, and statistical analysis techniques to extract and analyze information from large datasets stored in Azure Data Lake Storage (ADLS) and Delta Lake across Bronze, Silver, and Gold layers
Identify business problems and management objectives that can be addressed through data analysis
translate business requirements into analytical workflows and data solutions using Azure Data Factory and Azure Databricks
Develop and maintain data models and analytical datasets to support reporting, business intelligence, and downstream data consumption
identify relationships, trends, and factors that could affect the results of analysis
Apply feature selection and data profiling methods to identify patterns, anomalies, and data quality issues that may impact analytical outcomes
recommend data-driven improvements
Clean, manipulate, and prepare raw data for analysis using ETL/ELT processes
implement data quality frameworks including validation rules, cleansing, and reconciliation techniques to ensure accuracy and consistency

Fulltime

Azure Data Engineer

We are currently seeking a Azure Data Engineer to join our team in Bangalore, Ka...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

6+ years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects
5+ years of demonstrated production experience in core data platforms such as Databricks and Azure related data services
5+ years of expertise in SQL and Python (Spark) as data manipulation languages
5+ years of hands-on knowledge of Cloud and Distributed Data Storage, including ADLS
5+ years of Data integration technologies, encompassing Spark, Kafka, eventing/streaming, Azure DataFactory, Azure Synapse, and Databricks
Showcase professional written and verbal communication skills to effectively convey complex technical concepts
Undergraduate or Graduate degree preferred

Job Responsibility

Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack
Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure
Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations
Generate comprehensive solution documentation, including sequence diagrams, class hierarchies, logical system views, etc.
Adhere to Agile practices throughout the solution development process
Design, build, and deploy databases, data pipelines and data stores to support organizational requirements

Azure Data Engineer

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

6+ years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects
5+ years of demonstrated production experience in core data platforms such as Databricks and Azure related data services
5+ years of expertise in SQL and Python (Spark) as data manipulation language
5+ years of hands-on knowledge of Cloud and Distributed Data Storage, including ADLS
5+ years of Data integration technologies, encompassing Spark, Kafka, eventing/streaming, Azure Data Factory, Azure Synapse, and Databricks
Showcase professional written and verbal communication skills to effectively convey complex technical concepts
Undergraduate or Graduate degree preferred
6+ years of Azure Data Factory, Strong SQL, Azure Synapse, Spark/PySpark, Python scripting, data modeling/analysis/mapping

Job Responsibility

Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack
Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure
Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations
Generate comprehensive solution documentation, including sequence diagrams, class hierarchies, logical system views, etc
Adhere to Agile practices throughout the solution development process
Design, build, and deploy databases, data pipelines and data stores to support organizational requirements

Fulltime

Azure Data Engineer

We are currently seeking a Azure Data Engineer to join our team in Bangalore, Ka...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

6+ years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects
Ability to work from NTT DATA's ODC centers in Bengaluru, Chennai or Hyderabad 3 days per week
5+ years of demonstrated production experience in core data platforms such as Databricks and Azure related data services
5+ years of expertise in SQL and Python (Spark) as data manipulation language
5+ years of hands-on knowledge of Cloud and Distributed Data Storage, including ADLS
5+ years of Data integration technologies, encompassing Spark, Kafka, eventing/streaming, Azure Data Factory, Azure Synapse, and Databricks
Showcase professional written and verbal communication skills to effectively convey complex technical concepts
Undergraduate or Graduate degree preferred
6+ years of Azure Data Factory, Strong SQL, Azure Synapse, Spark/PySpark, Python scripting, data modeling/analysis/mapping

Job Responsibility

Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack
Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure
Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations
Generate comprehensive solution documentation, including sequence diagrams, class hierarchies, logical system views, etc.
Adhere to Agile practices throughout the solution development process
Design, build, and deploy databases, data pipelines and data stores to support organizational requirements

Fulltime

Azure Data Engineer

We are currently seeking a Azure Data Engineer to join our team in Bangalore, Ka...

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

6+ years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects
Ability to work from NTT DATA's ODC centers in Bengaluru, Chennai or Hyderabad 3 days per week
5+ years of demonstrated production experience in core data platforms such as Databricks and Azure related data services
5+ years of expertise in SQL and Python (Spark) as data manipulation language
5+ years of hands-on knowledge of Cloud and Distributed Data Storage, including ADLS
5+ years of Data integration technologies, encompassing Spark, Kafka, eventing/streaming, Azure Data Factory, Azure Synapse, and Databricks
Professional written and verbal communication skills
6+ years of Azure Data Factory, Strong SQL, Azure Synapse, Spark/PySpark, Python scripting, data modeling/analysis/mapping

Job Responsibility

Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack
Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure
Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations
Generate comprehensive solution documentation, including sequence diagrams, class hierarchies, logical system views, etc.
Adhere to Agile practices throughout the solution development process
Design, build, and deploy databases, data pipelines and data stores to support organizational requirements

Azure Data Engineer

You are an experienced Data Engineer with a strong background in Azure-based dat...

Location

Netherlands , Amsterdam

Salary:

Not provided

Levy Professionals

Expiration Date

Until further notice

Requirements

5+ years of experience in Azure cloud data engineering
Hands-on experience with Databricks, Unity Catalog and SQL data warehousing
Experience with DevOps practices and Scrum/Agile ways of working
Knowledge of Power BI, Azure cloud infrastructure, data governance and compliance practices

Job Responsibility

Develop and maintain scalable data solutions within the Azure cloud environment
Work with Databricks, Data Lakes and big data technologies to support enterprise data platforms
Build and optimize SQL data warehouse solutions using Kimball methodologies and data modelling principles
Develop and maintain solutions using Python, Scala and/or PySpark
Contribute to DevOps practices, Agile delivery processes and continuous platform improvements

Fulltime

Azure Data Engineer

Location

India , Bangalore

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

6+ years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects
Ability to work from NTT DATA's ODC centers in Bengaluru, Chennai or Hyderabad 3 days per week

Job Responsibility

Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack
Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure
Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations
Generate comprehensive solution documentation, including sequence diagrams, class hierarchies, logical system views, etc
Adhere to Agile practices throughout the solution development process
Design, build, and deploy databases, data pipelines and data stores to support organizational requirements

Fulltime

Select Country

Azure Data Engineer

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Azure Data Engineer

Our AI answers in your language