CrawlJobs Logo

Data Engineer - Azure

Vietnam · Job Posted January 05, 2026
Apply Position
Job Link Share

Job Responsibility

  • Design, develop, and maintain real-time data streaming pipelines using Spark Streaming or Azure Functions
  • Load, merge, and process machine logs from Kafka, ensuring efficient data flow and transformation
  • Integrate processed data into Redis cache and send it to the data lake for long-term storage and analysis
  • Implement and optimize data processing solutions using Python
  • Apply software engineering best practices, including code reviews, version control, and continuous integration/deployment (CI/CD)
  • Collaborate with cross-functional teams to understand requirements and deliver high-quality data solutions

Requirements

  • Proven experience in real-time data streaming using Spark Streaming or Azure Functions
  • Strong proficiency in Python for data processing and automation tasks
  • Hands-on experience with Kafka for data ingestion and message queuing
  • Familiarity with Redis for caching and fast data retrieval
  • Knowledge of data lake architectures and best practices for data storage and retrieval
  • Solid understanding of software engineering principles, including design patterns, testing, and documentation
  • Strong problem-solving skills and ability to work in a fast-paced, collaborative environment

Nice to have

  • Experience with cloud platforms such as Azure
  • Knowledge of other programming languages and frameworks related to data engineering
  • Familiarity with data modeling, ETL processes, and data lake concepts

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer - Azure

8 matching positions

Data Engineer - Azure

The Data Engineer - Azure role requires expertise in SQL and Python, focusing on...
Location
Location
India
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced SQL programming for more than 4 years
  • Data analysis skills for more than 2 years
  • Experience with Agile delivery frameworks/methodologies (e.g. Scrum, SAFe) and tools (i.e. Jira, Azure DevOps)
  • Demonstrate a proven track record of having implemented solutions using one or more agile methodologies in conjunction with a large system integration partner
  • Experience with Azure Data Factory and Databricks including orchestrating and designing data pipelines for secure data solutions are preferred
  • Industry certifications in Azure, Databricks or data architecture is advantageous
  • Understanding and knowledge of system development life cycle methodologies (such as agile software development, rapid prototyping, incremental, synchronize and stabilize, and DevOps)
  • Experience in migrating data and associated systems from on prem to Cloud environments
  • Knowledge of advanced analytics (models, tools, etc.) and their operational support is a plus
  • Excellent verbal and written communication
Read More
Arrow Right

Data Engineer - Azure

The Data Engineer - Azure role requires a strong background in SQL and Python, w...
Location
Location
India
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced SQL programming for more than 4 years
  • Data analysis skills for more than 2 years
  • Experience with Agile delivery frameworks/methodologies (e.g. Scrum, SAFe) and tools (i.e. Jira, Azure DevOps)
  • Proven track record of having implemented solutions using one or more agile methodologies in conjunction with a large system integration partner
  • Experience with Azure Data Factory and Databricks including orchestrating and designing data pipelines for secure data solutions
  • Industry certifications in Azure, Databricks or data architecture
  • Understanding and knowledge of system development life cycle methodologies (such as agile software development, rapid prototyping, incremental, synchronize and stabilize, and DevOps)
  • Experience in migrating data and associated systems from on prem to Cloud environments
  • Knowledge of advanced analytics (models, tools, etc.) and their operational support
  • Excellent verbal and written communication
Job Responsibility
Job Responsibility
  • Design data pipelines
  • Collaborate with teams to ensure data integrity
Read More
Arrow Right

Data Engineer - Azure

The Data Engineer - Azure role requires expertise in SQL and Python, with a focu...
Location
Location
India , Remote
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Advanced SQL programming for more than 4 years
  • Data analysis skills for more than 2 years
  • Experience with Agile delivery frameworks/methodologies (e.g. Scrum, SAFe) and tools (i.e. Jira, Azure DevOps)
  • Demonstrate a proven track record of having implemented solutions using one or more agile methodologies in conjunction with a large system integration partner
  • Experience with Azure Data Factory and Databricks including orchestrating and designing data pipelines for secure data solutions
  • Understanding and knowledge of system development life cycle methodologies (such as agile software development, rapid prototyping, incremental, synchronize and stabilize, and DevOps)
  • Experience in migrating data and associated systems from on prem to Cloud environments
  • Strong technical proficiency in SQL, Python, and data integration tools
  • Hands-on experience with ETL tools and data orchestration (e.g., Azure Data Factory, Databricks)
  • Knowledge of data modelling, warehouse design, and architecture principles
  • Fulltime
Read More
Arrow Right

Data Engineer - Azure

Location
Location
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4-6 years of professional experience in a similar role
  • Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders
  • Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps)
  • Independence and responsibility in delivering solutions
  • Ability to work under agile methodologies
  • Hands-on experience in designing and optimizing of data storage (data lakes, data warehouses, distributed file systems)
Job Responsibility
Job Responsibility
  • Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms
  • Integrating and transforming data to ensure its compatibility with the target data model or format
  • Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems
  • Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval
  • Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency
  • Designing and implementing data models that support efficient data storage, retrieval, and analysis
  • Collaborating with data scientists and analysts to understand their requirements and provide them with well-structured and optimized data for analysis and modeling purposes
  • Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders to understand their requirements and provide technical solutions
  • Communicating complex technical concepts to non-technical stakeholders in a clear and concise manner
  • Independence and responsibility for delivering a solution
What we offer
What we offer
  • Stable employment
  • Medical Insurance
  • Grocery Coupons
  • Saving fund
  • 30 days of Christmas bonus
  • Remote work bonus
  • Profit sharing
  • 50% vacation premium
  • 100% remote
  • Flexibility regarding working hours
  • Fulltime
Read More
Arrow Right

Technical Support Engineer - Azure Data Factory / Data Integration

Within CE&S, the Customer Service & Support (CSS) organization builds trust and ...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology (IT), or related field AND 1+ years of technical support, technical consulting experience, or information technology experience
  • OR 3+ years of technical support, technical consulting experience, or information technology experience
  • OR equivalent experience
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics / Microsoft Fabric Pipeline
  • Data Lake
  • Relational Database Management System (Microsoft SQL Server / Oracle Database / MySQL / IBM Db2 / SAP)
  • Big Data or Analytics Products (Spark / Azure HDInsight / Azure Data Lake Analytics / Azure Synapse Analytics / Databricks / Google BigQuery)
  • Pipeline and ETL/ELT Skills
  • Building and orchestrating pipelines (ADF / Synapse / Fabric)
Job Responsibility
Job Responsibility
  • Response and Resolution: You own, investigate and solve customer technical issues. You collaborate within and across teams, leveraging troubleshooting tools and practices
  • Readiness: You lead or participate in building communities with peer delivery roles and, where appropriate, share your knowledge
  • You develop specific technical and professional proficiency to enable you to resolve customer issues, through training and readiness
  • Product/Process Improvement: You identify potential product defects and escalate appropriately to resolve, contributing to Microsoft product improvements
  • Fulltime
Read More
Arrow Right

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Principal Frontend Engineer - Azure Monitor AIOps & Experience (Azure Data)

Principal Frontend Engineer — Azure Monitor AIOps & Experience (Azure Data). Abo...
Location
Location
Israel , Tel Aviv, Herzliya
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years building modern web applications with TypeScript and React (or similar), including component architecture, state management, and testing at scale
  • Proven experience delivering data-intensive UIs (dashboards, charts, investigative workflows) with performance and accessibility best practices
  • Strong API integration skills, client-side performance profiling, and production debugging
  • Ability to collaborate across PM, Design, and ML/Backend to shape product direction and ship iteratively
  • Demonstrated expertise in migrating codebases from Angular to React
Job Responsibility
Job Responsibility
  • Own end-to-end web experiences for Azure Monitor: from UX design through production rollout
  • Visualize telemetry at scale with interactive charts, timelines, and dashboard integrations
  • Advance intelligent alerting: dynamic thresholds, smart grouping, contextual enrichment, and noise reduction in the alert lifecycle
  • Integrate AIOps capabilities (anomaly detection, RCA hints, agentic flows) into approachable, explainable UIs in partnership with data/ML engineers
  • Partner with platform teams to consume Azure Monitor, Alerts, Azure Resource Graph, and Log Analytics APIs
  • shape UI contracts, performance and resilience patterns
  • Champion quality: instrumentation, accessibility, localization, reliability, and front-end performance
  • Mentor and lead: drive technical design, code reviews, and best practices across cross-geo teams
  • Fulltime
Read More
Arrow Right

Data Engineer (Azure Focus)

About Blue Ridge Care At Blue Ridge Care, we deliver extraordinary care to impro...
Location
Location
United States , Winchester
Salary
Salary:
85000.00 - 110000.00 USD / Year
brhospice.org Logo
Blue Ridge Hospice
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, data analytics, information systems, or related field preferred (or equivalent experience)
  • 1–2 years of experience in data engineering, BI, analytics engineering, or similar role
  • Foundational experience with Microsoft Azure and strong desire to grow in Azure technologies
  • Working knowledge of SQL and data pipeline concepts (ETL/ELT)
  • Experience supporting or troubleshooting data processes or pipelines
  • Understanding of relational databases, structured data, and validation techniques
  • Strong problem-solving, documentation, and communication skills
  • Ability to collaborate with both technical and non-technical stakeholders
Job Responsibility
Job Responsibility
  • Support the buildout and stabilization of Blue Ridge Care’s Azure-based data platform
  • Assist in developing, testing, and maintaining scalable data pipelines
  • Help expand the platform to meet growing reporting and analytics needs
  • Learn system architecture to support long-term internal ownership
  • Integrate data from various systems including databases, files, and APIs
  • Apply ETL/ELT concepts to transform data into standardized, usable formats
  • Support enhancements to data models and reporting structures
  • Assist with new data pipeline development and system integrations
  • Perform data validation and quality checks to ensure reliability and accuracy
  • Identify and troubleshoot data issues across systems and pipelines
What we offer
What we offer
  • Competitive Pay
  • Flexible Work Arrangements
  • PTO & Paid Volunteer Time
  • Comprehensive Health Benefits
  • Tuition Reimbursement & Professional Development
  • Collaborative, mission-driven culture
  • Growth opportunities aligned with our 2030 Strategic Plan
  • Fulltime
Read More
Arrow Right