CrawlJobs Logo

Data Engineer

Vietnam · Job Posted January 05, 2026
Apply Position
Job Link Share

Job Description

We are looking for a highly skilled Azure Data Engineer with expert knowledge in cloud infrastructure and DevOps automation. This critical hybrid role will be responsible for designing, building, optimizing, and automating our entire end-to-end data platform within the Microsoft Azure ecosystem. The ideal candidate will ensure our data solutions are scalable, reliable, and deployed using modern Infrastructure as Code (IaC) and CI/CD practices.

Job Responsibility

  • Design & Implement ETL/ELT: Develop, optimize, and maintain scalable data pipelines using Python, SQL, and core Azure data services
  • Azure Data Services Management: Architect and manage key Azure data components, including: Data Lakes: Provisioning and structuring data within Azure Data Lake Storage (ADLS Gen2)
  • Data Processing: Implementing data transformation and analysis logic using Azure Data Factory (ADF), Azure Synapse Pipelines, and Azure Databricks (using Spark/PySpark)
  • Data Warehousing: Designing and optimizing the enterprise Data Warehouse in Azure Synapse Analytics (SQL Pool)
  • Data Modeling and Quality: Define and enforce data modeling standards and implement data quality checks within the pipelines
  • Infrastructure as Code (IaC): Design, manage, and provision all Azure data resources (ADLS, Synapse, ADF, Databricks Clusters) using Terraform or Azure Resource Manager (ARM) Templates/Bicep
  • CI/CD Implementation: Build and maintain automated Continuous Integration/Continuous Deployment (CI/CD) pipelines for all code (data, infrastructure, and application) using Azure DevOps or GitHub Actions
  • Containerization & Compute: Utilize Docker and manage deployment environments using Azure Kubernetes Service (AKS) or Azure Container Instances (ACI) when required for data applications
  • Monitoring, Logging, & Security: Configure comprehensive monitoring and alerting using Azure Monitor and Log Analytics. Implement network security and access controls (RBAC) across the data platform

Requirements

  • Strong hands-on experience designing and deploying end-to-end data solutions specifically within the Azure ecosystem
  • High proficiency in Python (including PySpark) and expert knowledge of SQL
  • Proven, production-level experience with Terraform (preferred) or ARM/Bicep for automating Azure infrastructure deployment
  • Experience setting up CI/CD workflows using Azure DevOps Pipelines or GitHub Actions
  • Deep working knowledge of Azure Data Factory, Azure Databricks, and Azure Synapse Analytics
  • Experience with workflow orchestration tools like Azure Data Factory or Apache Airflow

Nice to have

  • Azure certifications such as Azure Data Engineer Associate (DP-203) or Azure DevOps Engineer Expert (AZ-400)
  • Familiarity with Data Governance tools such as Azure Purview
  • Experience with real-time data ingestion using Azure Event Hubs or Azure Stream Analytics

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

Lamb Weston is pursuing a modernization of its data assets and analytics environ...
Location
Location
United States , Eagle
Salary
Salary:
86380.00 - 129570.00 USD / Year
lambweston.com Logo
Lamb Weston
Expiration Date
August 09, 2026
Flip Icon
Requirements
Requirements
  • Minimum BS in Computer Science or related field or combination of education and experience sufficient to perform duties at an experienced level
  • Minimum of 3 years experience in a technical environment with data warehouse design and implementation
  • 3 years of programming experience in SQL, Java or Python
  • In depth knowledge of Snowflake
  • Knowledge of Informatica
  • 1 year+ working as a DBA
  • Demonstrated ability to work in a team and collaborative environment
  • Strong communication and interpersonal skills
  • Love of learning new technologies and having fun
  • Ability to travel 10% of the time
Job Responsibility
Job Responsibility
  • Design, build and maintain data warehouses (existing and from scratch) using Kimball and modern data methodologies
  • Debug support issues with the legacy environment and support our business users
  • Design and implement efficient data pipelines (ETLs) to integrate data from a variety of sources into Data Warehouse as well as data model changes that align with warehouse standards and backfill or other warehouse data management processes
  • Evaluates data design, database architecture, metadata and repositories for performance and effective design
  • Develop scalable ETL data pipelines with python, SQL, and AWS cloud tools
  • Optimization of existing SQL queries to improve reliability and performance
  • Develop and execute testing strategies to ensure high quality warehouse data
  • Provide documentation, training, and consulting for data warehouse users
  • Work with cross functional stakeholders to design and architect data warehouse and analytics solutions
  • Perform requirement and data analysis in order to support warehouse project definition
What we offer
What we offer
  • Health Insurance Benefits - Medical, Dental, Vision
  • Flexible Spending Accounts for Health and Dependent Care, and Health Reimbursement Accounts
  • Well-being programs including companywide events and a wellness incentive program
  • Paid Time Off
  • Financial Wellness – Industry leading 401(k) plan with generous company contributions, Financial Planning Services, Employee Stock purchase program, and Health Savings Accounts, Life and Accident insurance
  • Family-Friendly Employee events
  • Employee Assistance Program services – mental health and other concierge type services
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We’re looking for an experienced Data Engineer to design, build and support high...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
fortnumandmason.com Logo
Fortnum & Mason
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years in data engineering / data development
  • Strong Python and SQL
  • Azure Data Services (Synapse, Data Lake, Fabric, Databricks)
  • Power BI reporting & data modelling
  • ETL/ELT pipeline development and data architecture
Job Responsibility
Job Responsibility
  • Design, build and support high-quality data solutions that power reporting and analytics across the business
  • Translate business needs into scalable technical solutions
  • Develop ETL/ELT pipelines, data warehouses and lake solutions
  • Ensure strong data quality, monitoring and performance
  • Lead on BI initiatives and collaborate with stakeholders to deliver impactful insights
What we offer
What we offer
  • Competitive salary
  • A generous store and restaurant discount of up to 40%
  • 25 days holidays (excluded bank holidays) and an extra day off for your birthday
  • A fantastic subsidised staff restaurant which uses Fortnum’s ingredients
  • A range of opportunities to develop and grow personally and professionally
  • Excellent pension scheme
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Be a part of a place where challenges are measured in billions, qubits and nanos...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineering & ETL Development: Strong hands-on experience in ETL development, data transformation, and end-to-end pipeline workflows (ingestion → processing → consumption) including structured dataset creation and analytics outputs
  • SQL, Data Modelling & Data Warehousing: Solid database and querying skills with expertise in SQL, joins, and large-scale data modelling for warehouse-style analytics and dataset integration
  • Data Integration & Distributed Systems: Experience integrating multiple enterprise data sources including API/feed handling and working with distributed data environments
  • Cloud & Data Lake Fundamentals: Exposure to AWS, data lake architectures, and catalogue-based querying environments, supporting scalable data processing
  • Data Quality, Testing & Debugging: Strong capability in debugging pipelines, resolving data issues, validating datasets, and working with data quality frameworks and controls
  • Financial Data Domain & Collaboration: Understanding of financial datasets with ability to collaborate across teams and stakeholders to deliver data solutions
Job Responsibility
Job Responsibility
  • Delivering a set of enterprise, non-negotiable data strategy outcomes across the end-to-end lifecycle
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We're looking for a motivated Data Engineer(s) to join our growing team at Hutch...
Location
Location
United Kingdom , Sheffield
Salary
Salary:
Not provided
jobs.360resourcing.co.uk Logo
360 Resourcing Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • experience in a data engineering or similar technical role
  • Strong verbal and written communication skills
  • Proficiency in SQL and at least one programming language
  • Experience building and maintaining ETL/ELT pipelines
  • Familiarity with cloud data platforms (e.g. AWS, Azure, or GCP)
  • Understanding of data modelling principles and best practices
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines and ETL/ELT processes
  • Connect and integrate data from multiple business systems and third-party sources
  • Ensure data quality, consistency, and reliability across all pipelines
  • Support the development of dashboards, reports, and data products
  • Write clean, well-documented code and follow engineering best practices
  • Collaborate with stakeholders to understand data requirements and translate them into technical solutions
  • Where working as a pair, support and peer-review each other's work to maintain high standards
  • Maintain clear documentation of data models, pipelines, and processes
  • Track and report on data quality metrics and pipeline performance
  • Maintain a professional, collaborative presence across all teams
What we offer
What we offer
  • We invest in training, certifications, and development
  • supportive team
  • flexibility
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Seeking a Data Engineer to build and optimize scalable data pipelines and platfo...
Location
Location
United States , Atlanta, GA
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Platforms: Apache Spark (DataFrames, SQL, RDDs, streaming, tuning, Catalyst/Tungsten)
  • Delta Lake (ACID, MERGE, OPTIMIZE, Z-ORDER, CDC, time travel)
  • Databricks SQL (queries, views, UDFs)
  • Delta Live Tables (DLT), Jobs, Workflows
  • Architecture & Ingestion: Lakehouse (Medallion, partitioning, clustering, data contracts)
  • Auto Loader / Lakeflow (batch & streaming ingestion, CDC)
  • Unity Catalog (governance, access control)
  • Core Data Engineering: Advanced SQL & data modeling (dimensional, Data Vault)
  • ETL/ELT pipelines
  • Data quality & monitoring
Job Responsibility
Job Responsibility
  • Build ETL/ELT pipelines (batch & streaming)
  • Design scalable data architectures (Lakehouse, warehouse)
  • Ensure data quality, governance, and security
  • Optimize performance, cost, and reliability
  • Partner with analytics, BI, and engineering teams
What we offer
What we offer
  • Competitive compensation and benefits
  • Free online training
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for an experienced Data Engineer to join a long-term contract eng...
Location
Location
United States , Centennial
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in data engineering or a closely related technical field
  • Strong programming ability in Python and solid experience developing enterprise-grade ETL and data integration solutions
  • Hands-on expertise with Microsoft Fabric and practical experience working with Synapse Analytics and Azure Data Factory
  • Proven experience using Databricks to build, manage, and optimize large-scale data processing solutions
  • Strong understanding of cloud-based data engineering principles, including pipeline design, orchestration, and performance tuning
  • Experience working with large datasets and distributed processing technologies such as Apache Spark or PySpark
  • Familiarity with modern data platforms and architectures, including lakehouse, data warehouse, or hybrid cloud data environments
Job Responsibility
Job Responsibility
  • Design, develop, and enhance scalable data pipelines to support enterprise reporting, analytics, and AI use cases
  • Transform, cleanse, and organize complex data from multiple sources so it can be used effectively by downstream engineering and machine learning teams
  • Build and maintain robust data workflows in a cloud-based ecosystem using Microsoft Fabric, Synapse Analytics, Azure Data Factory, and Databricks
  • Collaborate with data engineers, ML engineers, and other technical stakeholders to create efficient and dependable data architecture
  • Monitor pipeline performance and resolve issues related to data quality, reliability, and processing efficiency across platforms
  • Orchestrate data ingestion, movement, and transformation processes for large-volume datasets in a backend-focused engineering environment
  • Support AI and machine learning initiatives by delivering well-structured datasets optimized for model development and operational use
  • Contribute to scalable lakehouse or warehouse-oriented data solutions while helping align engineering practices with cloud data best practices
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • enrollment in company 401(k) plan
Read More
Arrow Right
New

Data Engineer

The Data Engineer is accountable for developing high quality data products to su...
Location
Location
United States , Irving
Salary
Salary:
96400.00 - 144600.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
June 20, 2026
Flip Icon
Requirements
Requirements
  • 4+ years experience implementing data-intensive solutions using agile methodologies
  • Experience of modelling data for analytical consumers
  • Hands on Mantas expert throughout the full development life cycle, including: requirements analysis, functional design, technical design, programming, testing, documentation, implementation, and on-going technical support
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • ETL: Hands on experiencing in building data pipelines using Apache Spark
  • Big Data: Hands on experience of working on 'Big Data' platforms such as Hadoop, Hive or Snowflake for data storage and processing
  • Data Warehousing & Database Management: Understanding of Data Warehousing concepts, Relational (Oracle, MSSQL, MySQL) and NoSQL (MongoDB, DynamoDB) database design
  • Data Modeling & Design: Good exposure to data modeling techniques
Job Responsibility
Job Responsibility
  • Developing and supporting scalable, extensible, and highly available data solutions
  • Deliver on critical business priorities while ensuring alignment with the wider architectural vision
  • Identify and help address potential risks in the data supply chain
  • Follow and contribute to technical standards
  • Design and develop analytical data models
  • Considers the business implications of the application of technology to the current business environment
  • identifies and communicates risks and impacts
  • Drives communication between business leaders and IT
  • exhibits sound and comprehensive communication and diplomacy skills to exchange complex information
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
!
Read More
Arrow Right
New

Data Engineer

Location
Location
United Kingdom , Edinburgh
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A basic understanding of IT systems, including operating systems, networks, databases, and cloud fundamentals
  • Experience using scripting languages such as Python, PowerShell, Bash or Groovy to support automation and problem-solving
  • Exposure to troubleshooting approaches, including working with logs, error messages, and monitoring tools, and the ability to break down technical issues and identify possible causes
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right