CrawlJobs Logo
Miracle Software Systems Logo Miracle Software Systems · IT - Software Development

Azure Data Factory Developer

India, Miracle Heights · Job Posted May 29, 2026
Apply Position
Job Link Share

Job Description

Design, develop, and maintain cloud-based ETL and ELT pipelines using Azure Data Factory for enterprise data integration needs. Build scalable data ingestion workflows to move data from hybrid sources including on-premise systems, Azure SQL, and cloud platforms into data lakes and warehouses. Develop and manage ADF pipelines, triggers, integration runtimes, and mapping data flows to support automated processing. Implement orchestration and scheduling mechanisms for event-driven and recurring data workflows. Perform data transformation and cleansing using ADF Data Flows to prepare structured datasets for reporting and analytics. Write and optimize SQL queries for data extraction, transformation, validation, and performance improvement. Utilize Python and PySpark for advanced processing, automation, and data engineering requirements. Monitor pipeline execution, troubleshoot failures, and ensure reliability, scalability, and operational efficiency of data systems. Collaborate with analytics, BI, and engineering teams to deliver high-quality and business-ready data solutions.

Job Responsibility

  • Design, develop, and maintain cloud-based ETL and ELT pipelines using Azure Data Factory for enterprise data integration needs
  • Build scalable data ingestion workflows to move data from hybrid sources including on-premise systems, Azure SQL, and cloud platforms into data lakes and warehouses
  • Develop and manage ADF pipelines, triggers, integration runtimes, and mapping data flows to support automated processing
  • Implement orchestration and scheduling mechanisms for event-driven and recurring data workflows
  • Perform data transformation and cleansing using ADF Data Flows to prepare structured datasets for reporting and analytics
  • Write and optimize SQL queries for data extraction, transformation, validation, and performance improvement
  • Utilize Python and PySpark for advanced processing, automation, and data engineering requirements
  • Monitor pipeline execution, troubleshoot failures, and ensure reliability, scalability, and operational efficiency of data systems
  • Collaborate with analytics, BI, and engineering teams to deliver high-quality and business-ready data solutions

Requirements

  • Azure Data Factory
  • Azure SQL
  • SQL
  • Python
  • Pyspark
Miracle Software Systems - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Azure Data Factory Developer

8 matching positions

Integration Developer / Data Engineer

We are looking for an experienced Integration Developer / Data Engineer to desig...
Location
Location
Poland , Wroclaw
Salary
Salary:
Not provided
eviden.com Logo
Eviden
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience with MS SQL (T-SQL, query optimization)
  • Knowledge of Microsoft Dataverse and Dynamics 365 Sales CRM
  • Hands-on experience with Azure Data Factory
  • Strong understanding of ETL process design
  • English – professional working proficiency
Job Responsibility
Job Responsibility
  • Design and implement integration processes (MS SQL → Dataverse / D365 Sales CRM)
  • Develop and optimize pipelines in Azure Data Factory
  • Analyze business and technical requirements
  • Monitor and maintain ETL processes
  • Collaborate with development and analytics teams
  • Parttime
Read More
Arrow Right

Azure Data Engineer

At LeverX, we have had the privilege of delivering over 1,500 projects for vario...
Location
Location
Uzbekistan, Georgia
Salary
Salary:
Not provided
leverx.com Logo
LeverX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience as a Data Engineer with strong expertise in Azure services (e.g., Azure Data Factory, Azure SQL Database, Azure Synapse, Microsoft Fabric, and Azure Cosmos DB
  • Advanced SQL skills, including complex query development, optimization, and troubleshooting
  • Strong knowledge of indexing, partitioning, and query execution plans to ensure scalability and performance
  • Proven expertise in database modeling, schema design, and normalization/denormalization strategies
  • Ability to design and optimize data architectures to support both transactional and analytical workloads
  • Proficiency in at least one programming language such as Python, C#, or Scala
  • Strong background in cloud-based data storage and processing (e.g., Azure Data Lake, Databricks, or equivalent) and data warehouse platforms (e.g., Snowflake)
  • English B2+
Job Responsibility
Job Responsibility
  • Design, develop, and maintain efficient and scalable data architectures and workflows
  • Build and optimize SQL-based solutions for data transformation, extraction, and loading (ETL) processes
  • Collaborate closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver effective solutions
  • Manage and optimize data storage platforms, including databases, data lakes, and data warehouses
  • Troubleshoot and resolve data-related issues, ensuring accuracy, integrity, and performance across all systems
What we offer
What we offer
  • Projects in different domains: healthcare, manufacturing, e-commerce, fintech, etc
  • Projects for every taste: Startup products, enterprise solutions, research & development initiatives, and projects at the crossroads of SAP and the latest web technologies
  • Global clients based in Europe and the US, including Fortune 500 companies
  • Employment security: We hire for our team, not just a specific project. If your project ends, we will find you a new one
  • Healthy work atmosphere: On average, our employees stay with the company for 4+ years
  • Market-based compensation and regular performance reviews
  • Internal expert communities and courses
  • Perks to support your growth and well-being
Read More
Arrow Right

Data Science Developer

Data Science Developer - Deliverables. The candidates will perform Data Science ...
Location
Location
Canada , Toronto
Salary
Salary:
Not provided
nspritsolutions.com Logo
NSPR IT Services & Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience with Azure Storage, Azure Data Lake, Azure Databricks Lakehouse, and Azure Synapse structures
  • Experience with Python, Databricks and Azure Data Factory
  • Power BI reports and dashboards
Job Responsibility
Job Responsibility
  • Creating, enhancing, maintaining, and supporting structures for storage of data in formats that are suitable for consumption in analytics solutions
  • Automation of data pipelines used to ingest, prepare, transform, and model data for use in analytics products
  • Creating, enhancing, maintaining, and supporting dashboards and reports
  • Creating, enhancing, maintaining, and supporting analytics environments and implementing new technology to improve performance, simplify architecture patterns, and reduce cloud hosting costs
  • Knowledge transfer sessions and documentation for technical staff related to architecting, designing, and implementing continuous improvement enhancements to analytics solutions
Read More
Arrow Right

Azure Data Engineer

Join AlgebraIT, a premier IT consulting firm in Austin, Texas! We are looking fo...
Location
Location
United States , Austin
Salary
Salary:
Not provided
algebrait.com Logo
AlgebraIT
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 3 years of relevant experience
  • Bachelor’s degree in Computer Science or a related field
  • 3+ years of experience in data engineering
  • Proficiency in Azure services (e.g., Data Lake, Databricks, Synapse)
  • Strong knowledge of Python, SQL, and data modeling
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data pipelines using Azure Data Factory and other Azure services
  • Collaborate with data scientists and analysts to support data initiatives
  • Ensure the reliability, availability, and performance of the data infrastructure
  • Optimize data flow and pipeline architecture
  • Implement best practices for data security and governance
  • Monitor data pipelines and troubleshoot issues as needed
  • Develop and maintain data integration solutions
  • Document data processes and workflows
  • Stay up-to-date with Azure technology advancements
  • Provide support for data-related technical issues
  • Fulltime
Read More
Arrow Right

Azure Data Engineer

As an Azure Data Engineer, you will be expected to design, implement, and manage...
Location
Location
India , Hyderabad / Bangalore
Salary
Salary:
Not provided
quadranttechnologies.com Logo
Quadrant Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Technology, or a related field
  • Hands-on experience in writing complex T-SQL queries and stored procedures
  • Good experience in data integration and database development
  • Proficiency in T-SQL and Spark SQL/PySpark. (Synapse/ Databricks)
  • Extensive experience with Azure Data Factory
  • Excellent problem-solving skills and attention to detail
  • 5 – 8 years experience
  • Proven track record of writing complex SQL stored procedures with implementing OTLP database solutions (using Microsoft SQL Server)
  • Experience with Azure Synapse / PySpark / Azure Databricks for big data processing
  • Expertise in T-SQL, Dynamic SQL, Spark SQL, and ability to write complex stored procedures
Job Responsibility
Job Responsibility
  • Collaborate with cross-functional teams to gather, analyze, and document business requirements for data integration projects
  • Write complex stored procedures to support data transformation and to implement business validation logic
  • Develop and maintain robust data pipelines using Azure Data Factory ensuring seamless data flow between systems
  • Work closely with the team to ensure data quality, integrity, and accuracy across all systems
  • Contribute to the enhancement and optimization of OLTP systems
  • Fulltime
Read More
Arrow Right

Azure Data Engineer

Experience: 3-6+ Years Location: Noida/Gurugram/Remote Skills: PYTHON, PYSPARK...
Location
Location
India , Noida; Gurugram
Salary
Salary:
Not provided
nexgentechsolutions.com Logo
NexGen Tech Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3-6+ Years experience
  • PYTHON
  • PYSPARK
  • SQL
  • AZURE DATA FACTORY
  • DATABRICKS
  • DATA LAKE
  • AZURE FUNCTION
  • DATA PIPELINE
Job Responsibility
Job Responsibility
  • Design and engineer the cloud/big data solutions, develop a modern data analytics lake
  • Develop & maintain data pipelines for batch & stream processing using modern cloud or open source ETL/ELT tools
  • Liaise with business team and technical leads, gather requirements, identify data sources, identify data quality issues, design target data structures, develop pipelines and data processing routines, perform unit testing and support UAT
  • Implement continuous integration, continuous deployment, DevOps practice
  • Create, document, and manage data guidelines, governance, and lineage metrics
  • Technically lead, design and develop distributed, high-throughput, low-latency, highly available data processing and data systems
  • Build monitoring tools for server-side components
  • work cohesively in India-wide distributed team
  • Identify, design, and implement internal process improvements and tools to automate data processing and ensure data integrity while meeting data security standards
  • Build tools for better discovery and consumption of data for various consumption models in the organization – DataMarts, Warehouses, APIs, Ad Hoc Data explorations
  • Fulltime
Read More
Arrow Right

Azure Data Engineer

Job Description: Designs, modifies, and builds new and scalable data processes. ...
Location
Location
United States , Kennesaw
Salary
Salary:
Not provided
cpctechno.com Logo
CPC Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6 - 8 years’ of experience on developing data solutions in Python using Spark framework
  • Ability to perform root cause analysis and identify performance bottlenecks in Spark Jobs
  • Expert in Data Engineering and building data pipelines, implementing Algorithms in a distributed environment
  • Ability to design and develop parallel processing data platform in PySpark
  • Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
  • Strong Proficiency in SQL
  • Cloud knowledge especially Azure
  • Collaborates with stakeholders, IT, database engineers and other scientists
  • Hands-on knowledge in Azure Synapse and Azure Data Factory is a plus
Job Responsibility
Job Responsibility
  • Designs, modifies, and builds new and scalable data processes
  • Fulltime
Read More
Arrow Right

Azure Data Engineer

As an Azure Data Engineer, you will design and maintain scalable data pipelines ...
Location
Location
Salary
Salary:
Not provided
aciinfotech.com Logo
ACI Infotech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3–5 years of experience as a Data Engineer with Azure ecosystem
  • Strong skills in SQL, Databricks, and Python
  • Hands-on experience with Azure Data Factory (ADF)
  • Power BI experience preferred
  • Familiarity with Delta Lake and/or Azure Synapse is a plus
Job Responsibility
Job Responsibility
  • Develop, manage, and optimize ADF pipelines
  • Design and implement Databricks notebooks for ETL processes
  • Write and optimize SQL scripts for large-scale datasets
  • Collaborate with BI teams to support dashboard and reporting solutions
  • Ensure data quality, security, and compliance with governance policies
  • Fulltime
Read More
Arrow Right