CrawlJobs Logo
NTT DATA Logo NTT DATA · IT - Software Development

Data Engineer - Fabric Pipelines / Orchestration

India, Delhi · Job Posted June 15, 2026
Apply Position
Job Link Share

Job Description

We are currently seeking a Data Engineer - Fabric Pipelines / Orchestration to join our team in Delhi, Delhi (IN-DL), India (IN). Job Title: Data Engineer – Core Team (Offshore). Program: Symphony. Client: The Coca-Cola Company (TCCC). Engagement Type: Contract. Model: Core Team. Location: Remote. Start Date: ASAP. Duration: Ongoing (Quarterly renewal).

Job Responsibility

  • Migrate Spark Job Definitions from Synapse to Fabric (32)
  • Build Fabric Pipelines
  • Set up Data Orchestration
  • Design, develop, and maintain data pipelines using Scala and SQL on Apache Spark
  • Monitor and support Phase 1 pipelines post go-live
  • Investigate and remediate pipeline failures, data quality issues, and performance bottlenecks
  • Lead refactoring and cleanup of existing Phase 1 code
  • Optimize existing solutions for performance and scalability
  • Build and contribute to reusable patterns and automation frameworks
  • Work within TCCC’s metadata-driven architecture
  • Ensure pipelines are used strictly for scheduling — ETL logic must remain in code
  • Manage code using GitHub version control
  • Contribute to discovery sessions to derive requirements directly from data.

Requirements

  • 8–10 years of hands-on data engineering experience
  • Strong understanding of Apache Spark and its core concepts
  • Proficiency in Scala and/or Java — code-first approach required
  • Advanced SQL skills
  • Experience with Azure Synapse
  • Working knowledge of GitHub for source control
  • Experience with data warehousing and large-scale data integration
  • Must be a hands-on builder
  • Must be available to mobilize immediately.

Nice to have

  • Experience with Microsoft Fabric
  • Background in marketing data or consumer goods analytics
  • Familiarity with metadata-driven architectures.
NTT DATA - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer - Fabric Pipelines / Orchestration

8 matching positions

Data Engineer – Microsoft Fabric & Power BI

We are looking for a Data Engineer with experience in Microsoft Fabric and Power...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
rightanglesol.com Logo
Right Angle Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BE/BS/MTech/MS or equivalent work experience
  • 5+ Years
  • 2+ years of experience working with Microsoft Fabric, Azure Synapse, or Azure Data Factory
  • Practical experience building solutions with OneLake, Lakehouse, Delta Lake, and Fabric Pipelines or Dataflows Gen2
  • Strong proficiency in SQL and PySpark / Spark SQL
  • Proven experience implementing medallion architecture and dimensional data modeling
Job Responsibility
Job Responsibility
  • Design and develop Fabric Pipelines for automated ingestion from APIs, files into OneLake
  • Implement medallion architecture (Bronze → Silver → Gold) using Fabric Lakehouses and Warehouses, applying Delta Lake best practices, partitioning, and incremental load patterns
  • Build dimensional (star schema) models in the Gold layer aligned to Student, Finance, HR, Learning, and Advising domains
  • Develop and maintain the master orchestration framework, including dependency management, retry logic, error handling, and scheduled execution windows
  • Implement data quality checks, validation rules, and reconciliation logic across layers
  • support certification of enterprise KPIs
  • Configure Row-Level Security (RLS) and Object-Level Security (OLS) in collaboration with the BI and security teams
  • Integrate with Microsoft Purview for metadata capture, lineage, classification, and business glossary alignment
  • Support deployment pipelines across Dev → Test → Prod Fabric workspaces, including CI/CD via Git integration
  • Collaborate with NWTC technical data stewards during sprint ceremonies, UAT, and hypercare
  • Fulltime
Read More
Arrow Right

Data Engineer with Azure Fabric

The Data Engineer will focus on developing scalable, high-performance data proce...
Location
Location
Romania , Cluj
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 3–8 years in data engineering, data warehousing, or data architecture roles
  • At least 3+ years working with Fabric
  • BSc/MSc in Computer Science, Data Engineering, or related field
  • Proven experience in data engineering and pipeline development on Fabric, Azure and cloud-native platforms
  • Familiarity with Fabric Workflows and other orchestration tools
  • Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent
  • Strong SQL and Python (or equivalent language) skills for data manipulation and automation
  • Exposure to AI/ML workloads desirable
  • Proficiency in cloud ecosystems (Specifically Azure, optionally AWS and GCP are an advantage) and infrastructure-as-code (e.g., Terraform)
  • Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon)
Job Responsibility
Job Responsibility
  • Client Engagement & Delivery
  • Data Pipeline Development (Batch and Streaming)
  • Fabric and Azure Architectures
  • Data Modelling & Optimisation
  • Collaboration & Best Practices
  • Quality, Governance & Security
  • Client stakeholders up to Head of Data Engineering, Chief Data Architect, and Analytics leadership
  • Delivery of high-performing, scalable, and secure data pipelines aligned to client requirements
  • High client satisfaction and successful adoption of Fabric and Azure based solutions
  • Improve data engineering practices
What we offer
What we offer
  • Smooth integration and a supportive mentor
  • Pick your working style: choose from Remote, Hybrid or Office work opportunities
  • Projects have different working hours to suit your needs
  • Sponsored certifications, trainings and top e-learning platforms
  • Private Health Insurance
  • Individual coaching sessions or joining our accredited Coaching School
  • Epic parties or themed events
Read More
Arrow Right

Data Engineer (Enterprise Data & Intelligence)

As a Data Engineer on the Enterprise Data & Intelligence team, you will design, ...
Location
Location
Bulgaria , Sofia
Salary
Salary:
Not provided
hotschedules.com Logo
HotSchedules Corporate
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years in data engineering or a closely related role
  • Bachelor's degree in Computer Science, Data Engineering, or a related field
  • Strong T-SQL skills and working proficiency in PySpark or Python for data processing
  • Hands-on experience with MS Azure Storage Explorer and SSMS
  • Hands-on experience with cloud-based data engineering services and orchestration tools (e.g., Azure Data Factory, Microsoft Fabric)
  • Practical experience building ETL/ELT pipelines and dimensional or analytical data models
  • Familiarity with CI/CD practices in data engineering, including version control (Git) and automated testing
  • Active use of AI productivity tools (e.g., ChatGPT, Claude, Copilot, Cursor) as an integrated part of development, testing, documentation, and day-to-day engineering workflows
  • Ability to work collaboratively with both technical and non-technical stakeholders
  • Good documentation habits and a willingness to communicate technical concepts clearly
Job Responsibility
Job Responsibility
  • Design, build, and maintain the data pipelines and models that underpin Fourth’s single source of truth
  • Gather and translate business requirements into reliable, well-tested data solutions on our Azure-based cloud platform
  • Collaborate closely with analytics engineers and business stakeholders to scope, prioritise, and deliver data products that serve FP&A, Commercial, Product, and AI teams
  • Build, maintain, and optimise scalable ETL/ELT pipelines (batch and near-real-time) on Azure Data Cloud Platform
  • Develop and refine data models to support BI reporting, analytics, and ML/AI use cases
  • Write efficient, well-documented T-SQL and PySpark code following team coding standards
  • Implement automated testing, data validation, and monitoring (SLAs, alerts) to ensure pipeline reliability
  • Contribute to data governance practices, including lineage tracking, metadata management, and quality controls
  • Support CI/CD pipelines for data assets, ensuring version control and reproducibility
  • Partner with Analytics Engineers to scope, refine, and prioritise data requirements from business stakeholders
What we offer
What we offer
  • 25+ days off, as well as birthday day off and 4 charity days off per year
  • Flexible start and end of the working day and hybrid working mode, including a combination remote and in the office
  • Team-centric atmosphere
  • Encouraging healthy lifestyle and work-life balance including supplemental health insurance
  • New parents bonus scheme
  • Fulltime
Read More
Arrow Right

Technical Support Engineer - Azure Data Factory / Data Integration

Within CE&S, the Customer Service & Support (CSS) organization builds trust and ...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology (IT), or related field AND 1+ years of technical support, technical consulting experience, or information technology experience
  • OR 3+ years of technical support, technical consulting experience, or information technology experience
  • OR equivalent experience
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics / Microsoft Fabric Pipeline
  • Data Lake
  • Relational Database Management System (Microsoft SQL Server / Oracle Database / MySQL / IBM Db2 / SAP)
  • Big Data or Analytics Products (Spark / Azure HDInsight / Azure Data Lake Analytics / Azure Synapse Analytics / Databricks / Google BigQuery)
  • Pipeline and ETL/ELT Skills
  • Building and orchestrating pipelines (ADF / Synapse / Fabric)
Job Responsibility
Job Responsibility
  • Response and Resolution: You own, investigate and solve customer technical issues. You collaborate within and across teams, leveraging troubleshooting tools and practices
  • Readiness: You lead or participate in building communities with peer delivery roles and, where appropriate, share your knowledge
  • You develop specific technical and professional proficiency to enable you to resolve customer issues, through training and readiness
  • Product/Process Improvement: You identify potential product defects and escalate appropriately to resolve, contributing to Microsoft product improvements
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, build, and opt...
Location
Location
Kosovo
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake
  • strong programming skills in Python and SQL
  • Proven experience building batch and streaming data pipelines and production-grade data platforms
  • solid understanding of data modeling, data quality, and governance principles
  • Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP
  • Familiarity with modern data platforms such as Databricks and Snowflake
  • Experience with lakehouse architectures and distributed data systems
  • strong understanding of scalability, reliability, and performance considerations in data pipelines
  • Strong problem-solving skills focused on scalability and reliability
  • collaborative approach to working in cross-functional teams
Job Responsibility
Job Responsibility
  • Design and implement scalable data platforms and pipelines across cloud environments (Azure/Fabric, AWS, GCP, Databricks, Snowflake)
  • developing reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
  • building ingestion, transformation, and curation workflows for both structured and unstructured data
  • implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold)
  • deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems
  • enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows)
  • design scalable logical and physical data models for analytical and operational use cases
  • orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents
  • apply modern architecture patterns including event-driven and streaming architectures
  • ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC)
What we offer
What we offer
  • Health insurance that guarantees fast access to contracted health services
  • Vacation Plan
  • Subsidy for study materials, trainings, conferences and events that will contribute to your development
  • Hybrid Working model
  • Performance Evaluation Process that paves the roadmap for a personal and professional career development
  • Refreshments and fruit in the office
  • Team gatherings and parties organized and subsidized by the company
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a real estate and property organizati...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Microsoft Fabric and/or Azure Data Factory, including building and optimizing pipelines
  • Proven background working with Azure data services and cloud-based data architecture
  • Advanced experience with data modeling, complex querying, and performance tuning in enterprise data platforms
  • Solid programming skills in Python, Java, Scala, or a comparable language used in data engineering
  • Experience with ETL development, relational databases, and data warehousing concepts
  • Familiarity with technologies such as Apache Spark, Hadoop, or Kafka in support of large-scale data processing
  • Ability to work effectively as an individual contributor in a lean team environment with high accountability
  • Exposure to Power BI or Tableau, along with the ability to align technical solutions with business needs
Job Responsibility
Job Responsibility
  • Design, build, and enhance end-to-end data pipelines using Microsoft Fabric and/or Azure Data Factory for production use
  • Manage and improve the data environment with a strong ownership mindset, ensuring performance, reliability, and maintainability
  • Integrate data from varied sources such as APIs, databases, and flat files into structured, usable datasets
  • Develop data models and schema designs that support reporting, analytics, and downstream business needs
  • Monitor data quality and implement validation checks, troubleshooting issues through root cause analysis and continuous optimization
  • Create scalable cloud-based data solutions within Azure that support long-term operational and analytical goals
  • Partner with cross-functional stakeholders to translate business questions into practical data engineering solutions
  • Contribute to orchestration, automation, and ongoing support of data workflows using modern engineering tools and programming languages
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, build, and opt...
Location
Location
Poland
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake, and strong programming skills in Python and SQL. Proven experience building batch and streaming data pipelines and production-grade data platforms, with solid understanding of data modeling, data quality, and governance principles. Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP. Familiarity with modern data platforms such as Databricks and Snowflake is expected. Experience with lakehouse architectures and distributed data systems, and strong understanding of scalability, reliability, and performance considerations in data pipelines. Strong problem-solving skills focused on scalability and reliability, with a collaborative approach to working in cross-functional teams.
Job Responsibility
Job Responsibility
  • Design and implement scalable data platforms and pipelines across cloud environments
  • develop reliable batch, streaming, and near-real-time pipelines
  • implement modern data architectures including lakehouse patterns and medallion layering
  • deliver high-quality datasets supporting analytics, machine learning, causal modeling, and optimization systems
  • enable data pipelines for GenAI use cases
  • design scalable logical and physical data models
  • orchestrate workflows using tools such as Airflow, dbt, Lakeflow
  • apply modern architecture patterns including event-driven and streaming architectures
  • ensure adherence to best practices in data governance, lineage, quality, and access control
  • establish strong data observability
What we offer
What we offer
  • 24 working days of paid vacation
  • National holidays covered
  • Sick leave (up to 20/year)
  • Unpaid leave (up to 20/year)
  • Medical insurance
  • Multisport card OR Multikafeteria
  • Maternity & paternity leave support
  • Internal workshops & learning initiatives
  • Professional certifications reimbursement
  • Participation in professional local & global communities
  • Fulltime
Read More
Arrow Right

Sr Data Engineer

As a Senior Data Engineer at Amgen, you will be responsible for managing and opt...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master's degree with 8 - 13 years of experience in Computer Science, IT or related field
  • Hands-on experience in data engineering technologies such as Databricks, PySpark, SparkSQL Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies
  • Proficiency in workflow orchestration, performance tuning on big data processing
  • Strong understanding of AWS services
  • Experience with Data Fabric, Data Mesh, or similar enterprise-wide data architectures
  • Ability to quickly learn, adapt and apply new technologies
  • Strong problem-solving and analytical skills
  • Excellent communication and teamwork skills
  • Experience with Scaled Agile Framework (SAFe), Agile delivery practices, and DevOps practices
  • Excellent analytical and troubleshooting skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable ETL/ELT pipelines to support structured, semi-structured, and unstructured data processing across the Enterprise Data Engineering for Biotech or Pharma functional knowledge of R&D
  • Implement real-time and batch data processing solutions, integrating data from multiple sources into a unified, governed data fabric architecture
  • Optimize big data processing frameworks using Apache Spark, Hadoop, or similar distributed computing technologies to ensure high availability and cost efficiency
  • Work with metadata management and data lineage tracking tools to enable enterprise-wide data discovery and governance
  • Ensure data security, compliance, and role-based access control (RBAC) across data environments
  • Optimize query performance, indexing strategies, partitioning, and caching for large-scale data sets
  • Develop CI/CD pipelines for automated data pipeline deployments, version control, and monitoring
  • Implement data virtualization techniques to provide seamless access to data across multiple storage systems
  • Collaborate with cross-functional teams, including data architects, business analysts, and DevOps teams, to align data engineering strategies with enterprise goals
  • Stay up to date with emerging data technologies and best practices, ensuring continuous improvement of Enterprise Data Fabric architectures
  • Fulltime
Read More
Arrow Right