CrawlJobs Logo

Data Engineering Architect

India · Job Posted December 10, 2025
Apply Position
Job Link Share

Job Description

Data engineering involves the development of solutions for the collection, transformation, storage and management of data to support data-driven decision making and enable efficient data analysis by end users. It focuses on the technical aspects of data processing, integration, and delivery to ensure that data is accurate, reliable, and accessible in a timely manner. It also focuses on the scalability, cost-effectiveness, security, and supportability of the solution. Data engineering encompasses multiple toolsets and architectural concepts across on-premises and cloud stacks, including but not limited to data warehousing, data lakes, lake house, data mesh, and includes extraction, ingestion, and synchronization of structured and unstructured data across the data ecosystem. It also includes processing organization and orchestration, as well as performance optimization of data processing.

Job Responsibility

  • Collaborate with stakeholders to understand business requirements and translate them into data engineering solutions
  • Design and oversee the overall data architecture and infrastructure, ensuring scalability, performance, security, maintainability, and adherence to industry best practices
  • Define data models and data schemas to meet business needs, considering factors such as data volume, velocity, variety, and veracity
  • Select and integrate appropriate data technologies and tools, such as databases, data lakes, data warehouses, and big data frameworks, to support data processing and analysis
  • Create scalable and efficient data processing frameworks, including ETL (Extract, Transform, Load) processes, data pipelines, and data integration solutions
  • Ensure that data engineering solutions align with the organization's long-term data strategy and goals
  • Evaluate and recommend data governance strategies and practices, including data privacy, security, and compliance measures
  • Collaborate with data scientists, analysts, and other stakeholders to define data requirements and enable effective data analysis and reporting
  • Provide technical guidance and expertise to data engineering teams, promoting best practices and ensuring high-quality deliverables
  • Support to team throughout the implementation process, answering questions and addressing issues as they arise
  • Oversee the implementation of the solution, ensuring that it is implemented according to the design documents and technical specifications
  • Stay updated with emerging trends and technologies in data engineering, recommending and implementing innovative solutions as appropriate
  • Conduct performance analysis and optimization of data engineering systems, identifying and resolving bottlenecks and inefficiencies
  • Ensure data quality and integrity throughout the data engineering processes, implementing appropriate validation and monitoring mechanisms
  • Collaborate with cross-functional teams to integrate data engineering solutions with other systems and applications
  • Participate in project planning and estimation, providing technical insights and recommendations
  • Document data architecture, infrastructure, and design decisions, ensuring clear and up-to-date documentation for implementation, reference and knowledge sharing

Requirements

  • 10+ years’ experience in the Data & Analytics area
  • 4+ years’ experience into Data Engineering Architecture
  • Proficiency in Python, PySpark, SQL
  • Strong expertise in Azure cloud services such as: ADF, databricks, pyspark, Logic app
  • Strong understanding of data engineering concepts, including data modeling, ETL processes, data pipelines, and data governance
  • Expertise in designing and implementing scalable and efficient data processing frameworks
  • In-depth knowledge of various data technologies and tools, such as relational databases, NoSQL databases, data lakes, data warehouses, and big data frameworks (e.g., Hadoop, Spark)
  • Experience in selecting and integrating appropriate technologies to meet business requirements and long-term data strategy
  • Ability to work closely with stakeholders to understand business needs and translate them into data engineering solutions
  • Strong analytical and problem-solving skills, with the ability to identify and address complex data engineering challenges
  • Experience in designing and implementing data solutions in a cloud environment
  • Knowledge of data governance principles and best practices, including data privacy and security regulations
  • Excellent communication and collaboration skills, with the ability to effectively communicate technical concepts to non-technical stakeholders
  • Experience in leading and mentoring data engineering teams, providing guidance and technical expertise
  • Familiarity with agile methodologies and experience in working in agile development environments
  • Continuous learning mindset, staying updated with the latest advancements and trends in data engineering and related technologies
  • Strong project management skills, with the ability to prioritize tasks, manage timelines, and deliver high-quality results within designated deadlines
  • Strong understanding of distributed computing principles, including parallel processing, data partitioning, and fault-tolerance

Nice to have

  • Bachelor’s degree in computer science, Information Technology, or a related field
  • A master’s degree may be preferred
  • Having multi cloud experience (Azure, GCP & AWS)

What we offer

  • Stable employment
  • “Office as an option” model
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Internal Gallup Certified Strengths Coach to support your growth
  • Grow as we grow as a company
  • A diverse, inclusive, and values-driven community
  • Autonomy to choose the way you work
  • Create our community together
  • Activities to support your well-being and health
  • Plenty of opportunities to donate to charities and support the environment
  • Modern office equipment

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineering Architect

8 matching positions

Data Engineering Architect

Location
Location
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 11+ years of professional experience in the Data & Analytics area
  • 5+ years of experience in the Senior Consultant role with a strong focus on Azure data solutions
  • Advanced knowledge and understanding of architecture, application design, systems engineering, and integration
  • Very good knowledge of cloud data services, data warehousing, big data technologies, and data lakes
  • Expertise in data modeling, data integration, and ETL processes
  • Proven experience in using of Microsoft ETL tools (Azure Databricks, Azure Data Factory, Data Lake and SSIS)
  • Programming skills for data analysis (especially PySpark, SparkSQL, Python, SQL)
  • Familiarity with data governance, data security, and compliance standards
  • Familiarity with agile methodologies and the ability to apply DevOps and DataOps principles to data pipelines
  • Ability to use ARM templates
Job Responsibility
Job Responsibility
  • Acting as a Senior Consultant/Solution Advisor
  • Technology partner: Advise on designing data architectures in Microsoft Azure
  • Empowering customer to spot and leverage business opportunities by unlocking the power of data
  • Providing technical and problem-solving expertise for client representatives and Lingaro project teams
  • Data Integration: Lead data integration efforts, including ETL processes, to ensure seamless data flow
  • Cloud Services Utilization: Leverage Azure, as well as tools like dbt and Databricks, for efficient data pipelines and analytics solutions
  • Advise on security measures and compliance standards in cloud environments
  • Continuously monitor and optimize data solutions for cost-efficiency
  • Data Governance: Advise data governance and quality standards
  • Collaboration: Work with cross-functional teams to understand requirements and provide data solutions
What we offer
What we offer
  • Stable employment
  • “Office as an option” model
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs
  • Upskilling support
  • Internal Gallup Certified Strengths Coach to support your growth
  • Grow as we grow as a company
Read More
Arrow Right

Senior Data Engineering Architect

Location
Location
Poland
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven work experience as a Data Engineering Architect or a similar role and strong experience in in the Data & Analytics area
  • Strong understanding of data engineering concepts, including data modeling, ETL processes, data pipelines, and data governance
  • Expertise in designing and implementing scalable and efficient data processing frameworks
  • In-depth knowledge of various data technologies and tools, such as relational databases, NoSQL databases, data lakes, data warehouses, and big data frameworks (e.g., Hadoop, Spark)
  • Experience in selecting and integrating appropriate technologies to meet business requirements and long-term data strategy
  • Ability to work closely with stakeholders to understand business needs and translate them into data engineering solutions
  • Strong analytical and problem-solving skills, with the ability to identify and address complex data engineering challenges
  • Proficiency in Python, PySpark, SQL
  • Familiarity with cloud platforms and services, such as AWS, GCP, or Azure, and experience in designing and implementing data solutions in a cloud environment
  • Knowledge of data governance principles and best practices, including data privacy and security regulations
Job Responsibility
Job Responsibility
  • Collaborate with stakeholders to understand business requirements and translate them into data engineering solutions
  • Design and oversee the overall data architecture and infrastructure, ensuring scalability, performance, security, maintainability, and adherence to industry best practices
  • Define data models and data schemas to meet business needs, considering factors such as data volume, velocity, variety, and veracity
  • Select and integrate appropriate data technologies and tools, such as databases, data lakes, data warehouses, and big data frameworks, to support data processing and analysis
  • Create scalable and efficient data processing frameworks, including ETL (Extract, Transform, Load) processes, data pipelines, and data integration solutions
  • Ensure that data engineering solutions align with the organization's long-term data strategy and goals
  • Evaluate and recommend data governance strategies and practices, including data privacy, security, and compliance measures
  • Collaborate with data scientists, analysts, and other stakeholders to define data requirements and enable effective data analysis and reporting
  • Provide technical guidance and expertise to data engineering teams, promoting best practices and ensuring high-quality deliverables. Support to team throughout the implementation process, answering questions and addressing issues as they arise
  • Oversee the implementation of the solution, ensuring that it is implemented according to the design documents and technical specifications
What we offer
What we offer
  • Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites
  • Workation. Enjoy working from inspiring locations in line with our workation policy
  • Great Place to Work® certified employer
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs. Lingarians earn 500+ technology certificates yearly
  • Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly
  • Grow as we grow as a company. 76% of our managers are internal promotions
Read More
Arrow Right

Director, Data Architect and Engineering

The Director, Data Architect and Engineering leads technical strategy of data an...
Location
Location
China , Shanghai
Salary
Salary:
Not provided
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in big data platform management, data engineering
  • Proven leadership in cross-functional environments and large-scale transformation, focusing on delivery business value
  • Bachelor or above degree in Computer Science, Engineering, Data Science, Analytics or a related field
  • Hands-on experience with Data/AI engineering work
  • Strong knowledge of data architecture, data governance, and MLOps best practices
  • Familiarity with big data technology, especially cloud-native platform (e.g. Alicloud, Snowflake, Databricks, etc.)
  • Strong analytical, strategic planning, and project management skills
Job Responsibility
Job Responsibility
  • Define technical strategy, direction, and roadmap for data architecture and engineering
  • Lead and provide hands-on support to end-to-end lifecycle of GC Marriott’s data platform, including architecture design, technical roadmap development, implementation, and continuous optimization
  • Lead, mentor, and coach a team of Data/AI Engineers, fostering a culture of continuous learning, innovation, and accountability
  • Build and maintain strong, collaborative relationships with key technical stakeholders (GC/HQ), third-party vendors, industry partners, and core business teams
  • Oversee the development, implementation, and refinement of GC data governance framework
  • Provide technical oversight for data engineering and AI initiatives, ensuring alignment with architecture standards and business objectives
  • Drive the delivery of business value through data initiatives, measuring the impact of data products and tools on key business metrics
  • Stay abreast of emerging trends, technologies, and best practices in data & AI
  • Fulltime
Read More
Arrow Right

Director, Data Architect and Engineering

The Director, Data Architect and Engineering leads technical strategy of data an...
Location
Location
China , Shanghai
Salary
Salary:
Not provided
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in big data platform management, data engineering
  • Proven leadership in cross-functional environments and large-scale transformation, focusing on delivery business value
  • Bachelor or above degree in Computer Science, Engineering, Data Science, Analytics or a related field
  • Hands-on experience with Data/AI engineering work
  • Strong knowledge of data architecture, data governance, and MLOps best practices
  • Familiarity with big data technology, especially cloud-native platform (e.g. Alicloud, Snowflake, Databricks, etc.)
  • Strong analytical, strategic planning, and project management skills
Job Responsibility
Job Responsibility
  • Define technical strategy, direction, and roadmap for data architecture and engineering
  • Lead and provide hands-on support to end-to-end lifecycle of GC Marriott’s data platform, including architecture design, technical roadmap development, implementation, and continuous optimization
  • Lead, mentor, and coach a team of Data/AI Engineers, fostering a culture of continuous learning, innovation, and accountability
  • Build and maintain strong, collaborative relationships with key technical stakeholders (GC/HQ), third-party vendors, industry partners, and core business teams
  • Oversee the development, implementation, and refinement of GC data governance framework
  • Provide technical oversight for data engineering and AI initiatives, ensuring alignment with architecture standards and business objectives
  • Drive the delivery of business value through data initiatives, measuring the impact of data products and tools on key business metrics
  • Stay abreast of emerging trends, technologies, and best practices in data & AI
  • Fulltime
Read More
Arrow Right

Design Project Lead and Architect, Data Center Design, Engineering, and Construction

Meta is seeking a Design Project Lead and Architect experienced in the design an...
Location
Location
United States , Denver, CO +4 locations
Salary
Salary:
150000.00 - 209000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of professional experience in mission critical building design, construction and/or operations
  • Registered Architect, or equivalent licensure in Civil or Structural Engineering
  • Experience on large scale design and construction projects
  • Experience with industry standards, building codes and safety standards
  • Experience with Google Suite, Revit/BIM, Bluebeam, Autodesk, ACC, or similar design software applications
  • Project Management experience
  • Knowledge depth (SME) of building systems design and architectural details for steel, concrete, and mass timber structures
  • Knowledge in geotechnical/soils design, concrete and steel structural design, landscape architecture, sustainable design, interior/exterior finish systems, and design of culinary and physical security systems
  • Knowledge of mission critical building systems, including mechanical, electrical, controls, and fire protection systems
  • Knowledge of industry standards, building codes, and safety standards including IBC, ASCE, and European equivalents
Job Responsibility
Job Responsibility
  • Lead multiple projects through schematic design, design development, construction documents, construction administration and turn-over as Project Lead and technical domain lead for the Civil, Structural, Landscape, Architecture (CSLA) disciplines on new builds (greenfield), leased facilities, and retrofit projects
  • Lead end-to-end project planning including requirements gathering, defining scope, identifying key milestones, and allocating resources. Serve as the primary technical liaison between business stakeholders and design engineering teams
  • Set clear goals and expectations for teams, regularly tracking progress and communicating status updates to stakeholders. Ensure all project decisions support Meta’s broader organizational goals and technical vision
  • Facilitate regular project meetings, retrospectives, and reviews to drive transparency and continuous improvement
  • Collaborate with internal cross-functional stakeholders and external partners in resolving issues and leading risk mitigation strategies ensuring on-time and budget delivery of capacity with focus on safety, quality, operability and sustainability
  • Prepare and issue Request for Proposals (RFP), analyze and make award recommendations, manage and administer project/program level contracts, review/approve change cost proposals, value engineering proposals, invoices, shop drawings, submittals, requests for information, reports/audits/studies and other design related deliverables
  • Hold EoR teams accountable on deliverables and performance by providing actionable feedback, including from other stakeholders such as Construction Management and by participating in the project health reviews. Proactively identify risks and remove roadblocks to ensure on-time delivery of project deliverables
  • In collaboration with cross-functional stakeholders, analyze forward thinking ideas to identify and mitigate risks, and embedding lessons learned into current and future products. Drive opportunities to compress schedules proactively and in response to business needs
  • Participate in mock-ups, onsite testing, commissioning, and other quality checks throughout the project life cycle in partnership with cross-functional teams to ensure proper installation and commissioning of systems
  • Liaise between internal teams, consultants, and contractors across projects and campuses to ensure transparency, situational awareness of status, way forward, and timely resolution of issues
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Manager, Data Engineering - Finance Data Foundations

Manager, Data Engineering - Finance Data Foundations The Manager, Data Engineer...
Location
Location
Canada , Toronto
Salary
Salary:
110000.00 - 130000.00 USD / Year
fourseasons.com Logo
Four Seasons
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 5-8 years experience Data Engineering
  • with experience in Azure using Databricks
  • Bachelor’s degree Required
  • MBA or Master’s in Engineering preferred
  • Expert in Data Engineering in Microsoft Azure Environment + Toolsets (ADF, Synapse, Data Bricks, Cosmos DB, FunctionApps, Logic Apps etc)
  • Lakehouse experience using Databricks
  • Azure platform administration
  • Data Governance Software experience
  • Microsoft Power BI delivery and support
  • Strong SQL query skills
Job Responsibility
Job Responsibility
  • Leading the delivery of finance domain data migration projects with clear milestones, quality controls, and operational readiness
  • Designing and maintaining reusable data ingestion and transformation frameworks aligned with enterprise engineering standards
  • Ensuring data consistency, lineage, and trustworthiness across finance and enterprise data domains
  • Collaborating with business and technical stakeholders to enable analytics, forecasting, and AI readiness for finance data
  • Driving operational excellence across engineering practices, optimizing for cost, performance, and maintainability
  • Design, develop, and maintain robust batch and streaming data pipelines across Azure Data Factory, Databricks, Informatica, and SQL environments, ensuring scalability, reliability, and operational efficiency
  • Closely work with vendors, contractors and other FS teams to operationalize the data migration process for the hotels
  • Implement and oversee CI/CD workflows, Infrastructure as Code (IaC), and automated testing frameworks (unit, integration, and data validation) with built-in monitoring and observability to meet defined SLAs and SLOs
  • Operationalize data quality by integrating Informatica IDQ into finance workflows for profiling, rule-based validation, and continuous data quality monitoring
  • Apply governance standards by embedding metadata, cataloging, and lineage practices in collaboration with the Data Strategy & Governance team
  • Fulltime
Read More
Arrow Right

SAP Datasphere Architect / Data Migration Architect

We are currently seeking a SAP Datasphere Architect / Data Migration Architect t...
Location
Location
United States , Remote
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of SAP experience
  • 10+ years of strong Data Migration experience
  • 7+ years of Data structure and methodology experience
  • 5+ years of ETL, Data warehousing, Data Goverance and data quality experience
  • Minimum 15 years of overall SAP experience, with at least 5 years of hands-on experience in a leadership role on large-scale SAP data migration projects
  • Minimum 10+ years of expertise in SAP S/4HANA and ECC data structures and migration methodologies for both brownfield and greenfield implementations
  • Minimum 7-8+ years of deep, hands-on experience with SAP data migration tools, including Migration Cockpit, SAP Data Services (BODS), and LSMW
  • Strong proficiency in ETL processes, data warehousing, and advanced SQL querying
  • Minimum 7-8+ years of familiarity with data governance and data quality tools like Syniti is a plus
  • Minimum 10+ years of in-depth understanding of SAP modules and their underlying data structures (e.g., Finance (FI/CO), Sales and Distribution (SD), Materials Management (MM), Production Planning (PP))
Job Responsibility
Job Responsibility
  • Serve as the single point of accountability for all data migration-related decisions, strategy, and execution
  • Lead and define the overall data migration blueprint and strategy, ensuring it aligns with project timelines and business objectives
  • Develop and maintain comprehensive data migration plans, including detailed cutover runbooks, schedules, and rollback procedures
  • Lead the end-to-end data migration lifecycle: extraction, cleansing, transformation, validation, loading, and reconciliation
  • Oversee data mapping from legacy systems to the new SAP S/4HANA and ECC environment for both master and transactional data
  • Manage and provide guidance to a team of data migration specialists, functional consultants, and technical resources
  • Establish and enforce robust data governance policies and standards throughout the migration process
  • Drive data cleansing, profiling, and quality assurance activities to ensure data integrity and accuracy
  • Design and implement automated data validation tools and scripts to accelerate reconciliation
  • Work closely with business data owners, functional leads, and technical teams to gather requirements and resolve data discrepancies
  • Fulltime
Read More
Arrow Right

Data Architect - Enterprise Data & AI Solutions

We are looking for a visionary Data Architect who can translate enterprise data ...
Location
Location
India , Chennai; Madurai; Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong background in RDBMS design, data modeling, and schema optimization
  • Advanced SQL skills, including performance tuning and analytics functions
  • Proven expertise in data warehouses, data lakes, and lakehouse architectures
  • Proficiency in ETL/ELT tools (Informatica, Talend, dbt, Glue)
  • Hands-on with cloud platforms (AWS Redshift, Azure Synapse, GCP BigQuery, Snowflake)
  • Familiarity with GenAI frameworks (OpenAI, Vertex AI, Bedrock, Azure OpenAI)
  • Experience with real-time streaming (Kafka, Kinesis, Flink) and big data ecosystems (Hadoop, Spark)
  • Strong communication skills with the ability to present data insights to executives
  • 8+ years in data architecture, enterprise data strategy, or modernization programs
  • Hands-on with AI-driven analytics and GenAI adoption
Job Responsibility
Job Responsibility
  • Design scalable data models, warehouses, lakes, and lakehouse solutions
  • Build data pipelines to support advanced analytics, reporting, and predictive insights
  • Integrate GenAI frameworks to enhance data generation, automation, and summarization
  • Define and enforce enterprise-wide data governance, standards, and security practices
  • Drive data modernization initiatives, including cloud migrations
  • Collaborate with stakeholders, engineers, and AI/ML teams to align solutions with business goals
  • Enable real-time and batch insights through dashboards, AI-driven recommendations, and predictive reporting
  • Mentor teams on best practices in data and AI adoption
What we offer
What we offer
  • Opportunity to design next-generation enterprise data & AI architectures
  • Exposure to cutting-edge GenAI platforms to accelerate innovation
  • Collaborate with experts across cloud, data engineering, and AI practices
  • Access to learning, certifications, and leadership mentoring
  • Competitive pay with opportunities for career growth and leadership visibility
  • Fulltime
Read More
Arrow Right