CrawlJobs Logo

Lead Data Integration Engineer

India, Pune · Job Posted April 10, 2026
Apply Position
Job Link Share

Job Description

A highly experienced and technically adept Senior Integration Engineer to join our Wealth Lending platforms team. This role demands a blend of strategic thinking, technical leadership, and hands-on development expertise. The ideal candidate will not only own the data & integration strategy but also actively contribute to the design, development, and implementation of robust and scalable integration solutions

Job Responsibility

  • Owning overall data integration strategy, design, development, & delivery across Wealth lending platforms
  • Providing technical leadership to integration developers, and actively contributing to the design, development, and implementation of integration pipelines
  • Design & Develop integration patterns, including batch, real-time and event-based integrations with robust error handling, monitoring & replay mechanisms
  • Design, Build, & Manage data access integration layer, ensuring consistent data extracts & schema management
  • Perform & oversee source system data profiling, data discovery and data quality assessments, identifying gaps and driving remediation strategies
  • Define, Implement and validating complex transformation, standardization, and mapping rules for data integration
  • Champion and utilize AI assisted development tools and authentication frameworks to improve developer productivity, code quality, testing & documentation across the engineering team
  • Provide technical leadership and delivery ownership, guiding the team on architecture decisions, best practices, and ensuring high quality delivery of features and platform enhancements
  • Identify problems, analyze information, and make evaluative judgments to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Apply fundamental knowledge of programming languages for design specifications and active development
  • Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field
  • 10+ years of progressive experience in data integration, data engineering, or a similar role, with at least 4 years in a technical leadership or senior capacity
  • Demonstrable experience within the financial services or banking industry, specifically with wealth management or lending platforms
  • Extensive hands-on experience with end-to-end design, development, coding, and deployment of complex data integration solutions
  • Proficiency in designing, developing, and managing data access integration layers, ensuring data consistency, efficient extraction, and robust schema management
  • Strong background in source system data profiling, data discovery, data quality assessments, and driving remediation strategies. With knowledge of wholesale Lending domain
  • Skilled in defining and implementing intricate data transformation, standardization, and mapping rules
  • Hands-on experience with leading data integration platforms, ETL/ELT tools, message queuing systems, and API management solutions
  • Solid understanding and hands-on RDBMS (SQL, PL/SQL) + knowledge of NoSQL databases
  • Practical experience with AI-assisted development tools and modern authentication frameworks to enhance productivity, code quality, testing, and documentation
  • Solid understanding of fundamental programming concepts and proven experience in developing with relevant languages (e.g., Python, Java, Scala) for design specifications and implementation
  • Proven ability to lead, mentor, and guide integration developers on design, development, and implementation best practices for data pipelines
  • Expertise in designing, building, and governing diverse data integration patterns, including batch, real-time, and event-based architectures
  • Deep understanding of implementing robust error handling, monitoring, logging, and replay mechanisms within integration solutions
  • A strong commitment to ensuring high-quality deliverables through architectural guidance, best practices, and rigorous testing
  • Hands-on knowledge of messaging systems - IBM MQ, Kafka, Solace etc
  • Demonstrated ability to assess and mitigate risks in technical decisions, ensuring compliance with applicable laws, rules, and regulations within a regulated environment
  • Adherence to internal policies, sound ethical judgment, and transparent escalation/management of control issues
  • Ability to operate with a high degree of autonomy and drive initiatives from conception to delivery with limited direct supervision
  • Excellent communication and interpersonal skills, fostering effective collaboration with cross-functional teams and stakeholders

Nice to have

  • Certifications in relevant data integration technologies, cloud platforms (e.g., AWS, Azure, GCP), or data governance are a plus
  • Experience with hands-on design and implementations of cloud-ready applications and deployment pipelines on large-scale container platform clusters is a plus
  • Experience working in a Continuous Integration and Continuous Delivery environment and familiar with Tekton, Harness, Jenkins, Code Quality, etc

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Lead Data Integration Engineer

8 matching positions

Lead Data Integration Engineer

Are you an expert in MS SQL Server & SSIS development who learned python and clo...
Location
Location
United States , Saint Petersburg; Memphis
Salary
Salary:
Not provided
raymondjames.com Logo
Raymond James
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Deep expertise in Microsoft SQL Server, SSIS, and SQL development
  • Strong proficiency in writing and optimizing complex stored procedures, functions, and packages
  • Hands-on experience with Python for data manipulation, automation, and pipeline development
  • Familiarity with Oracle databases and PL/SQL development is required for cross-platform data integration
  • Experience in implementing CI/CD pipelines and DevOps practices for data solutions
  • Understanding data warehousing concepts, ETL methodologies, and data modeling techniques
  • Experience with Unix and Shell scripting
  • Experience with job scheduler tools such as BMC Control-M
  • Proven track record working in both waterfall and agile SDLC frameworks
  • Knowledge of the Financial Services industry including middle and back-office functions
Job Responsibility
Job Responsibility
  • Maintain and support our critical Pre-trade clearance system
  • Working on re-engineering our entire data stack into AWS using python
  • Fulltime
Read More
Arrow Right

Lead Data Integration Specialist / Senior Full Stack Engineer

Lead Data Integration Specialist / Senior Full Stack Engineer – New York – Compe...
Location
Location
United States , New York
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on experience in developing production-ready software
  • Experience maintaining and working with data integrations / external API sources
  • Demonstrates skill in manoeuvring both front-end and backend technical projects
  • Brings to the table a collaborative mindset, having effectively led engineering teams
  • Demonstrates a remarkable ability to adapt swiftly to the evolving needs of our growing organization
  • Proficient in client-side technologies such as TypeScript, JavaScript (ES6/React), HTML/CSS
  • Server-side proficiency in Python (Django)
  • Holds practical experience in managing relational databases, with a strong command over PostgreSQL
Job Responsibility
Job Responsibility
  • Design and build a scalable platform that simplifies the creation/operation of hundreds of data partner integrations
  • Liaise with engineers, designers, and product managers to translate our product and technical vision into a concrete roadmap
  • Partner with third-party vendors & our clients to gather requirements and co-create solutions
  • Craft high-quality, thoroughly-tested code that meets the unique requirements of our clients
  • Provide technical mentorship and guidance to fellow engineers
What we offer
What we offer
  • Competitive Package
  • Unlimited PTO and flexible work policy
  • Fulltime
Read More
Arrow Right

Lead Data Integration Specialist / Senior Full Stack Engineer

This young and agile company, providing identity risk solutions, is currently se...
Location
Location
United States , New York
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on experience in developing production-ready software
  • Experience maintaining and working with data integrations / external API sources
  • Demonstrates skill in manoeuvring both front-end and backend technical projects, adept at prioritising tasks, defining requirements, and facilitating productive discussions within the team
  • Brings to the table a collaborative mindset, having effectively led engineering teams
  • Demonstrates a remarkable ability to adapt swiftly to the evolving needs of our growing organisation and dynamic product landscape
  • Proficient in client-side technologies such as TypeScript, JavaScript (ES6/React), HTML/CSS
  • Server-side proficiency in Python (Django)
  • Holds practical experience in managing relational databases, with a strong command over PostgreSQL
Job Responsibility
Job Responsibility
  • Design and build a scalable platform that simplifies the creation/operation of hundreds of data partner integrations
  • Liaise with engineers, designers, and product managers to translate our product and technical vision into a concrete roadmap
  • Partner with third-party vendors & our clients to gather requirements and co-create solutions
  • Craft high-quality, thoroughly-tested code that meets the unique requirements of our clients
  • Provide technical mentorship and guidance to fellow engineers
What we offer
What we offer
  • Competitive Salary
  • Competitive Package
  • Opportunity to work with an Ambitious, Young, Growing Organisation
  • Unlimited PTO
  • Flexible work policy
  • Fulltime
Read More
Arrow Right

Lead Data Engineer - Data Pipelines

Economic Intelligence is a Mastercard Services program within Economic & Busines...
Location
Location
Czechia , Prague
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong professional experience with Python building production-grade systems
  • Strong SQL skills, including writing readable and well-tuned queries for large-scale datasets
  • Experience leading design and delivery of data pipelines and/or data platform components, with attention to scalability, reliability, and maintainability
  • Familiarity with Databricks (or similar Spark-based data platforms)
  • Comfortable using LLM‑based coding tools, with the discipline to validate, test, and take full ownership of the generated code
  • Strong foundation in object-oriented software design and engineering best practices
  • Comfortable with Linux command line and production troubleshooting
  • Clear communicator with strong written and verbal English
  • Ownership mindset: motivation, creativity, self-direction, and ability to thrive in small, collaborative teams while influencing across boundaries
  • Passion for analytical/quantitative problem solving, quality, and continuous improvement of both platform and team processes
Job Responsibility
Job Responsibility
  • Lead technical execution to deliver end-to-end capabilities from data processing through publishing and customer consumption
  • Design, build, and evolve scalable, maintainable data pipelines that deliver insights from economic data
  • Drive performance, reliability, observability, and readability in the data platform codebase
  • Own and unify the data layer across multiple products, establishing shared patterns, reusable components, and clear interfaces
  • Translate business needs into durable technical designs
  • Tackle technical debt strategically
  • Set engineering direction and standards for pipeline development and cross-team integration
  • Write, test, and review code
  • Provide technical leadership through mentorship, rigorous code reviews, and support for other engineers’ growth and delivery
  • Continuously innovate, evaluating new approaches, tools, and technologies
  • Fulltime
Read More
Arrow Right

Lead Data Engineer - Data Pipelines

Economic Intelligence is a Mastercard Services program within Economic & Busines...
Location
Location
Czechia , Prague
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong professional experience with Python building production-grade systems
  • Strong SQL skills, including writing readable and well-tuned queries for large-scale datasets
  • Experience leading design and delivery of data pipelines and/or data platform components, with attention to scalability, reliability, and maintainability
  • Familiarity with Databricks (or similar Spark-based data platforms)
  • Comfortable using LLM‑based coding tools
  • Strong foundation in object-oriented software design and engineering best practices
  • Comfortable with Linux command line and production troubleshooting
  • Clear communicator with strong written and verbal English
  • Ownership mindset: motivation, creativity, self-direction, and ability to thrive in small, collaborative teams while influencing across boundaries
  • Passion for analytical/quantitative problem solving, quality, and continuous improvement of both platform and team processes
Job Responsibility
Job Responsibility
  • Lead technical execution to deliver end-to-end capabilities from data processing through publishing and customer consumption
  • Design, build, and evolve scalable, maintainable data pipelines that deliver insights from economic data
  • Drive performance, reliability, observability, and readability in the data platform codebase
  • Own and unify the data layer across multiple products, establishing shared patterns, reusable components, and clear interfaces
  • Translate business needs into durable technical designs
  • Tackle technical debt strategically
  • Set engineering direction and standards for pipeline development and cross-team integration
  • Write, test, and review code
  • Provide technical leadership through mentorship, rigorous code reviews, and support for other engineers’ growth and delivery
  • Continuously innovate, evaluating new approaches, tools, and technologies
  • Fulltime
Read More
Arrow Right

Data Engineer Lead (OT Data)

Data Engineer (OT Data) (Category - Engineer) Sector: Oil and Gas Location: Doha...
Location
Location
Qatar , Doha
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's in engineering, Information Systems, or a related quantitative field
  • 5+ years of proven experience in a data engineering role
  • Experience within oil and gas industry is highly preferred
  • Demonstrable experience building and operationalizing large-scale data pipelines and applications
Job Responsibility
Job Responsibility
  • Architect & Build Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems and ETL/ELT pipelines
  • Integrate Diverse Data Sources: Develop processes to ingest and integrate high-volume, high-velocity data from SCADA systems, historians (like OSIsoft PI, Aspen InfoPlus.21), DCS, PLC, and IoT sensors
  • Cloud Data Platform Development: Implement and manage data solutions on the Microsoft Azure cloud platform, Leveraging services like Azure IoT Hub, Azure Event Hubs, and Azure Stream Analytics for real-time ingestion and processing of operational technology (OT) data
  • Data Modelling & Warehousing: Design and implement data models optimized for time-series data from industrial assets, supporting operational dashboards and real-time analytics
  • Enable Advanced AI: Build the data infrastructure to support AI/ML models for predictive maintenance, operational anomaly detection, and process optimization using real-time OT data
  • Champion Master Data Management (MDM): Design and implement MDM strategies and solutions to create a single, authoritative source of truth for critical data domains such as wells, equipment, and assets, ensuring data consistency across the enterprise
  • Ensure Data Quality & Governance: Implement robust data quality checks, validation rules, and monitoring to ensure the accuracy, consistency, and reliability of our data. Adhere to and help shape our data governance policies
  • Embrace Industry Standards: Champion and implement industry-specific data standards and models, such as the OSDU™ Data Platform, to ensure interoperability and a unified data view across the upstream lifecycle
  • Collaborate & Innovate: Work closely with a cross-functional team of geoscientists, drilling engineers, data scientists, and business analysts to understand their data needs and deliver effective solutions
  • Automate & Optimize: Identify opportunities for process automation and infrastructure optimization to improve data delivery, scalability, and cost-effectiveness
  • Fulltime
Read More
Arrow Right

Technical Support Engineer - Azure Data Factory / Data Integration

Within CE&S, the Customer Service & Support (CSS) organization builds trust and ...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Technology (IT), or related field AND 1+ years of technical support, technical consulting experience, or information technology experience
  • OR 3+ years of technical support, technical consulting experience, or information technology experience
  • OR equivalent experience
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics / Microsoft Fabric Pipeline
  • Data Lake
  • Relational Database Management System (Microsoft SQL Server / Oracle Database / MySQL / IBM Db2 / SAP)
  • Big Data or Analytics Products (Spark / Azure HDInsight / Azure Data Lake Analytics / Azure Synapse Analytics / Databricks / Google BigQuery)
  • Pipeline and ETL/ELT Skills
  • Building and orchestrating pipelines (ADF / Synapse / Fabric)
Job Responsibility
Job Responsibility
  • Response and Resolution: You own, investigate and solve customer technical issues. You collaborate within and across teams, leveraging troubleshooting tools and practices
  • Readiness: You lead or participate in building communities with peer delivery roles and, where appropriate, share your knowledge
  • You develop specific technical and professional proficiency to enable you to resolve customer issues, through training and readiness
  • Product/Process Improvement: You identify potential product defects and escalate appropriately to resolve, contributing to Microsoft product improvements
  • Fulltime
Read More
Arrow Right
New

Data Engineer – Lead

Data Engineer – Lead
Location
Location
India , Bengaluru Urban
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Pipelines, Dataflows Gen2, Notebooks, and Power BI integration
  • Expertise in ETL/ELT, data pipelines, distributed data processing, and cloud-scale data engineering
  • Strong SQL, Python, PySpark, and data modeling skills
  • Experience with Lakehouse, Warehouse, and Medallion Architecture
  • Understanding of Delta tables, dimensional modeling, star schema, facts, dimensions, and curated analytical datasets
  • Experience integrating structured, semi-structured, file-based, API-based, enterprise application, and cloud data sources
  • Experience with data quality, reconciliation, logging, monitoring, and error-handling frameworks
  • Experience leading technical teams and coordinating onshore/offshore delivery
  • Experience with Git, CI/CD, Azure DevOps, branching, code reviews, and release management
  • Good to Have: Experience with Azure Data Factory, Synapse, Databricks, ADLS Gen2, Azure SQL, Microsoft Purview, or related Azure services
Job Responsibility
Job Responsibility
  • Lead the design and implementation of scalable data pipelines and data processing frameworks in Microsoft Fabric
  • Define data engineering standards, development practices, naming conventions, coding guidelines, and reusable technical patterns
  • Lead implementation of Bronze, Silver, and Gold layers in the Medallion Architecture
  • Oversee ingestion, transformation, orchestration, validation, and publication of data from multiple enterprise, clinical, operational, and cloud-based sources
  • Guide development of Fabric Pipelines, Dataflows Gen2, Notebooks, Lakehouse tables, Warehouse objects, and curated datasets
  • Ensure scalability, performance, reliability, maintainability, security, monitoring, and optimization of data solutions
  • Define standards for data quality, reconciliation, logging, error handling, auditability, and lineage
  • Conduct technical design reviews, code reviews, performance reviews, and deployment readiness reviews
  • Mentor and guide data engineering teams across onshore/offshore locations
  • Collaborate with architects, platform engineers, BI teams, QA teams, AI/ML teams, functional consultants, and stakeholders
Read More
Arrow Right