CrawlJobs Logo

Data & AI Lead Engineer

India, Bangalore · Job Posted July 03, 2026
Apply Position
Job Link Share

Job Description

We are seeking a Lead Engineer – GenAI & Data Platform to design and build a CTA Workbench, an AI-powered workflow platform that integrates with enterprise data systems to enable: Deep research across structured and unstructured datasets; Automated generation of scope documents, test plans, and audit workpapers; Continuous monitoring and analytics for AFC, Compliance, and ORM MI. This role requires a strong blend of Data Engineering, Full Stack Development, and Generative AI expertise.

Job Responsibility

  • Architect and implement GenAI-powered workflows using LLMs and Agentic AI frameworks
  • Design RAG (Retrieval-Augmented Generation) pipelines over enterprise data sources
  • Enable automated generation of audit/compliance artefacts with high accuracy and traceability
  • Define prompt engineering, evaluation, and guardrails for enterprise use
  • Design and build data pipelines to ingest, transform, and serve data from: Data lakes / warehouses
  • Compliance and risk systems
  • Document repositories
  • Implement data models and semantic layers for AI consumption
  • Ensure data quality, lineage, and governance across pipelines
  • Work with both batch and real-time data processing
  • Build and oversee development of end-to-end platform (UI + APIs + backend services)
  • Develop user interfaces for: AI-driven research workflows
  • Document generation and validation
  • Monitoring dashboards
  • Design scalable microservices architecture
  • Collaborate with business stakeholders in Compliance, AFC, and Risk
  • Ensure adherence to banking security, regulatory, and data governance standards
  • Lead design decisions and mentor engineering team

Requirements

  • 10+ years in Data Engineering / Software Engineering / AI
  • Strong programming expertise in Python
  • Experience in Generative AI, LLMs, and Agentic AI frameworks
  • Strong experience in data engineering: ETL/ELT pipelines
  • Data modeling (dimensional, lakehouse, etc.)
  • SQL & large-scale data processing
  • Experience with RAG, embeddings, and vector databases
  • Hands-on with APIs, microservices, and distributed systems
  • Experience with data platforms (AWS Glue, Azure Data Factory, Databricks, Snowflake, etc.)
  • Knowledge of data governance, lineage, and quality frameworks
  • Experience with structured + unstructured data processing
  • Experience with frontend frameworks (React/Angular)
  • Backend API development and system integration

Nice to have

  • Experience in banking / financial services domain
  • Understanding of: Anti-Financial Crime (AFC)
  • Compliance Monitoring
  • Operational Risk Management (ORM)
  • Experience with Azure OpenAI / enterprise AI platforms
  • Knowledge of AI governance and model risk management

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data & AI Lead Engineer

8 matching positions

Data & AI Lead Engineer

We are seeking a Lead Engineer – GenAI & Data Platform to design and build a CTA...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years in Data Engineering / Software Engineering / AI
  • Strong programming expertise in Python
  • Experience in Generative AI, LLMs, and Agentic AI frameworks
  • Strong experience in data engineering: ETL/ELT pipelines
  • Data modeling (dimensional, lakehouse, etc.)
  • SQL & large-scale data processing
  • Experience with RAG, embeddings, and vector databases
  • Hands-on with APIs, microservices, and distributed systems
  • Experience with data platforms (AWS Glue, Azure Data Factory, Databricks, Snowflake, etc.)
  • Knowledge of data governance, lineage, and quality frameworks
Job Responsibility
Job Responsibility
  • Architect and implement GenAI-powered workflows using LLMs and Agentic AI frameworks
  • Design RAG (Retrieval-Augmented Generation) pipelines over enterprise data sources
  • Enable automated generation of audit/compliance artefacts with high accuracy and traceability
  • Define prompt engineering, evaluation, and guardrails for enterprise use
  • Design and build data pipelines to ingest, transform, and serve data from: Data lakes / warehouses
  • Compliance and risk systems
  • Document repositories
  • Implement data models and semantic layers for AI consumption
  • Ensure data quality, lineage, and governance across pipelines
  • Work with both batch and real-time data processing
  • Fulltime
Read More
Arrow Right

Lead Data Engineer – AI & Foundation Models

Our Purpose Mastercard powers economies and empowers people in 200+ countries a...
Location
Location
Ireland , Dublin 18
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
October 10, 2026
Flip Icon
Requirements
Requirements
  • Strong experience designing and building production‑grade data pipelines in large‑scale environments
  • Deep expertise with distributed data processing frameworks (e.g. Spark or equivalent) and SQL‑based analytics
  • Experience working with cloud data platforms and storage technologies (AWS, Azure, or GCP)
  • Solid understanding of data modeling, performance tuning, and cost‑efficient data architecture
  • Experience supporting machine learning and AI workloads, including training datasets, feature engineering, and inference data flows
  • Familiarity with data governance concepts, including lineage, data quality, access control, and auditability
  • Strong software engineering fundamentals, including version control, testing, CI/CD, and code quality standards
  • Ability to translate AI and product requirements into practical, scalable data solutions
  • Experience leading technical delivery and mentoring engineers, without formal line‑management responsibility
  • Clear, concise communicator able to collaborate effectively with engineers, data scientists, product managers, and stakeholders
Job Responsibility
Job Responsibility
  • Lead the design and implementation of scalable data pipelines supporting AI model training, inference, and experimentation
  • Own data ingestion, transformation, and aggregation patterns across batch and streaming workloads
  • Partner with AI engineers to enable feature engineering, feature stores, and training datasets aligned to model requirements
  • Ensure data pipelines meet enterprise standards for quality, availability, lineage, and governance
  • Drive best practices for data modeling, schema management, partitioning, and performance optimization
  • Implement robust data quality checks, validation, and monitoring to ensure trust in downstream AI systems
  • Collaborate with platform and infrastructure teams to build pipelines on cloud‑native and distributed data processing platforms
  • Support secure data access patterns, including environment isolation, access controls, and auditability
  • Lead code reviews and design reviews for data engineering deliverables across the program
  • Mentor and guide senior and mid‑level data engineers, providing technical direction and delivery oversight
  • Fulltime
Read More
Arrow Right

Lead Data Engineer - AI Search

We are looking for a Lead Data Engineer — AI Search (all genders) to join Valtec...
Location
Location
France , Paris
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of professional software engineering experience in enterprise environments
  • Strong expertise in Google Cloud Platform (GCP) and AI ecosystems
  • Experience with AI Search, conversational AI, and generative AI integrations
  • Strong application architecture, API design, and enterprise integration experience
  • Solid understanding of cloud-native, microservices, and event-driven architectures
  • Experience with CI/CD pipelines, software quality, observability, and cloud security best practices
  • Experience working with Kubernetes and Infrastructure as Code
  • Technical leadership experience, including mentoring engineers and guiding technical decisions
  • Ability to collaborate across architecture, engineering, cloud, and data teams
  • Strong communication and stakeholder management skills
Job Responsibility
Job Responsibility
  • Define detailed technical design, components, interfaces, and integration patterns
  • Lead development teams and enforce engineering standards and best practices
  • Coordinate architecture, cloud/platform, data, QA, and business stakeholders
  • Ensure delivery quality through testing, observability, and application security practices
  • Guide teams on GCP and AI Search implementation patterns
  • Lead technical discovery, estimation, and solution design workshops
  • Identify technical risks and propose mitigation strategies early
  • Ensure scalable, reliable, and production-ready AI solutions
  • Contribute hands-on in complex and high-impact technical areas
  • Support industrialization and operationalization of AI and search use cases
What we offer
What we offer
  • Flexibility, with remote and hybrid work options (country-dependent)
  • Career advancement, with international mobility and professional development programs
  • Learning and development, with access to cutting-edge tools, training and industry experts
  • Fulltime
Read More
Arrow Right

Lead AI Data Engineer (Energy Intelligence Platform)

We are looking for a Lead Data Engineer to define and scale modern data practice...
Location
Location
Poland
Salary
Salary:
Not provided
airswift.com Logo
Airswift Sweden
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert-level SQL and dbt experience (clean, testable, modular code)
  • Strong expertise in dimensional data modelling and complex data scenarios
  • Proven experience driving adoption of engineering standards across teams
  • Excellent stakeholder management and communication skills (technical to non-technical translation)
  • Deep understanding of the end-to-end data lifecycle (ingestion, transformation, consumption)
Job Responsibility
Job Responsibility
  • Define and enforce best practices across the data ecosystem (CI/CD, modular architecture, testing)
  • Lead advanced data modelling initiatives using SQL and dbt, ensuring scalable and reusable design
  • Design and implement robust data governance frameworks, including GDPR response ownership
  • Partner with Product to shape the Analytics Engineering roadmap and translate business needs into technical solutions
  • Promote a data-driven culture and influence standards across multiple teams
  • Fulltime
Read More
Arrow Right

Principal Engineer, Computer Vision & AI /3D Data (Team Lead)

Cesium is the leading open platform for streaming and visualizing huge 3D geospa...
Location
Location
Salary
Salary:
Not provided
bentley.com Logo
Bentley Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • PhD or equivalent in Computer Vision, AI, or Machine Learning
  • 10+ years' experience as a Software Engineer
  • at least 5+ years leading and mentoring technical teams within a product driven environment
  • 5+ years of experience in AI/3D vision development including industry experience of deploying AI and working with 3D data, including ML ops and practical, user-focused product development
  • Expertise in deep learning, computer vision, 3D geometry, and multimodal AI, including experience with large language models
  • Strong programming skills in Python and/or C++ with ML frameworks (PyTorch, TensorFlow), GPU programming (CUDA)
  • Excellent communication and leadership skills
  • Fluent in English
Job Responsibility
Job Responsibility
  • Lead and mentor a team of 5 engineers, providing technical direction and project coordination in computer vision and AI/3D data modeling projects, providing coaching and guidance
  • Design and deploy advanced AI/ML and 3D vision algorithms generated by our modelling team for large-scale datasets for practical, user focused product development including point clouds, meshes, sensor data and Gaussian splatting
  • Define the AI strategy and contribute to product roadmap decisions
  • Implement ML Ops practices for scalable, automated training and inference pipelines
  • Conduct research on emerging AI techniques for 3D understanding and integrate findings into production
  • Ensure quality through rigorous evaluation, optimization, and code reviews
What we offer
What we offer
  • A great Team and culture
  • An exciting career as an integral part of a world-leading software company providing solutions for architecture, engineering, and construction
  • An attractive salary and benefits package
  • A commitment to inclusion, belonging and colleague wellbeing through global initiatives and resource groups
  • A company committed to making a real difference by advancing the world’s infrastructure for better quality of life, where your contributions help build a more sustainable, connected, and resilient world
Read More
Arrow Right

Lead Data Engineer - Data Transformation (Modeling and Architecture)

Lead Data Engineer - Data Transformation (Modeling and Architecture). Do you lov...
Location
Location
United States , Richmond, Virginia; McLean, Virginia; Cambridge, Massachusetts
Salary
Salary:
179400.00 - 225100.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 4 years of experience in application development
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Build and maintain comprehensive data models—spanning conceptual, logical, and physical layers—to ensure scalable architecture and high data integrity across enterprise systems
  • Lead design of the org data landscape by applying Consumer Driven design principles, ensuring that data structures reflect business realities and evolving organizational needs
  • Architect and implement robust data ecosystem solutions, including Data Lake and Data Warehouse patterns, to support diverse analytical and operational requirements
  • Support high-performance data pipelines and complex transformations that utilize SQL, Spark, and Python to process large-scale datasets efficiently
  • Define and Enforce rigorous data governance standards while managing metadata frameworks to ensure data compliance and discoverability
  • Translate complex technical concepts into actionable business insights, working independently to lead initiatives and collaborate with stakeholders to meet organizational goals
  • Contribute to the evolution of the data ecosystem by designing AI-ready architectures
  • Collaborate with and across Agile teams to design, develop, implement, and support technical solutions
  • Work with a team of developers with deep experience in machine learning, AI, distributed microservices, and full stack systems
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Data Engineer Lead (OT Data)

Data Engineer (OT Data) (Category - Engineer) Sector: Oil and Gas Location: Doha...
Location
Location
Qatar , Doha
Salary
Salary:
Not provided
Codvo AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's in engineering, Information Systems, or a related quantitative field
  • 5+ years of proven experience in a data engineering role
  • Experience within oil and gas industry is highly preferred
  • Demonstrable experience building and operationalizing large-scale data pipelines and applications
Job Responsibility
Job Responsibility
  • Architect & Build Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems and ETL/ELT pipelines
  • Integrate Diverse Data Sources: Develop processes to ingest and integrate high-volume, high-velocity data from SCADA systems, historians (like OSIsoft PI, Aspen InfoPlus.21), DCS, PLC, and IoT sensors
  • Cloud Data Platform Development: Implement and manage data solutions on the Microsoft Azure cloud platform, Leveraging services like Azure IoT Hub, Azure Event Hubs, and Azure Stream Analytics for real-time ingestion and processing of operational technology (OT) data
  • Data Modelling & Warehousing: Design and implement data models optimized for time-series data from industrial assets, supporting operational dashboards and real-time analytics
  • Enable Advanced AI: Build the data infrastructure to support AI/ML models for predictive maintenance, operational anomaly detection, and process optimization using real-time OT data
  • Champion Master Data Management (MDM): Design and implement MDM strategies and solutions to create a single, authoritative source of truth for critical data domains such as wells, equipment, and assets, ensuring data consistency across the enterprise
  • Ensure Data Quality & Governance: Implement robust data quality checks, validation rules, and monitoring to ensure the accuracy, consistency, and reliability of our data. Adhere to and help shape our data governance policies
  • Embrace Industry Standards: Champion and implement industry-specific data standards and models, such as the OSDU™ Data Platform, to ensure interoperability and a unified data view across the upstream lifecycle
  • Collaborate & Innovate: Work closely with a cross-functional team of geoscientists, drilling engineers, data scientists, and business analysts to understand their data needs and deliver effective solutions
  • Automate & Optimize: Identify opportunities for process automation and infrastructure optimization to improve data delivery, scalability, and cost-effectiveness
  • Fulltime
Read More
Arrow Right

Lead AI Engineer (Generative AI)

Location
Location
Australia , Melbourne
Salary
Salary:
160000.00 - 170000.00 AUD / Year
welovesalt.com Logo
Salt
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2 – 4 years experience applying modern Generative AI in real delivery environments
  • A strong track record of providing technical leadership
  • A strong background in software engineering before stepping into a more AI-focused role in recent times
  • Deep expertise in Generative AI, large language models, retrieval‑augmented generation (RAG), and modern machine learning techniques
  • Strengths in prompt engineering, offline/online evaluation, safety guardrails, and telemetry‑driven improvement
  • Practical experience with RAG, embeddings/vector search, and tool‑use/function‑calling orchestration
  • The ability to define trustworthy AI metrics
  • A Software engineering background using the likes of React, Typescript, React Native
  • AWS experience / certifications
  • Strong knowledge of CI/CD
Job Responsibility
Job Responsibility
  • Accelerating the adoption of Generative AI for this company, leading the adoption of AI‑first engineering practices and an 'AI-first' mindset
  • Providing technical leadership and shaping AI-enabled solutions
  • Reporting into the Head of Technology and working closely with the Head of Enterprise AI
  • Collaborating with a variety of cross-functional teams including
  • Engineering, QA, BA, Product Management, Senior Business Stakeholders, Data Science, Cyber Security, Enterprise Architecture
  • Coaching and training engineers and leaders in the organisation in safe, effective AI‑assisted development
  • Encouraging teams to embed AI‑driven thinking in solution design and delivery
  • Defining and helping to operationalise trustworthy metrics to measure the impact of AI features, and developer productivity uplifts
  • Producing AI-augmented solution designs when required
  • Driving engineering excellence by uplifting standards, modernising technical practices, and championing AI‑aligned SDLC patterns
What we offer
What we offer
  • Super
  • Bonus
  • Fulltime
Read More
Arrow Right