CrawlJobs Logo

Director, Data Engineering

Ireland, Dublin 18 · Job Posted May 20, 2026
Apply Position
Job Link Share

Job Description

The CNPF Data & AI organisation is looking for a Director of Data Engineering (L5) to lead the strategy, architecture, and delivery of the data platform powering our analytics products and agentic AI applications across Small & Medium Enterprise (SME), Corporate Solution, Transfer Solution and Commercial Verticals. This is a senior, hands-on technical leadership role within Data & AI Product Enablement. The Director will own the data backbone that our LLM agents, MCP servers, and analytics products run on — making sure data is reliable, governed, retrievable in real time, and ready for AI consumption at production scale. The role works in close partnership with Applied AI, Product, and Architecture leadership.

Job Responsibility

  • Own the data engineering strategy and technical direction for CNPF, with a strong focus on enabling agentic AI and GenAI products in production
  • Architect and deliver the data foundations for multi-agent systems — including MCP servers exposing data and tools to agents, retrieval pipelines, vector stores, feature stores, and knowledge graphs
  • Lead the design of context-engineering infrastructure that lets agents reason over Mastercard data safely, with the right grounding, freshness, and access controls
  • Drive lakehouse, streaming, and event-driven platform design (Databricks, Spark, Kafka, Delta/Iceberg) to support both batch analytics and low-latency AI use cases
  • Ensure data systems meet Mastercard standards for governance, lineage, data quality, observability, and risk — including the additional requirements that come with AI consumption (PII handling, prompt/response logging, audit trails)
  • Set technical standards for how data products are exposed to agents and applications, including MCP design patterns, schema contracts, and tool interfaces
  • Partner with Applied AI on evaluation and runtime data needs — training sets, eval datasets, retrieval quality, and feedback loops
  • Stay hands-on enough to make sharp architectural calls, review designs, and unblock the team on hard problems
  • Guide a team of senior data engineers, providing technical direction and growing their capability over time

Requirements

  • Significant experience leading the design and delivery of large-scale data platforms in production
  • Deep expertise in distributed data processing and the modern data stack — Spark, Databricks, Kafka, dbt, Delta/Iceberg, and similar
  • Strong hands-on background in data architecture, modelling, streaming, and lakehouse design on AWS
  • Proven track record of taking data systems from concept to secure, scalable production
  • Solid grasp of data governance, lineage, quality, and observability frameworks
  • Excellent technical communication — able to align engineers, AI scientists, product managers, and executives
  • Comfortable operating as a player-coach: setting direction, reviewing designs, and going deep when needed

Nice to have

  • You have personally built data infrastructure that powers agentic AI in production — not just analytics dashboards
  • Hands-on experience designing and operating MCP (Model Context Protocol) servers, including authentication, tool exposure, schema design, and observability
  • Direct experience building the data layer for multi-agent systems — retrieval, memory, state management, long-running workflow data, and human-in-the-loop checkpoints
  • Strong familiarity with vector databases, hybrid retrieval (semantic + structured), and knowledge graph integration with LLMs
  • Practical understanding of LLMOps data needs — eval datasets, golden traces, prompt/response telemetry, and feedback capture
  • Experience designing real-time and event-driven systems that support low-latency agent decisioning
  • Sharp instincts for the trade-offs between batch and streaming, structured and unstructured, accuracy and cost — and how those decisions cascade into agent behaviour
  • Experience partnering with security and governance teams to ship AI-facing data products responsibly at enterprise scale

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Director, Data Engineering

8 matching positions

New

Director, Data Engineering

The CNPF Data & AI organisation is looking for a Director of Data Engineering to...
Location
Location
Ireland , Dublin 18
Salary
Salary:
Not provided
mastercard.com Logo
Mastercard
Expiration Date
October 10, 2026
Flip Icon
Requirements
Requirements
  • Significant experience leading the design and delivery of large-scale data platforms in production
  • Deep expertise in distributed data processing and the modern data stack — Spark, Databricks, Kafka, dbt, Delta/Iceberg, and similar
  • Strong hands-on background in data architecture, modelling, streaming, and lakehouse design on AWS
  • Proven track record of taking data systems from concept to secure, scalable production
  • Solid grasp of data governance, lineage, quality, and observability frameworks
  • Excellent technical communication — able to align engineers, AI scientists, product managers, and executives
  • Comfortable operating as a player-coach: setting direction, reviewing designs, and going deep when needed
Job Responsibility
Job Responsibility
  • Own the data engineering strategy and technical direction for CNPF, with a strong focus on enabling agentic AI and GenAI products in production
  • Architect and deliver the data foundations for multi-agent systems — including MCP servers exposing data and tools to agents, retrieval pipelines, vector stores, feature stores, and knowledge graphs
  • Lead the design of context-engineering infrastructure that lets agents reason over Mastercard data safely, with the right grounding, freshness, and access controls
  • Drive lakehouse, streaming, and event-driven platform design (Databricks, Spark, Kafka, Delta/Iceberg) to support both batch analytics and low-latency AI use cases
  • Ensure data systems meet Mastercard standards for governance, lineage, data quality, observability, and risk — including the additional requirements that come with AI consumption (PII handling, prompt/response logging, audit trails)
  • Set technical standards for how data products are exposed to agents and applications, including MCP design patterns, schema contracts, and tool interfaces
  • Partner with Applied AI on evaluation and runtime data needs — training sets, eval datasets, retrieval quality, and feedback loops
  • Stay hands-on enough to make sharp architectural calls, review designs, and unblock the team on hard problems
  • Guide a team of senior data engineers, providing technical direction and growing their capability over time
  • Fulltime
Read More
Arrow Right

Director, Data Engineering

You'll be one of the analytics leaders for how Meta transforms its Enterprise th...
Location
Location
United States , Menlo Park
Salary
Salary:
253000.00 - 314000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • AI power user. You're already a power AI user in your day-to-day work—Metamate, Claude, Cursor, or whatever tools make you faster. You'll set an example for what "AI-native" looks like and help others get there
  • 0→1 builder experience You've built measurement systems from scratch in ambiguous spaces. You don't wait for requirements—you define them
  • Speed + rigor. You can move fast without being sloppy. You know when to be 60% right now vs. 95% right later
  • Executive communication. You'll regularly present to leadership. Your insights need to be crisp, actionable, and defensible
  • Cross-functional influence. You'll work across dozens of teams (EE, Security, CPP, DevInfra, and more). You need to drive alignment without authority
  • Honesty. Some AI initiatives won't work. Some claimed impact will be inflated. You'll need to call it like you perceive it
Job Responsibility
Job Responsibility
  • Firefighter Mode: Leadership asks "what's the ROI of [new AI tool]?" on Wednesday. You have an answer by Friday
  • A team claims their AI initiative saved 10,000 hours. You validate (or invalidate) it
  • You rapidly instrument, measure, and communicate whether it's working
  • You jump into whatever is urgent and ambiguous—and you close it
  • Systems Thinker Mode: Build measurement frameworks that work across wildly different AI tools and use cases (coding, analytics, recruiting, HR support, supply chain, finance and more)
  • Create the dashboards, workspaces, semantic models and self-serve layers that let stakeholders across the company understand progress without pinging you
  • Design and scale the data pipelines and instrumentation that capture agent telemetry, usage signals, and outcome metrics across a fragmented and fast-moving tool landscape
  • Shape the strategy for how we think about productivity, time savings, and quality improvements in an AI-augmented workforce
  • Influence how Analytics (and business functions) evolve their operating models, job profiles, and organization structures for the AI era
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Engineering Director Data Engineering

Location
Location
India , Gurugram
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 26, 2026
Flip Icon
Requirements
Requirements
  • Proficiency in Data Engineering
  • Strong knowledge of data pipeline development and data integration techniques
  • 5+ years of overall IT experience, which includes building & deployment of Bigdata applications using PySpark and AWS cloud
  • Extensive experience in design, build and deployment of Python-based applications
  • Hands-on experience in relational databases preferably Oracle and PostgreSQL and writing complex SQL queries
  • Experience in various AWS services such as EMR, API Gateway, RDS instance, and Lambda
  • Understand complex data sets and ETL processes, and how they can be optimized using Spark
  • Experience with cloud-based data platforms and distributed computing frameworks
  • Ability to optimize data workflows for performance and scalability
  • Familiarity with database management systems and data warehousing concepts
Job Responsibility
Job Responsibility
  • Expected to be an SME, collaborate and manage the team to perform
  • Responsible for team decisions
  • Engage with multiple teams and contribute on key decisions
  • Provide solutions to problems for their immediate team and across multiple teams
  • Lead the coordination of project activities to ensure timely delivery of software components
  • Mentor junior team members to support their professional growth and skill development
  • Facilitate effective communication between stakeholders to align technical solutions with business objectives
  • Collaborate with other teams to integrate Spark jobs into the overall data pipeline
  • Monitoring and tuning data loads and queries
Read More
Arrow Right
New

Director, Data Engineering & AI

The Director, Data Engineering & AI Enablement is the senior-most technical lead...
Location
Location
United States , Philadelphia
Salary
Salary:
150000.00 - 160000.00 USD / Year
aramark.com Logo
Aramark
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert-level, current proficiency in modern data engineering: Python, SQL, Spark, streaming frameworks (e.g., Kafka), orchestration tooling, and cloud data platforms (e.g., Snowflake, Azure) - able to write and review production code personally, not only at a conceptual level
  • Proven, personal experience developing and deploying machine learning models and generative AI/LLM applications into production - this should reflect direct authorship, not solely direction of others' work
  • Hands-on experience with MLOps tooling, CI/CD pipelines, containerization, and model monitoring frameworks
  • Experience working across diverse, often messy enterprise data domains (financial, labor/workforce, IoT/sensor, employee activity, client/operational) preferred over deep specialization in any single domain
  • Demonstrated track record of delivering AI products that generated measurable business outcomes
  • Strong engineering leadership skills with experience building and scaling delivery-oriented technical teams - paired with a clear, recent record as a top individual technical contributor, not a manager who has drifted away from the technical work
  • Comfortable moving fluidly between hands-on building (coding, prototyping, debugging production issues) and strategic work (roadmaps, architecture decisions, executive communication)
  • Bachelor's degree in Computer Science, Engineering, Data Science, or a related field
  • advanced degree in a quantitative discipline preferred
  • 7+ years of data and software engineering experience, including 4+ years building AI/ML solutions and 2+ years in engineering leadership roles
Job Responsibility
Job Responsibility
  • Architect and build production-grade data pipelines (batch and streaming) for the highest-priority or highest-ambiguity initiatives — spanning financial, labor/workforce, and smart building sensor, employee work, and client/operational data — setting the technical pattern the team scales from
  • Write code, design model architectures, and personally develop and deploy machine learning models and generative AI applications (including LLM-based solutions), particularly for new or unproven use cases before delegating to the team
  • Stay hands-on in production: debug critical-path issues, review production-critical code and model logic, and remain a credible technical authority by virtue of doing the work, not just overseeing it
  • Define and execute the AI/ML roadmap for the line of business, identifying high-value use cases across the full data landscape — predictive maintenance, demand forecasting, workforce and labor optimization, financial and margin analytics, smart building performance, and intelligent client reporting
  • Provide overarching oversight and governance of enterprise data architecture standards, design patterns, and data modeling principles — ensuring all engineering solutions, vendor integrations, and AI workloads conform to the established framework
  • Review and approve solution designs across engineering, AI, and vendor deliverables for alignment with data architecture standards
  • serve as the senior technical authority for data design decisions
  • Evaluate emerging AI technologies and vendors
  • build-versus-buy analysis with a bias toward owned, scalable capabilities
  • Stand up and mature MLOps practices: CI/CD for data and models, automated testing, model monitoring, drift detection, and retraining pipelines
What we offer
What we offer
  • medical
  • dental
  • vision
  • work/life resources
  • retirement savings plans like 401(k)
  • paid days off such as parental leave and disability coverage
  • Fulltime
Read More
Arrow Right

Director Data Engineering, Platform

The Director of Data Engineering, Platform is a key technical leadership role re...
Location
Location
United States , Chicago, IL; Dallas, TX; New York, NY; San Francisco, CA
Salary
Salary:
200000.00 - 300000.00 USD / Year
jll.com Logo
JLL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, Engineering, or a related technical field.
  • 10+ years of hands-on experience in data engineering, software engineering, or related fields.
  • 5+ years of formal experience in a people management role, leading and mentoring engineering teams.
  • Proven experience designing, building, and operating large-scale, cloud-native data platforms (AWS, GCP, or Azure).
  • Expert-level knowledge of modern data architecture patterns and big data technologies (e.g., Spark, Kafka, Flink, Airflow).
  • Deep experience with modern unified data platforms like Databricks, and cloud data warehouses (e.g., Snowflake, Big Query, Redshift), with a strong understanding of Lakehouse architecture.
  • Strong programming skills in at least one language, such as Python, Scala, or Java.
  • Candidates must be authorized to work in the United States without sponsorship.
Job Responsibility
Job Responsibility
  • Build, lead, mentor, and inspire a high-performing, globally distributed data platform team.
  • Define and execute the technical strategy and roadmap for the enterprise data platform.
  • Manage hiring, performance, career development, and resource allocation.
  • Champion agile methodologies, a DevOps mindset, and a culture of operational excellence.
  • Partner with the central Data Governance team to implement technical solutions that enforce data policies.
  • Build platform capabilities for data lineage, metadata management, and data quality monitoring.
  • Architect and implement robust data security controls.
  • Develop the scalable, foundational data services and self-service tools that empower Data Science and Analytics teams.
  • Build a performant and reliable platform capable of supporting the entire analytics lifecycle.
  • Engineer performant and reliable data pipelines.
What we offer
What we offer
  • 401(k) plan with matching company contributions
  • Comprehensive Medical, Dental & Vision Care
  • Paid parental leave at 100% of salary
  • Paid Time Off and Company Holidays
  • Early access to earned wages through Daily Pay
  • Fulltime
Read More
Arrow Right

Associate Director - Data Engineering

In this vital role you will manage and oversee the development of robust Data Ar...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master’s degree and 14 to 16 years of computer science and engineering preferred, other Engineering fields will be considered
  • Bachelor’s degree and 15 to 18 years of computer science and engineering preferred, other Engineering fields will be considered
  • Diploma and 18 to 20 years of computer science and engineering preferred, other Engineering fields will be considered
  • 10+ years of experience in Data Engineering, working in COE development or product building
  • 5+ years of experience in leading enterprise scale data engineering solution development.
  • Experience building enterprise scale data lake, data fabric solutions on cloud leveraging modern approaches like Data Mesh
  • Demonstrated proficiency in leveraging cloud platforms (AWS, Azure, GCP) for data engineering solutions. Strong understanding of cloud architecture principles and cost optimization strategies.
  • Hands-on experience using Databricks, Snowflake, PySpark, Python, SQL
  • Proven ability to lead and develop high-performing data engineering teams.
  • Strong problem-solving, analytical, and critical thinking skills to address complex data challenges.
Job Responsibility
Job Responsibility
  • Oversee the architecture, design, and implementation of scalable, high-performance Modern Data Engineering solutions (applications) that include data analysis, data ingestion, storage, data transformation (data pipelines), and analytics.
  • Evaluate the new trends in data engineering area and build rapid prototypes
  • Build Data Solution Architectures and Frameworks to accelerate the Data Engineering processes
  • Build frameworks to improve the re-usability, reduce the development time and cost of data management & governance
  • Integrate AI into data Engineering practices to bring efficiency through automation
  • Build and nurture strong relationships with stakeholders, emphasizing value-focused engagement and partnership to align data initiatives with broader business goals.
  • Lead and motivate a high-performing data engineering team to deliver exceptional results.
  • Provide expert guidance and mentorship to the data engineering team, fostering a culture of innovation and best practices.
  • Collaborate with counterparts in US and EU and work with business functions, functional IT teams, and others to understand their data needs and ensure the solutions meet the requirements.
  • Engage with business stakeholders to understand their needs and priorities, ensuring that data and analytics solutions built deliver real value and meet business objectives.
What we offer
What we offer
  • Competitive and comprehensive Total Rewards Plans that are aligned with local industry standards.
  • Fulltime
Read More
Arrow Right

Director Data Engineering - Bank Tech

Capital One is seeking a Director, Data Engineering who is equal parts visionary...
Location
Location
United States , Wilmington; McLean; Philadelphia
Salary
Salary:
244700.00 - 307200.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 7 years of experience in software engineering or data engineering
  • At least 5 years of people management experience
  • At least 3 years of experience with Big Data and data streaming
  • At least 3 years of experience with cloud-based data platforms (Amazon Web Services, Microsoft Azure, Google Cloud Platform)
Job Responsibility
Job Responsibility
  • Lead, manage, and grow multiple teams of product focused software & data engineers
  • Embrace and incubate emerging technology and open-source products across all platforms
  • Work to modernize our existing tech stacks and data platforms
  • Collaborate with internal teams to find areas of opportunities for automation and machine learning
  • Partner with architects, product owners, data professionals, and software & data engineers to drive the implementation of new applications
  • Work within and across Agile teams to design, develop, test, implement and support technical solutions across full-stack development tools and technologies
  • Lead efforts to deploy new and existing applications into AWS environments and provide operational support for the applications
  • Conduct design and code review to ensure compliance with standards
What we offer
What we offer
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Fulltime
Read More
Arrow Right

Director of Data Engineering and Agentic AI Automation

We are looking for a Director of Data Engineering and Agentic AI Automation to l...
Location
Location
United States , San Francisco
Salary
Salary:
347000.00 - 490000.00 USD / Year
openai.com Logo
OpenAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years in data engineering, with proven experience building and managing enterprise-scale, auditable ETL pipelines and complex datasets
  • Proficiency in SQL and Python, with demonstrated experience in schema design, data modeling, and orchestration frameworks
  • Expertise in distributed data processing technologies such as Apache Spark, Kafka, and cloud-native storage (e.g., S3, ADLS)
  • Deep knowledge of enterprise data architecture, especially within Finance and Supply Chain
  • Familiarity with financial processes (close, allocations, revenue recognition) and supply chain data models (Supply and demand planning, procurement, vendor master), along with experience in ingesting data from internal engineering systems with large volumes of B2C
  • Strong track record of partnering with senior business stakeholders and translating complex requirements into scalable technical solutions
Job Responsibility
Job Responsibility
  • Build and maintain scalable, auditable data infrastructure that powers accurate financial information, with a focus on revenue recognition, compute attribution, and close automation
  • Lead and grow teams of analytics engineers, data engineers, and AI engineers to deliver high-impact, intelligent data systems
  • Guide work across financial close and allocations automation, B2C revenue automation from engineering systems to ERP (including reconciliation with cash and source systems), and other mission-critical financial processes
  • Design and implement data pipelines connecting ERP, planning, and operational systems, including Oracle Fusion, Anaplan, and Workday
  • Build and support scalable, audit-proof architecture that enables reliable financial reporting and compliance
  • Develop data and AI-powered workflows that enhance forecasting accuracy, compliance automation, and operational efficiency
  • Create and maintain data marts and products that support stakeholders across Revenue, FP&A, Tax, Procurement, Hardware Accounting, and Controller teams
  • Define and enforce best practices for data modeling, lineage, observability, and reconciliation across finance data domains
  • Set the technical direction and manage team structure, mentoring engineers and overseeing contractors or system integrators to ensure delivery of high-quality outcomes
  • Partner with senior leaders across Finance, Engineering, and Infrastructure to align on priorities and integrate new automation capabilities
What we offer
What we offer
  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, and multiple paid coordinated company office closures throughout the year for focus and recharge, plus paid sick or safe time (1 hour per 30 hours worked, or more, as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend to fuel your professional growth
  • Daily meals in our offices, and meal delivery credits as eligible
  • Fulltime
Read More
Arrow Right