CrawlJobs Logo

Data Catalogue Engineer

https://www.soprasteria.com Logo

Sopra Steria

Location Icon

Location:
India , Noida

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are looking for one Data Catalogue Engineer responsible for maintaining, enhancing, and supporting the organization's Data catalogue platform. The role supports Metadata management and Data stewardship, ensuring data assets from systems such as Snowflake, BigQuery, and dbt are accurately catalogued, governed, and easily discoverable. Additionally, the role involves using Python to develop automation scripts, templates, and reusable frameworks that streamline metadata ingestion and catalogue operations.

Job Responsibility:

  • Maintain, enhance, and support the organization's Data catalogue platform (e.g. Atlan, Collibra)
  • Support Metadata management and Data stewardship
  • Ensure data assets from systems such as Snowflake, BigQuery, and dbt are accurately catalogued, governed, and easily discoverable
  • Use Python to develop automation scripts, templates, and reusable frameworks that streamline metadata ingestion and catalogue operations
  • Act as an advisor to Data Architects, Data Governance Officers, Data Product Owners and Managers

Requirements:

  • 10+ years of experience in Data cataloguing, Metadata management and Data stewardship
  • Administer and maintain the Data catalogue platform, managing user roles, permissions, and configurations
  • Schedule, monitor, and troubleshoot metadata ingestion
  • Experience of automating process automate metadata extraction, transformation, and loading processes into the catalogue using Python
  • Coordinate with platform and infrastructure teams for upgrades, enhancements, and patches
  • Strong background in Data Governance, Data Quality, and Master data Management (MDM)
  • Strong expertise in Data Catalogue (e.g. Atlan, Collibra) and Data Stewardship
  • Strong expertise in Snowflake/BigQuery/dbt
  • In-depth knowledge of Data Governance, Data Quality, and MDM frameworks
  • Experience of working with Python
  • Strong knowledge of Data security, Data privacy, and Compliance frameworks
  • Awareness of Data governance, compliance, and data security standards
  • Excellent documentation skills, Strong stakeholder management and Communication skills
  • BE / B.Tech/ MS/ M.Tech/ MCA qualification
  • Total Experience Expected: 08-10 years
What we offer:
  • Commitment to fighting against all forms of discrimination
  • Inclusive and respectful work environment
  • All positions open to people with disabilities

Additional Information:

Job Posted:
November 14, 2025

Employment Type:
Fulltime
Icon
Sopra Steria - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon
PREMIUM
More languages and countries
+ Unlock 31694 hidden job offers
Languages
English Čeština Deutsch Ελληνικά Español Français +15
Countries
United States United Kingdom India Canada Australia +
See plans
Plans from $2.99 / month

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Catalogue Engineer

Data Engineer / Scientist

As a Data Engineer/Scientist at Actica, you will have the opportunity to design,...
Location
Location
United Kingdom , London; Guildford; Bristol; M4 corridor
Salary
Salary:
Not provided
actica.co.uk Logo
Actica Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Coding expertise in Python or R
  • Collaborative, team-based development
  • Cloud analytics platforms e.g. relevant AWS and Azure platform services
  • Hands on experience with Palantir ESSENTIAL
  • Data science approaches and tooling e.g. Hadoop, Spark
  • Data engineering approaches
  • Database management, e.g. MySQL, Postgres
  • Software development methods and techniques e.g. Agile methods such as SCRUM
  • Software change management, notably familiarity with git
  • Public sector best practice guidance, e.g. ITIL, OGC toolkit
Job Responsibility
Job Responsibility
  • Design, implement, and maintain scalable data pipelines and ETL processes
  • Develop and maintain data warehouses and data lakes
  • Implement data quality monitoring and validation systems
  • Create and maintain data documentation and cataloguing systems
  • Optimize data storage and retrieval systems
  • Implement data security and governance frameworks
  • Build and maintain data APIs and services
  • Translate business problems into data queries and solutions
  • Develop and deploy machine learning models
  • Create advanced analytics solutions
What we offer
What we offer
  • 25 days of paid leave per annum plus 8 UK bank holidays
  • Discretionary, Performance-Based Bonus Scheme
  • Enrolment in Stakeholder Pension Scheme
  • Cycle To Work Scheme
  • Employee Assistance Programme
  • Electric Vehicle Leasing Scheme
  • Private Medical Insurance
  • Fulltime
Read More
Arrow Right

Ab Initio Data Engineer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Chennai; Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in a quantitative field (such as Engineering, Computer Science, Statistics, Econometrics)
  • Minimum 5 years of extensive experience in design, build and deployment of Ab Initio-based applications
  • Expertise in handling complex large-scale Data Lake and Warehouse environments
  • Hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities
Job Responsibility
Job Responsibility
  • Ability to design and build Ab Initio graphs (both continuous & batch) and Conduct>it Plans
  • Build Web-Service and RESTful graphs and create RAML or Swagger documentations
  • Complete understanding and analytical ability of Metadata Hub metamodel
  • Strong hands on Multifile system level programming, debugging and optimization skill
  • Hands on experience in developing complex ETL applications
  • Good knowledge of RDBMS – Oracle, with ability to write complex SQL needed to investigate and analyze data issues
  • Strong in UNIX Shell/Perl Scripting
  • Build graphs interfacing with heterogeneous data sources – Oracle, Snowflake, Hadoop, Hive, AWS S3
  • Build application configurations for Express>It frameworks – Acquire>It, Spec-To-Graph, Data Quality Assessment
  • Build automation pipelines for Continuous Integration & Delivery (CI-CD), leveraging Testing Framework & JUnit modules, integrating with Jenkins, JIRA and/or Service Now
  • Fulltime
Read More
Arrow Right

Palantir Data Engineer

We are seeking an experienced Palantir Data Engineer to support large-scale tran...
Location
Location
Romania
Salary
Salary:
Not provided
airswift.com Logo
Airswift Sweden
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience with Palantir and Spark in large transformation projects
  • Strong background in data engineering, data modelling, and data quality
  • Proficiency with Git and automated testing frameworks
  • Familiarity with data catalogue tools
Job Responsibility
Job Responsibility
  • Design and implement data pipelines within Palantir and Spark environments
  • Develop and maintain data models, catalogues, and quality frameworks
  • Collaborate on workshops and AIP Logic initiatives (Agentic AI advantageous)
  • Integrate automated testing and version control (Git) into workflows
  • Support ontology development and chatbot integration
  • Contribute to front-end applications using React and TypeScript
  • Fulltime
Read More
Arrow Right
New

Data Architect

As a Data Architect, you are passionate about experience innovation and eager to...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Systems, Data Engineering, or equivalent professional experience
  • 10+ years of progressive experience in data architecture, data platform engineering, or enterprise BI/analytics roles
  • Demonstrable experience as a lead data architect on at least two large-scale enterprise data platform programmes
  • 3NF — operational and transactional layer design
  • Dimensional modelling — Kimball star/snowflake, slowly changing dimensions
  • Data Vault 2.0 — hubs, links, satellites, business keys
  • Data mesh & domain-oriented data product design
  • Architecture Decision Records (ADRs) and C4 modelling
  • Data contract design — schema, SLAs, versioning
  • Data catalogue & metadata management design
Job Responsibility
Job Responsibility
  • Define and document the end-to-end target-state data architecture for enterprise client programmes — covering ingestion, storage, transformation, serving, and consumption layers
  • Establish domain-driven data architecture boundaries aligned to business domains (e.g. Product, Customer, Order, Finance) using Domain-Driven Design (DDD) principles
  • Lead architecture design sessions with clients to align on technology choices, topology, and migration sequencing
  • Produce architecture artefacts to a consultancy standard: C4 diagrams, data flow diagrams, architecture decision records (ADRs), and technology selection rationale documents
  • Evaluate and recommend GCP-native vs. third-party component trade-offs — with clear cost, scalability, and maintainability justification
  • Define and enforce enterprise data modelling standards across the programme — covering 3NF (operational layer), dimensional modelling (Kimball star/snowflake for analytics), and Data Vault 2.0 (historized, auditable Lakehouse layers) as appropriate
  • Establish canonical data models for core business domains — ensuring consistency across squads and brands or business units
  • Design and govern the metadata framework: schema standards, naming conventions, entity definitions, data dictionaries, and lineage documentation
  • Oversee data contract design between producing and consuming domains — defining SLAs, schemas, versioning, and change management protocols
  • Ensure models are optimized for the target query engine — BigQuery partitioning/clustering strategies, Delta Lake Z-ordering, and Databricks Photon engine considerations
What we offer
What we offer
  • Flexibility, with remote and hybrid work options (country-dependent)
  • Career advancement, with international mobility and professional development programs
  • Learning and development, with access to cutting-edge tools, training and industry experts
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

Working for Movember, you’ll help raise millions for men’s health (not for a CEO...
Location
Location
Australia , Melbourne
Salary
Salary:
Not provided
ex.movember.com Logo
Movember
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years experience in data engineering, analytics engineering or data platform roles, including ownership of a production analytics warehouse or data platform
  • Demonstrated hands-on Snowflake expertise (schema design, dimensional modelling, performance optimisation, access controls)
  • Experience operating and supporting a live data platform, including monitoring, reliability and incident management
  • Proven experience designing and delivering business-facing Data Marts
  • Experience building and maintaining production data pipelines in AWS (Lambda, Glue, S3, IAM or similar)
  • Advanced SQL and strong Python in production environments
  • Experience implementing data governance controls (access management, classification, documentation standards)
  • Experience working directly with non-technical stakeholders to define datasets and evolve data capability
  • Experience enabling self-service analytics through curated, well-documented datasets
  • Experience implementing CI/CD for data deployments
Job Responsibility
Job Responsibility
  • Own and operate Movember’s organisation-wide data platform, ensuring reliability, scalability and performance
  • Design, build and maintain automated data pipelines (AWS Lambda, Glue, S3) across fundraising, CRM, campaign and program systems
  • Lead and optimise Snowflake architecture across staging, curated, conformed and Data Mart layers
  • Design and deliver high-quality, business-ready Data Marts that enable trusted self-service analytics
  • Partner proactively with Insights, Campaign, Marketing and MEL teams to evolve data practices and bring stakeholders on the journey
  • Drive the next evolution of our data capability across the organisation, not just maintain existing pipelines
  • Implement and mature data governance, role-based access controls and data quality frameworks
  • Establish and improve our data marketplace model so teams can confidently discover and use certified datasets
  • Implement data catalogue and metadata tooling, including lineage and documentation standards
  • Structure well-modelled datasets to support advanced analytics and AI-driven use cases
What we offer
What we offer
  • Flexible hybrid working from home and our modern Richmond office
  • Finish work at 2pm on Fridays (Dec-Aug)
  • NFP salary packaging (pay less tax)
  • 13 weeks paid parental leave and 5 weeks annual leave
  • Fun & collaborative culture with employee social events
  • Free Headspace subscription and other wellbeing initiative
  • Relaxed dress code
  • Fulltime
Read More
Arrow Right

Data Governance Program Manager

Digital Transformation PMO - Data Governance Program Manager. This role is accou...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in IT, Computer Science, Software Engineering, Data, Business Analytics or equivalent
  • Minimum 10 years of experience in data or corporate governance setup and operationalization
  • Experience in SAP MDG, S4 HANA roll out, Data Harmonization and Data Cleansing
  • Experience in Material, Vendor, BOM master Data
  • Certification in industry standard data architecture discipline or similar (e.g. DCAM, DAMA)
  • Experience in operating under Data Office organization
  • Expert in consulting and helping business to develop data quality business rules, data catalogue, business glossary
  • Ability to develop, implement & optimize complex data governance solution and issues
  • Experience in Data, Privacy, Protection implementations & operationalization
  • Experience in Big Data and associated platform / technology knowledge
Job Responsibility
Job Responsibility
  • Establish, develop and optimize Data Governance Framework, Policy, Process & associated business program / solutions implementations for Global Operation team
  • Define data governance, data management frameworks and solutions together with Chief Data Officer team, IT and Global Operation functional groups
  • Support business units in digital transformation journey with data governance
  • Enable Data Governance framework including managing the objectives, approach, processes, policies and procedures around data governance
  • Build robust and scalable data governance ecosystem to support business needs
  • Define data governance operational processes (e.g., data quality measurement, metadata management) in accordance with policies and standards
  • Provide expert consultation to business units to establish and maintain data policies and standards that enable use-cases
  • Provide expert consultation to assist business units in identify and setup of critical data elements including the setup of data lineage, data catalogue and data quality
  • Work collaboratively & consultatively with chief data officer, business units, IT to deliver enterprise objectives around data governance
  • Identify, design, and implement internal process & framework improvements: automating manual operational processes and control for data governance implementation
What we offer
What we offer
  • Health & Wellbeing comprehensive suite of benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion in an inclusive environment
  • Fulltime
Read More
Arrow Right

Data Engineer

We are investing massively in developing next-generation AI tools for multimodal...
Location
Location
United Kingdom; Greece; Lithuania
Salary
Salary:
Not provided
satalia.com Logo
Satalia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency with the Python and SQL programming languages
  • Hands-on experience with cloud platforms like AWS, GCP, or Azure, and familiarity with big data technologies such as Hadoop or Spark
  • Experience working with relational databases and NoSQL databases
  • Strong knowledge of data structures, data modelling, and database schema design
  • Experience in supporting data science workloads and working with both structured and unstructured data
  • Familiarity with containerization technologies, such as Docker or Kubernetes
Job Responsibility
Job Responsibility
  • Collaborate closely with data scientists, architects, and other stakeholders to understand and implement business requirements
  • Provide data engineering support for AI model development and deployment, ensuring data scientists have access to the data they need in the format they need it
  • Implement and optimize data transformations and ETL/ELT processes, using appropriate data engineering tools
  • Work with a variety of databases and data warehousing solutions to store and retrieve data efficiently
  • Implement monitoring, troubleshooting, and maintenance procedures for data pipelines to ensure the high quality of data and optimize performance
  • Participate in the creation and ongoing maintenance of documentation, including data dictionaries, data catalogues, data flow diagrams, and process documentation
What we offer
What we offer
  • enhanced pension
  • life assurance
  • income protection
  • private healthcare
  • Remote working
  • Truly flexible working hours
  • Generous Leave - holiday plus bank holidays and enhanced family leave
  • Annual bonus
  • Impactful projects
  • People oriented culture
  • Fulltime
Read More
Arrow Right
New

Data Onboarding & Cataloguing - KDB

We’re seeking a Data Onboarding & Cataloguing specialist for the KDB platform to...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experienced front-office data engineer specialising in the systematic onboarding and cataloguing of trading data at scale
  • Strong understanding of the practical challenges around metadata, data quality, lineage, ownership, and entitlement alignment in complex trading ecosystems
  • Delivered robust, tool-agnostic solutions that turn fragmented data landscapes into well-governed, discoverable, and reusable data products across multiple asset classes
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right