CrawlJobs Logo

Data Engineer

South Africa, Cape Town · Job Posted June 16, 2026
Apply Position
Job Link Share

Job Description

Collinson is the global, privately-owned company dedicated to helping the world to travel with ease and confidence. We use our expertise and products to craft customer experiences which enable some of the world's best known brands to acquire, engage and retain the most demanding and choice-rich customers. In particular, our unique expertise and insight into high earning, frequent travellers allows us to create products and solutions for our clients that inspire greater customer engagement to drive more profitable relationships, enrich their travel experiences, protect what matters and assist in in times of need. While specialising in Financial Services, Travel and Retail, we also support clients in multiple sectors. We have worked with over 90 airlines, 20 hotel groups and more than 600 financial institutions and banks, with clients including Accor Hotels, Air France KLM, American Express, British Airways, Cathay Pacific, Diners Club, Mandarin Oriental, Mastercard, Radisson Hotel Group, Sephora, Visa and Vhi. We take our 30 years' experience working with these kinds of household names in over 170 countries, and help our clients to deliver the smarter experiences it takes to differentiate their propositions, and help them win deeper devotion with their customers. Collinson is a privately-owned entrepreneurial business with 2,000 passionate people working in 20 locations worldwide. Our solutions include Priority Pass, the world's best known airport experiences programme, while we are also the trusted partner behind many of the leading financial services, airline and hotel brand's reward programmes and loyalty initiatives. Purpose of the job The Full-Stack Data Engineer will play a critical role in Collinson's efforts to deliver customer-centric global solutions with a focus on hands-on execution. As a key member of the data engineering team, you will be responsible for designing, building, and maintaining data pipelines and infrastructure in both AWS and other cloud environments. Your hands-on experience in delivering real-world solutions will be invaluable as the team works to modernize its data landscape. In this hands-on role, you will be tasked with leveraging your technical expertise to deliver customer centric solutions that meet the unique needs of internal and external stakeholders across the Collinson group's global footprint. Additionally, you will have the opportunity to bring innovation to the team, using cutting-edge data engineering frameworks and techniques. As a Full-Stack Data Engineer, you will be expected to not only deliver on technical projects, but also to mentor junior members of the team and help them get up to speed quickly. Strong communication and interpersonal skills are essential, as you will be working closely with stakeholders and clients to understand their data needs and help bring their data-driven initiatives to life.

Job Responsibility

  • Design, develop, and maintain data pipelines for collecting, transforming, and loading data into various data stores
  • Build and maintain data warehousing and data lake solutions
  • Develop and deploy data models that support various business requirements
  • Write efficient and scalable code in languages such as Python, Scala, or Java
  • Lead the design of data solutions with quality, automation, and performance in mind
  • Own the data pipelines feeding into the Data Platform ensuring they are reliable and scalable
  • Ensure data is available in a fit-for-purpose and timely manner for business and analytics consumption
  • Work with Data Governance team to ensure solutions are compliant with regulations such as GDPR and CISO policies and data quality is baked-in to pipelines
  • Maintain and optimise existing data pipelines to improve performance and quality, minimising impacts to business
  • Collaborate with cross-functional teams to understand data requirements and provide support for data-driven initiatives
  • Set and embed standards for systems and solutions, and share knowledge to keep the team engaged and skilled in the latest technology
  • Prototype and adopt new approaches, driving innovation into the solutions
  • Work closely with the Data Product Manager to support alignment of requirements and sources of data from line of business systems and other endpoints
  • Effectively communicate plans and progress to both technical and non-technical stakeholders
  • Develop and implement the Data roadmap for strategic data sets
  • Communicate complex solutions in a clear and understandable way to both experts and nonexperts
  • Mentor and guide junior members of the team to help them get up to speed in a short amount of time
  • Interact with stakeholders and clients to understand their data requirements and provide solutions
  • Stay up-to-date with industry trends and technology advancements in data engineering
  • Promote the Data Platform and Data & Analytics team brand throughout the business and represent the interests of data engineering in cross-functional forums
  • Champion the importance of modern data solutions across the business and support the education of colleagues on the business value of obtaining good quality data

Requirements

  • Extensive experience leading AWS and cloud data platform transformations
  • Proven track record of delivering large-scale data and analytical solutions in a cloud environment
  • Hands-on experience with end-to-end data pipeline implementation on AWS, including data preparation, extraction, transformation & loading, normalization, aggregation, warehousing, data lakes, and data governance
  • Expertise in developing Data Warehouses
  • In-depth understanding of modern data architecture such as Data Lake, Data Warehouse, Lakehouse, and Data Mesh
  • Strong knowledge of data architecture and data modelling practices
  • Cost-effective management of data pipelines
  • Familiarity with CI/CD driven data pipeline and infrastructure
  • Agile delivery approach using Scrum and Kanban methodologies
  • Ability to scope, estimate, and deliver committed work within deadlines, both independently and as part of an agile team
  • Supporting QA and user acceptance testing processes
  • Innovative problem-solving skills and ability to provide clear recommendations
  • Understanding of the impact of changes to business rules on data processes
  • Excellent communication and influencing skills, especially in regard to data solutions and outcomes
  • Experience managing and leading a small team of data engineers
  • Self-driven and constantly seeking opportunities to improve data processes
  • Strong knowledge of how data drives analytical and reporting activities, including automated marketing and personalization capabilities
  • Python, PySpark, SQL, NoSQL DBs (Mongo), Bash Scripting, Snowflake, DBT, Kafka, Airflow, Glue, Github, shell Scripting, AWS, Kinesis, Terraform, APIs, and Lakehouse

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

The Role: We are seeking a passionate Data Engineer to design scalable, robust s...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 16, 2026
Flip Icon
Requirements
Requirements
  • Deep expertise in data engineering with the ability to extend into backend services
  • Proven experience building pipelines for large-scale transactional or financial data
  • Fluency in Scala (Scio/Dataflow) and comfort with cloud-native development on GCP
  • Strong communication skills to collaborate with Finance, Product, and Engineering teams to ship auditable, reliable systems that meet regulatory scrutiny
  • Ability to thrive in fast-moving, ambiguous spaces while prioritizing long-term sustainability
Job Responsibility
Job Responsibility
  • Design scalable, robust systems that turn large-scale consumption and royalty data into accurate payouts
  • Build self-serve tools for our Finance team
  • Develop modular, easily maintainable platform capabilities
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Design, develop, and maintain data solutions, pipelines and analytics applicatio...
Location
Location
United States , Alpharetta
Salary
Salary:
Not provided
iqzsystems.com Logo
IQZ Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • MS or foreign equivalent in Computer Science or Engineering (any) or Information Systems or Data Science or Related
  • 1 year experience in data storage, analysis and pipelines, ETL, Apache Kafka and Apache Storm
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions, pipelines and analytics applications using various tools and technologies including Hadoop, Spark, Hive, Kafka, SQL, MapReduce, Apache Kafka, Apache Storm, AWS, Snowflake etc
  • Gather & analyze requirements
  • Identify and implement process improvements
  • Assemble large, complex data sets to meet requirements
  • Implement methods to improve data reliability and data quality
  • Design and develop frameworks to stream data
  • Optimize data delivery and re-design infrastructure for greater scalability
  • Perform troubleshooting and provide issue resolution and similar duties
  • Fulltime
Read More
Arrow Right
New

Data Engineer

As a Data Engineer in our Finance Systems and Analytics team, you’ll help design...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience building and maintaining data pipelines and scalable data products using structured and unstructured data
  • Strong knowledge of SQL, ideally within a Snowflake environment
  • Experience with at least one server-side language such as Python, Java, Kotlin or NodeJS or experience with Alteryx
  • Knowledge of event-driven, loosely coupled architectures and data processing patterns
  • Experience working with CI/CD tools such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development approaches
  • Experience with automated testing techniques within data or software engineering environments
  • Proven experience working in the energy industry
  • Ability to translate complex data concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Building and maintaining scalable data products that deliver insight across finance systems
  • Designing and optimising ETL processes to ensure data integrity and performance
  • Collaborating with engineers, analysts, and business teams to define and deliver data solutions
  • Contributing to agile delivery, including planning, retrospectives, and continuous improvement
  • Supporting the operational performance, monitoring, and reliability of data platforms
What we offer
What we offer
  • Competitive salary and potential for an annual bonus
  • Market-leading pension scheme
  • Electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer. At Barclays, we don’t just adapt to the future, we c...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience in ETL technologies, Ab Initio GDE and EME
  • Strong hands-on experience on SQL, Hive, Impala
  • Strong hands-on experience on Unix, Hadoop, Spark
  • Hands-on experience in Python
  • Experience working with cloud platforms, especially AWS
  • Strong knowledge of Data warehousing
  • Proficiency in Gitlab, CI/CD
  • Practical knowledge and hands‑on experience with AI-powered development tools such as Copilot, Claude Code, and GitLab Duo
  • Familiarity with data visualization tools such as Tableau, Grafana
  • Knowledge of data messaging platforms like Apache Kafka
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer. At Barclays, we don't just adapt to the future, we c...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands on experience in Abinitio ETL tool
  • Hands on experience in python and pyspark and strong knowledge on Dataframes, RDD and SparkSQL
  • Hands on Experience in developing, testing and maintaining applications on AWS Cloud
  • Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena)
  • Experience in Writing advanced SQL and PL SQL programs
  • Experience in AWS data pipeline development
  • Hands On Experience for building reusable components using AWS Tools/Technology
  • Should have worked at least on two major project implementations
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays, where you will spearhead the evolution o...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong in Abinitio (GDE), Unix and Data warehousing concepts
  • Working experience in Linux/UNIX
  • Ability to understand source to target ETL mappings
  • Ability to design, develop and maintain Abinitio graphs
  • Ability to explain functional and technical details
  • Well versed in data integration, batch processing, and delta processing
  • Hands-on experience on UNIX shell scripts to automate routine task
  • Strong understanding on job schedulers
  • Hands-on experience on database
  • Analyse and trouble shoot issues
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a Data Engineer with strong experience in Microsoft Azure and Dat...
Location
Location
United States , Jacksonville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of Data Engineering experience
  • Hands-on experience with Azure Databricks
  • Experience with Azure services such as: Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure SQL Database
  • Strong SQL development skills
  • Experience with Python, PySpark, or Spark
  • Experience building and maintaining ETL/ELT pipelines
  • Understanding of data warehousing concepts and dimensional modeling
  • Experience working with large datasets in cloud environments
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data pipelines in Azure and Databricks
  • Build and optimize ETL/ELT processes for structured and unstructured data
  • Develop and support data lake, data warehouse, and analytics solutions
  • Integrate data from multiple internal and external sources
  • Collaborate with business analysts, data scientists, and stakeholders to understand data requirements
  • Ensure data quality, integrity, security, and governance standards are met
  • Monitor and troubleshoot data workflows and performance issues
  • Create and maintain technical documentation and data models
  • Support reporting and analytics initiatives by delivering reliable datasets
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

Design, build, and maintain scalable data pipelines and ETL/ELT processes. Devel...
Location
Location
United States , Austin
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience in data engineering, data integration, or a related role
  • Strong proficiency in SQL and experience working with large, complex datasets
  • Experience building and maintaining ETL/ELT data pipelines
  • Proficiency in at least one programming language (Python, Java, Scala, or similar)
  • Hands‑on experience with data warehouses and data platforms (Snowflake, Redshift, BigQuery, Databricks, etc.)
  • Experience working in cloud environments (AWS, Azure, or GCP)
  • Familiarity with data modeling, schema design, and performance optimization
  • Experience integrating data from APIs, databases, and streaming sources
  • Strong problem‑solving and troubleshooting skills related to data pipelines and performance
  • Ability to collaborate with data analysts, data scientists, and business stakeholders
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines and ETL/ELT processes
  • Develop and manage data architectures such as data warehouses, data lakes, and lakehouses
  • Ingest and integrate data from multiple sources (databases, APIs, streaming platforms)
  • Ensure data quality, integrity, and reliability across systems
  • Optimize data processing, storage, and query performance
  • Collaborate with data analysts, data scientists, and business teams to support analytics and reporting needs
  • Implement automation for data workflows, monitoring, and error handling
  • Troubleshoot and resolve data pipeline issues and performance bottlenecks
  • Support batch and real‑time data processing frameworks
  • Document data models, pipelines, and data engineering processes
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • enrollment in company 401(k) plan
Read More
Arrow Right