CrawlJobs Logo

Senior Data Engineer

· Job Posted December 23, 2025
Apply Position
Job Link Share

Job Description

We are looking for a Data Engineer to join our team and support with designing, implementing, and maintaining the data systems that support our Gen AI-driven applications and data-driven decision-making processes. We are looking for an experienced Senior Data Engineer to join our AI team. You will be responsible for designing and optimizing complex data storage solutions, developing and maintaining efficient data pipelines, and ensuring data quality and integrity. Working closely with data analysts, machine learning engineers, and software engineers, you will deliver relevant datasets or data APIs for downstream applications.

Job Responsibility

  • Design and optimize complex data storage solutions, including data warehouses and data lakes
  • Develop, automate, and maintain data pipelines for efficient and scalable ETL processes
  • Ensure data quality and integrity through data validation, cleansing, and error handling
  • Collaborate with data analysts, machine learning engineers, and software engineers to deliver relevant datasets or data APIs for downstream applications
  • Implement data security measures and access controls to protect sensitive information
  • Monitor data infrastructure for performance and reliability, addressing issues promptly
  • Stay abreast of industry trends and emerging technologies in data engineering
  • Document data pipelines, processes, and best practices for knowledge sharing
  • Lead data governance and compliance efforts to meet regulatory requirements
  • Collaborate with cross-functional teams to drive data-driven decision-making within the organization

Requirements

  • Minimum of 7 years plus experience in data engineering
  • Track record of deploying and maintaining complex data systems at an enterprise level within regulated environments
  • Expertise in implementing robust data security measures, access controls, and monitoring systems
  • Proficiency in data modeling and database management
  • Strong programming skills in Python and SQL
  • Knowledge of big data technologies like Hadoop, Spark, and NoSQL databases
  • Deep experience with ETL processes and data pipeline development
  • Strong understanding of data warehousing concepts and best practices
  • Experience with cloud platforms such as AWS and Azure
  • Excellent problem-solving skills and attention to detail
  • Ability to collaborate effectively with cross-functional teams
  • Strong communication skills, both written and verbal
  • Ability to keep abreast of industry trends and emerging technologies in data engineering
  • Bachelors in Computer Science or Engineering
  • Excellent command of English

Nice to have

French and Spanish language skills are a bonus

What we offer

  • Impactful work
  • Professional growth
  • Competitive compensation
  • Collaborative environment
  • Attractive salary and benefits package
  • Continuous learning and development opportunities
  • A supportive team culture with opportunities for occasional travel for training and industry events

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer

8 matching positions

Senior Data Engineer

Location
Location
United States , Remote City
Salary
Salary:
96000.00 - 192000.00 USD / Year
berettaclima.it Logo
Beretta Clima Italia
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree
  • 5+ years of experience in data engineering
  • 5+ years of experience in open lakehouse architecture in Azure, GCP, AWS and/or Snowflake
  • 5+ years of experience creating automated data pipelines and performing data modeling
  • 5+ years of experience writing SQL, Python, and modern ETL/ELT frameworks
Job Responsibility
Job Responsibility
  • Design, build, and optimize data ingestion, transformation, and delivery pipelines that support batch, micro-batch, and streaming workloads
  • Develop ETL/ELT workflows that integrate data from enterprise systems, operational platforms, external sources, and commercial applications
  • Implement scalable data processing patterns that support open lakehouse architectures and medallion-layered data products
  • Ensure pipelines are reliable, maintainable, cost-efficient, and aligned with enterprise engineering standards
  • Design data models that support analytics, reporting, and data product consumption across raw, refined, and curated layers
  • Apply medallion architecture principles to ensure data quality, reusability, and consistency across domains
  • Contribute to architectural decisions that balance performance, scalability, governance, and operational simplicity
  • Support integration of ERP and enterprise systems, ensuring data consistency and alignment with business processes
  • Implement data quality checks, validation rules, and monitoring frameworks to ensure accuracy and reliability
  • Apply foundational data governance practices including lineage, metadata management, cataloging, and access controls
What we offer
What we offer
  • Health Care Benefits: Medical, Dental, Vision
  • Wellness incentives
  • Retirement Benefits
  • Time off and Leave: Paid vacation days, up to 15 days
  • paid sick days, up to 5 days
  • paid personal leave, up to 5 days
  • paid holidays, up to 13 days
  • birth and adoption leave
  • parental leave
  • family and medical leave
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Location
Location
United States , Los Angeles
Salary
Salary:
184558.00 - 208000.00 USD / Year
videoamp.com Logo
VideoAmp
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or a related field, plus 5 years of experience
  • 5 years of experience with Data Engineering
  • 5 years of experience developing Production-Grade Software
  • 5 years of experience with SQL
  • 5 years of experience with Data Pipeline Orchestration
  • 3 years of experience with Modern Engineering Stack/Tools
  • Must also have the authority to work permanently in the U.S.
Job Responsibility
Job Responsibility
  • Apply fluency in SQL to analyze and model complex linear viewership data
  • Develop data infrastructure processing and serving software, primarily written in Python
  • Build ETL/ELT streaming and batch pipelines on big data platforms and frameworks, including Snowflake, Spark, and Databricks
  • Orchestrating data engineering pipelines with Airflow
  • Apply Fluency with modern software development environments and tooling, e.g., Git, Jira, CircleCI (or similar CI/CD), Bazel
  • Collaborate with peers within her immediate team and across the larger engineering organization on activities that include distilling engineering designs from product requirements and data science
  • development of work plans
  • implementation, testing, productization, monitoring, and maintenance of big data infrastructure
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

In this vital role as Specialist / Senior Data Engineer at Amgen you will be res...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's/Bachelor's degree and 8 to 13 years of Computer Science, IT or related field experience
  • Experience managing a team of data engineers
  • Experience architecting and building data and analytics solutions that extract, transform, and load data from multiple source systems
  • Demonstrated hands-on experience with cloud platforms (AWS) and the ability to architect cost-effective and scalable data solutions
  • Proficiency in Python, PySpark, SQL
  • Experience with dimensional data modeling
  • Experience working with Apache Spark, Apache Airflow
  • Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
  • Experienced with AWS or GCP or Azure cloud services
  • Understanding of end to end project/product life cycle
Job Responsibility
Job Responsibility
  • Lead and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous learning for solving complex problems of R&D division
  • Oversee the development of data extraction, validation, and transformation techniques, ensuring ingested data is of high quality and compatible with downstream systems
  • Guide the team in writing and validating high-quality code for data ingestion, processing, and transformation, ensuring resiliency and fault tolerance
  • Drive the development of data tools and frameworks for managing and accessing data efficiently across the organization
  • Oversee the implementation of performance monitoring protocols across data pipelines, ensuring real-time visibility, alerts, and automated recovery mechanisms
  • Coach engineers in building dashboards and aggregations to monitor pipeline health and detect inefficiencies, ensuring optimal performance and cost-effectiveness
  • Lead the implementation of self-healing solutions, reducing failure points and improving pipeline stability and efficiency across multiple product features
  • Oversee data governance strategies, ensuring compliance with security policies, regulations, and data accessibility best practices
  • Guide engineers in data modeling, metadata management, and access control, ensuring structured data handling across various business use cases
  • Collaborate with business leaders, product owners, and cross-functional teams to ensure alignment of data architecture with product requirements and business objectives
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, build, and opt...
Location
Location
Poland
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake, and strong programming skills in Python and SQL. Proven experience building batch and streaming data pipelines and production-grade data platforms, with solid understanding of data modeling, data quality, and governance principles. Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP. Familiarity with modern data platforms such as Databricks and Snowflake is expected. Experience with lakehouse architectures and distributed data systems, and strong understanding of scalability, reliability, and performance considerations in data pipelines. Strong problem-solving skills focused on scalability and reliability, with a collaborative approach to working in cross-functional teams.
Job Responsibility
Job Responsibility
  • Design and implement scalable data platforms and pipelines across cloud environments
  • develop reliable batch, streaming, and near-real-time pipelines
  • implement modern data architectures including lakehouse patterns and medallion layering
  • deliver high-quality datasets supporting analytics, machine learning, causal modeling, and optimization systems
  • enable data pipelines for GenAI use cases
  • design scalable logical and physical data models
  • orchestrate workflows using tools such as Airflow, dbt, Lakeflow
  • apply modern architecture patterns including event-driven and streaming architectures
  • ensure adherence to best practices in data governance, lineage, quality, and access control
  • establish strong data observability
What we offer
What we offer
  • 24 working days of paid vacation
  • National holidays covered
  • Sick leave (up to 20/year)
  • Unpaid leave (up to 20/year)
  • Medical insurance
  • Multisport card OR Multikafeteria
  • Maternity & paternity leave support
  • Internal workshops & learning initiatives
  • Professional certifications reimbursement
  • Participation in professional local & global communities
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

As a Senior Data Engineer, you will provide thought leadership and deliver cutti...
Location
Location
Australia , Brisbane
Salary
Salary:
Not provided
aurizon.com.au Logo
Aurizon
Expiration Date
June 28, 2026
Flip Icon
Requirements
Requirements
  • Relevant degree in computer science, engineering, statistics, mathematics or similar
  • Senior data engineering or data warehousing expertise
  • Deep experience architecting scalable modern data platforms (cloud and/or on‑prem)
  • Strong capability across data modelling, transformation, cleansing and publication
  • Experience with machine learning frameworks, modern programming tools and agile delivery
  • Ability to explain technical concepts simply to business stakeholders
  • Strong collaboration skills — you enjoy working with SMEs, senior managers and executives
  • Exceptional communication and problem‑solving abilities
Job Responsibility
Job Responsibility
  • Build and deliver end‑to‑end enterprise data pipelines to drive operational, financial and commercial improvements
  • Provide expert guidance on data architecture, solution design, standards and best practice
  • Lead the development and continuous improvement of scalable data platforms
  • Support acquisition, integration, retention and publication of complex data across diverse business use cases
  • Prototype and develop next‑generation on‑prem and cloud-based data solutions across structured and unstructured datasets
  • Balance innovation with value, practicality and risk
  • Improve service delivery, technical support and change management processes
What we offer
What we offer
  • Development and growth opportunities
  • Access to mentoring and development programs
  • Discounts on selected health insurance funds, personal travel, gyms, vehicles and retail brands
  • Parental leave program and super booster
  • Fulltime
!
Read More
Arrow Right

Senior Data Engineer

In this role, you will work closely with the Digital Innovation team to design, ...
Location
Location
Canada , Vancouver
Salary
Salary:
140000.00 - 175000.00 USD / Year
klohn.com Logo
Klohn Crippen Berger
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field (or equivalent practical experience)
  • 7+ years in data engineering and enterprise data platforms, including hands-on Microsoft Fabric experience
  • Hands-on experience with Microsoft Fabric, OneLake, and Power BI
  • Experience designing and implementing enterprise data pipelines and architectures
  • Strong understanding of Medallion Architecture and modern data platform concepts
  • Experience with Azure data services and cloud-based data platforms
  • Knowledge of RBAC, and compliance best practices
  • Strong analytical and troubleshooting skills
  • Experience working with large-scale enterprise datasets
  • Strong oral and written communication skills
Job Responsibility
Job Responsibility
  • Support the implementation, optimization and governance of Microsoft Fabric and OneLake environments
  • Develop and maintain scalable data ingestion pipelines, workflows and enterprise data models
  • Design and implement Medallion Architecture (Bronze, Silver, Gold) solutions
  • Support Power BI semantic modeling, reporting, and analytics initiatives
  • Integrate and support Microsoft Purview governance capabilities
  • Assist with data quality, RBAC, security, compliance, and governance requirements
  • Collaborate with technical stakeholders to support enterprise reporting and AI initiatives
  • Troubleshoot and optimize Fabric workloads, pipelines, and data models for scalability and performance
  • Document technical solutions, processes, and standards
What we offer
What we offer
  • Hybrid work opportunities
  • Annual performance and salary review
  • Vacation policy that aligns to your experience
  • Flexible benefits, including RSP, social, and mental well-being initiatives
  • Paid OT, and sick days
  • Commitment to global ESG standards
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Location
Location
United Kingdom , London
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineering & Pipeline Architecture: End-to-end data engineering covering real-time and batch ingestion, ETL pipelines, and full lifecycle (ingestion → processing → consumption) using AWS, SQL, Java, and Python
  • Cloud Data Platforms & Distributed Systems: Hands-on experience with AWS data platforms, Data Lakes, Databricks, and federated architectures, including integration across multiple enterprise data sources
  • Data Governance, Modelling & Metadata Management: Strong expertise in large-scale SQL data modelling, enterprise data cataloguing (Alation), data governance, metadata management, and regulatory-aligned data frameworks
Job Responsibility
Job Responsibility
  • Provision of guidance and expertise to engineering teams to ensure alignment with best practices and foster a culture of technical excellence
  • Contribution to strategic planning by aligning technical decisions with business goals, anticipating future technology trends, and providing insights to optimize product roadmaps
  • Design and implementation of complex, scalable, and maintainable software solutions, considering long-term viability and business objectives
  • Mentoring and coaching to junior and mid-level engineers to foster professional growth and knowledge sharing, elevating the overall skillset and capabilities of the organization
  • Collaboration with business partners, product managers, designers, and other stakeholders to translate business requirements into technical solutions and ensure a cohesive approach to product development
  • Innovation within the organization by identifying and incorporating new technologies, methodologies, and industry practices into the engineering process
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Senior Data Engineer - UKRAINE - REMOTE. We are looking for an experienced Senio...
Location
Location
Ukraine
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake
  • strong programming skills in Python and SQL
  • proven experience building batch and streaming data pipelines and production-grade data platforms
  • solid understanding of data modeling, data quality, and governance principles
  • experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP
  • familiarity with modern data platforms such as Databricks and Snowflake
  • experience with lakehouse architectures and distributed data systems
  • strong understanding of scalability, reliability, and performance considerations in data pipelines
  • strong problem-solving skills focused on scalability and reliability
  • collaborative approach to working in cross-functional teams
Job Responsibility
Job Responsibility
  • Build & Data Platform Engineering: design and implement scalable data platforms and pipelines across cloud environments
  • develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
  • build ingestion, transformation, and curation workflows for both structured and unstructured data
  • implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold)
  • Enable AI, GenAI & Data Products: deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems
  • enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows) and agent-based architectures and intelligent workflows
  • Data Modeling, Orchestration & Automation: design scalable logical and physical data models for analytical and operational use cases
  • orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents
  • Architecture, Governance & Observability: apply modern architecture patterns including event-driven and streaming architectures
  • ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC)
What we offer
What we offer
  • Mental and physical health: Medical insurance
  • Sports reimbursement budget
  • Home office support
  • A number of free psychological and legal consultations
  • Maternity and paternity leave support
  • Personal and professional development: Internal workshops and learning initiatives
  • English language classes compensation
  • Professional certifications reimbursement
  • Participation in professional local and global communities
  • Growth Framework to manage expectations and define the steps to move towards the selected career
  • Fulltime
Read More
Arrow Right