CrawlJobs Logo

Senior Data Engineer

https://www.soprasteria.com Logo

Sopra Steria

Location Icon

Location:
Poland , Katowice ▼

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Employment contract, B2B

Salary Icon

Salary:

16000.00 - 22000.00 PLN / Month
Save Job
Save Icon
Apply Position

Job Description:

We are looking for Senior Data Engineer to join Sopra Steria Polska a team for a client in the banking sector. You will be working in a stable environment in an international team working for one of the most popular Dutch banks.

Job Responsibility:

  • Build and maintain data pipelines and platforms in Databricks and Azure using Apache Spark
  • Ensure data security, governance, and compliance using Unity Catalog and best practices
  • Develop reusable Python libraries for integration across Databricks and Azure Functions
  • Designing and implementing batch data pipelines in Databricks using Apache Spark (PySpark) and Delta Lake
  • Applying Spark performance tuning techniques (e.g., partitioning, caching, broadcast joins, shuffle optimization) for large-scale data processing
  • Setting up and managing Unity Catalog for data governance and security
  • Building Python libraries for reusable business logic and utilities, used in Databricks Spark jobs and Azure Functions to expose APIs
  • Developing CI/CD pipelines in Azure DevOps for data workflows and infrastructure deployment
  • Collaborating with stakeholders to understand data requirements and deliver solutions that create customer value

Requirements:

  • 5+ years of experience in data engineering roles
  • Deep hands-on experience with Databricks, including Unity Catalog, Delta Lake, and Lakehouse architecture
  • Strong proficiency in Apache Spark, including PySpark, Spark SQL, and Spark performance tuning
  • Experience creating Python libraries for reusable components and API integration
  • Experience with Azure Cloud services (Data Lake, Key Vault, Active Directory, App Services)
  • Familiarity with SQL Server and relational database concepts
  • Understanding of data security principles and compliance requirements
  • Experience building CI/CD pipelines in Azure DevOps for data workflows
  • Infrastructure as Code (Bicep or Terraform)
  • Good communication skills and a team player
  • Experience with Agile ways of working
  • English B2/C1
  • Being open to occasional business trips abroad and visits in our office in Katowice or Gdańsk
  • EU Citizenship

Nice to have:

  • Experience with finance or banking systems
  • Knowledge of streaming architectures (though primary focus is batch)
  • Familiarity with Spark Structured Streaming and MLlib
  • Advanced cost optimization strategies for Spark workloads in cloud environments
What we offer:
  • Luxmed
  • Medicover Sport
  • Worksmile
  • educational platforms
  • languages learning platform
  • referral bonus
  • copyrights
  • life insurance
  • workation
  • certifications (paid by the company)
  • conferences
  • Tech Lunches
  • possibility to join our Communities (Project Management, Architecture, Security, Process Management, Leadership, AI and Cloud)

Additional Information:

Job Posted:
January 08, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Sopra Steria - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Data Engineer

Senior Data Engineer

Our Data Engineering Team is comprised of data experts. We build world-class dat...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A BS in Computer Science or equivalent experience with 5+ years of professional experience as a Sr. Data Engineer or in a similar role
  • Strong programming skills using Python
  • Working knowledge of relational databases and query authoring (SQL)
  • Experience designing data models for optimal storage and retrieval to meet product and business requirements
  • Experience building scalable data pipelines using Spark (SparkSQL) with Airflow scheduler/executor framework or similar scheduling tools
  • Experience working with AWS data services or similar Apache projects (Spark, Flink, Hive, and Kafka)
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
  • Well versed in modern software development practices (Agile, TDD, CICD)
Job Responsibility
Job Responsibility
  • You'll partner with the product analytics and data scientist team to build the data solutions that allow them to obtain more insights from our data and use that to support important business decisions
  • You'll work with different stakeholders to understand their needs and architect/build the data models, data acquisition/ingestion processes and data applications to address those requirements
  • You'll add new sources, code business rules, and produce new metrics that support the product analysts and data scientists
  • You'll be the data domain expert who understand all the nitty-gritty of our products
  • You'll own a problem end-to-end
  • You'll improve data quality by using & improving internal tools/frameworks to automatically detect DQ issues
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
Read More
Arrow Right

Senior Data Engineer

Binariks is looking for a highly motivated and skilled Senior Data Engineer to j...
Location
Location
Salary
Salary:
Not provided
binariks.com Logo
Binariks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years as a Data Engineer with experience in working with AWS
  • Experience with Terraform
  • Experience with Datalakes, Medallion Architecture
  • Experience with SQL
  • Professional experience with Python
  • Experience with Athena, Glue, Glue Streaming, Kinesis, dbt
  • Able to work as a team to deliver against requirements in a collaborative and agile way
  • Excellent communication skills in English
Job Responsibility
Job Responsibility
  • Managing and improving our cloud data lakehouse for analytic and aggregate data
  • Building data pipelines
  • Developing foundations for handling larger volumes of streaming data
  • Manage our cloud data infrastructure using IaC tooling
  • Assist teams on integrating with the data lake and consuming from it
  • Developing customer-facing data products, such as APIs and data timelines
  • Help develop our machine learning data capabilities
What we offer
What we offer
  • 18 days of paid annual leave
  • 10 sick leaves
  • Additional days off for special occasions
  • Medical Care
  • Health check-up
  • English Class
  • Play Room
  • IT Cluster membership
  • Business Trip
  • Tech Talks
Read More
Arrow Right

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

The mission of the business intelligence team is to create a data-driven culture...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • Master’s degree in Computer Science / Information Technology or related field, highly preferred
  • Extensive knowledge of BI concepts and related technologies that help drive sustainable technical solutions
  • Extensive Experience with data lakes, ETL and data warehouses
  • Advanced experience of building data pipelines
  • Passion for building quality BI software
  • Project Management and/or process improvement experience highly preferred
  • Polyglot coder and expert level in multiple languages including, Python, R, Java, SQL, relational databases, ERP, DOMO or other data visualization tools i.e. Tableau
  • Advanced and proven experience with Google cloud platform (GCP) is preferred. But experience with Microsoft Azure / Amazon will be considered
  • Any exposure to Kafka, Spark, and Scala will be an added advantage
  • Should demonstrate a strong understanding of OOPS concepts and methodologies
Job Responsibility
Job Responsibility
  • Architect and build complex data pipelines using advanced cloud data technologies
  • Lead efforts to optimize data pipelines for performance, scalability, and cost-efficiency
  • Define industry best practices for building data pipelines
  • Ensure data security, compliance, and governance standards are met
  • Partner with leadership team to define and implement agile and DevOps methodologies
  • Serve as subject matter expert and define data architecture and infrastructure requirements
  • Partner with business analysts to plan project execution including appropriate product and technical specifications, direction, resources, and establishing realistic completion times
  • Understand data technology trends and identify opportunities to implement new technologies and provide forward-thinking recommendations
  • Proactively partner with internal stakeholders to bridge gaps, provide historical references, and design the appropriate processes
  • Design and implement a robust data observability process
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Beacon Technologies is seeking a Senior Data Engineer for our client partner. Th...
Location
Location
Salary
Salary:
Not provided
beacontechinc.com Logo
Beacon Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data engineering (SQL)
  • Scripting (Python, PowerShell, Bash)
  • Custom development (API integration, file-based integration)
  • Strategic thinker
  • Mentor juniors
  • Governance aware
Job Responsibility
Job Responsibility
  • Design integrations
  • Optimize rule structures
  • Lead analytics initiatives
  • Manage workforce identity (system access) for all corporate and field employees
What we offer
What we offer
  • Career advancement opportunities
  • Extensive training
  • Excellent benefits including paying for health and dental premiums for salaried employees
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy