Senior Data Engineer (ETL+Spark) Job at ELEKS (Buenos Aires)

Senior Staff Data Engineer- Data Platform

At Marktplaats, data is at the heart of everything we do, but Intelligence is wh...

Location

Netherlands , Amsterdam

Salary:

Not provided

Adevinta

Expiration Date

Until further notice

Requirements

10+ years of hands-on experience in Software Development or Data Engineering
at least 5+ years specifically focused on building Data Platforms
deep understanding of how Platform infra supports Analytics workloads
proven experience evolving complex platforms from legacy patterns to modern, cloud-native solutions
deep knowledge of Spark internals, JVM tuning, and performance optimization for high-scale batch and streaming datasets
deep expertise in Unity Catalog, Delta Lake internals, and optimizing high-volume workloads
strict software engineering discipline (CI/CD, Testing, OOP) applied to data pipelines
understanding of microservices architecture
understanding the needs of Analytics/DWH teams (Data Modeling, dbt)
strong background in building automated pipelines using Terraform/Terragrunt and ensuring system observability

Job Responsibility

Lead the evolution of our Data Platform and architect the "Data Exchange" strategy
define robust patterns for API-based ingestion, Event-Driven Architectures (Kafka), and Reverse ETL
ensure architectures are optimized for cost and performance on AWS
act as a catalyst for technical evolution
constantly scan the horizon for next-generation technologies
lead the implementation of new paradigms
design the strategy for Unity Catalog implementation and Data Contracts
champion FinOps, automating cost controls for our highest-volume workloads
build the underlying infrastructure that allows Analytics/DWH teams to run efficient transformations
elevate the technical bar of the team, mentoring Staff and Senior engineers

What we offer

An attractive Base Salary
Participation in our Short Term Incentive plan (annual bonus)
Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
A 24/7 Employee Assistance Program for you and your family
a collaborative environment with an opportunity to explore your potential and grow
a range of locally relevant benefits

Fulltime

Senior Data Engineer – Core Team (Onshore)

Location

United States

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

8–10 years of hands-on data engineering experience
Strong understanding of Apache Spark and its core concepts
Proficiency in Scala and/or Java — code-first approach required
Advanced SQL skills
Experience with Azure Synapse
Working knowledge of GitHub for source control
Experience with data warehousing and large-scale data integration
Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent work experience
Must be a hands-on builder
Must be available to mobilize immediately

Job Responsibility

Migrate Spark Job Definitions from Synapse to Fabric (32) Design, develop, and maintain data pipelines using Scala and SQL on Apache Spark
Monitor and support Phase 1 pipelines post go-live
Investigate and remediate pipeline failures, data quality issues, and performance bottlenecks
Lead refactoring and cleanup of existing Phase 1 code
Optimize existing solutions for performance and scalability
Build and contribute to reusable patterns and automation frameworks
Work within TCCC’s metadata-driven architecture
Ensure pipelines are used strictly for scheduling — ETL logic must remain in code
Manage code using GitHub version control
Contribute to discovery sessions to derive requirements directly from data

New

Senior Data Engineer

We are seeking Senior Data Engineers to support TCCC’s Symphony platform on a pe...

Location

India , Delhi

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

8–10 years of hands-on data engineering experience
Strong understanding of Apache Spark and its core concepts
Proficiency in Scala and/or Java — code-first approach is mandatory
Advanced SQL skills
Hands-on experience with Azure Synapse
Working knowledge of GitHub for source control
Experience with data warehousing and multi-source data integration
Ability to work in an offshore delivery model
Must be a hands-on builder — no oversight-only profiles
Must be available to mobilize immediately

Job Responsibility

Implement and configure the Symphony platform solution for assigned market(s)
Develop and maintain market-specific data pipelines using Scala and SQL on Apache Spark
Integrate market-level marketing and data sources into the Symphony platform
Identify and resolve market-specific data quality issues, discrepancies, and inconsistencies
Support ongoing maintenance and monitoring of market-level pipelines
Optimize market-specific solutions for performance and scalability
Collaborate with the core team to ensure market implementations align with global architecture standards
Work within TCCC’s metadata-driven architecture — no reinvention of existing frameworks
Ensure pipelines are used strictly for scheduling — all ETL logic must remain in code
Communicate findings and technical issues clearly to the Delivery Lead and market Business Analyst

Fulltime

Senior Data Engineer

As Senior Data Engineer you will be responsible for designing, building, maintai...

Location

Portugal , Lisbon

Salary:

35571.65 - 48126.35 EUR / Year

Amgen

Expiration Date

Until further notice

Requirements

Bachelor's degree and 3 to 5 years of Computer Science, IT or related field experience
Proficiency in Python, PySpark, and Scala for data processing and ETL (Extract, Transform, Load) workflows, with hands-on experience in using Databricks for building ETL pipelines and handling big data processing
Experience with data warehousing platforms such as Amazon Redshift, or Snowflake
Strong knowledge of SQL and experience with relational (e.g., PostgreSQL, MySQL) databases
Familiarity with big data frameworks like Apache Hadoop, Spark, and Kafka for handling large datasets
Experienced with software engineering best-practices, including but not limited to version control (GitLab, Subversion, etc.), CI/CD (Jenkins, GITLab etc.), automated unit testing, and Dev Ops

Job Responsibility

Design, develop, and maintain data solutions for data generation, collection, and processing
Be a key team member that assists in design and development of the data pipeline
Create data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
Implement data security and privacy measures to protect sensitive data
Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
Collaborate and communicate effectively with product teams

What we offer

Work That Matters – Build tech that accelerates scientific breakthroughs and helps patients worldwide
Modern Tech Stack – Cloud-first, automation-focused, AI-powered
Global Scale, Agile Mindset – Collaborate across continents while working in nimble, high-impact teams
Continuous Learning – Access to certifications, trainings, mentorship, and career mobility
AMGEN Total Rewards Plan – Comprehensive benefits in healthcare, finance, and well-being
Flexibility – Hybrid work model with time split between our Lisbon office and remote work

Fulltime

Senior Data Engineer (ETL/Big Data/Python) - Assistant Vice President

CITI Bank Enterprise Analytical Services organization is seeking a highly skille...

Location

India , Chennai

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Bachelor's degree in Computer Science, Information Technology, or a related field
8+ years of experience in data engineering, software development, or a similar role, with at least 2 years in a lead capacity
Proven experience with ETL pipeline design and development
Expert proficiency in Python and Spark
Strong experience with advanced scripting
Deep knowledge of relational databases (Oracle) and NoSQL databases (MongoDB), Snowflake
Solid understanding of data modeling, data warehousing, and performance tuning
Experience with CI/CD pipelines and tools (e.g., Jenkins, GitLab CI, GitHub Actions)
Experience with monitoring, logging, and alerting tools (e.g., Prometheus, Grafana, ELK Stack, Splunk, Datadog)
Excellent problem-solving and analytical skills, with a keen eye for detail

Job Responsibility

Design, develop, and implement ETL based reporting framework, focusing on data collection, transformation, and presentation
Utilize a robust technology stack including Databricks, Spark, Hive, Ozone, and Hadoop to process large volumes of data efficiently
Write and optimize complex ETL jobs using PySpark and advanced Python scripting
Design and manage data storage in various databases, including Oracle, MongoDB and Snowflake for flexible data models
Develop and maintain automated job schedules using Autosys, Apache Airflow for seamless data pipeline execution
Ability to develop visualization reporting dashboards
Able to leverage enterprise approved productivity tools like Copilot, etc., in daily analysis & development tasks
Act as the technical subject matter expert (SME) for the reporting framework, providing guidance and mentorship to the development team
Lead requirements gathering discussions with business stakeholders and product owners to understand reporting needs and translate them into technical solutions
Coordinate closely with the QA team to ensure thorough testing and data validation, maintaining high standards of data accuracy and integrity

Fulltime

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...

Location

United States , Austin, Texas; Warren, Michigan

Salary:

138700.00 - 175450.00 USD / Year

General Motors

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent experience
5+ years of relevant full-time experience
or equivalent knowledge
Strong experience in data engineering, including pipeline development, data modeling, data integration, and production support for enterprise data platforms
Data engineering experience, including Python or Scala, SQL, and relational/non-relational data storage (ETL frameworks, big data processing, NoSQL)
Experience with cloud platforms – Azure preferred
AWS or GCP also considered
Proficiency with SQL, key-value datastores, and document stores
Design, build, and optimize scalable batch and streaming data pipelines using Databricks (Apache Spark, Delta Lake) to support Medallion Architecture
Experience with modern cloud data platforms, distributed processing, and production-grade data pipelines

Job Responsibility

Design, build, and productionize reliable, scalable, and secure data pipelines and data products in Azure Databricks that support AI, analytics, and operational use cases
Lead the transformation of raw data from multiple source systems into trusted, well-structured datasets suitable for downstream analytics, model development, and AI enablement
Drive improvements in internal processes, delivery patterns, and technical solutions that support broader functional strategy and increase team efficiency
Solve complex and non-standard data engineering problems using advanced analytical and problem-solving techniques, with strong ownership and sound technical judgment
Partner closely with data scientists, analysts, software engineers, product stakeholders, and business teams to ensure data is accessible, trustworthy, and aligned to business outcomes
Support AI and data science use cases by enabling high-quality feature-ready data, experimentation workflows, and scalable patterns for model development and deployment
Contribute to technical direction within the team, influence key engineering decisions in their area, and act as a go-to resource for peers and less experienced engineers
Mentor team members through technical guidance, knowledge sharing, and strong engineering practices consistent with Level 7 expectations

What we offer

Relocation benefits
medical
dental
vision
Health Savings Account
Flexible Spending Accounts
retirement savings plan
sickness and accident benefits
life insurance
paid vacation & holidays

Fulltime

Senior Data Engineer

Senior Data Engineer. Must Haves: Strong hands-on experience building and suppor...

Location

United States , Los Angeles

Salary:

Not provided

Beacon Hill

Expiration Date

Until further notice

Requirements

Strong hands-on experience building and supporting production-grade data pipelines using PySpark and Apache Spark
Extensive experience working within Databricks environments
Experience with Databricks Unity Catalog migrations and modernization initiatives
Experience with Databricks Unity Catalog governance and security models
Strong understanding of ETL/ELT design, data modeling, and incremental data processing
Experience modernizing legacy data platforms and data migration projects
Experience working with large-scale datasets in cloud-based data platforms
Experience with workflow orchestration, scheduling, and pipeline automation
Knowledge of cloud data platforms such as Snowflake and/or Google Cloud
Experience implementing data quality checks, monitoring, logging, and alerting

Job Responsibility

Migrate existing data assets and pipelines to Databricks Unity Catalog
Refactor and optimize existing pipelines using modern engineering standards and best practices
Build and maintain scalable PySpark-based data pipelines
Develop new source-of-truth datasets and modernize legacy data workflows
Design and implement workflow orchestration using Databricks Jobs
Deploy and manage pipelines using Databricks Asset Bundles
Ensure data pipelines are reliable, observable, and production-ready
Implement data quality controls, monitoring, and operational alerting
Support platform migrations, testing, validation, and production cutovers
Partner with engineering teams to improve platform stability, scalability, and data reliability

Fulltime

Senior Data Engineer

We are seeking a Senior Data Engineer to support a high-impact Salesforce initia...

Location

United States , Philadelphia

Salary:

Not provided

Robert Half

Expiration Date

Until further notice

Requirements

7–9 years of experience in data engineering / data integration projects
Strong hands-on experience with: Spark / PySpark (required)
Python for ETL development (required)
Databricks (required)
Experience building data pipelines in AWS environments
Knowledge of data migration and integration frameworks
Experience with Terraform (infrastructure as code)
Familiarity with CI/CD tools (Concourse, GitHub Actions)
Experience working in Agile/Scrum environments
Strong troubleshooting and problem-solving skills

Job Responsibility

Develop ETL pipelines to migrate and integrate data into Databricks
Support Salesforce to Databricks data migration and integration
Design, build, test, and maintain data pipelines on AWS + Databricks
Translate business requirements into scalable data engineering solutions
Contribute to data warehousing components for Salesforce Phase 2
Utilize Terraform for infrastructure provisioning and management
Implement and maintain CI/CD pipelines (Concourse or GitHub Actions)
Perform testing, QA, and documentation for all data engineering work
Provide post-deployment support and troubleshooting
Identify and mitigate risks, including single points of failure (SPOF)

What we offer

medical
vision
dental
life and disability insurance
401(k) plan

Fulltime

Select Country

Senior Data Engineer (ETL+Spark)

Job Description

Job Responsibility

Requirements

What we offer

Looking for more opportunities?

Senior Data Engineer (ETL+Spark)

Senior Staff Data Engineer- Data Platform

Senior Data Engineer – Core Team (Onshore)

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer (ETL/Big Data/Python) - Assistant Vice President

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Our AI answers in your language