Senior Data Engineer Job at NTT DATA (Chennai)

New

Senior Data Engineer

Senior Data Engineer. Must Haves: Strong hands-on experience building and suppor...

Location

United States , Los Angeles

Salary:

Not provided

Beacon Hill

Expiration Date

Until further notice

Requirements

Strong hands-on experience building and supporting production-grade data pipelines using PySpark and Apache Spark
Extensive experience working within Databricks environments
Experience with Databricks Unity Catalog migrations and modernization initiatives
Experience with Databricks Unity Catalog governance and security models
Strong understanding of ETL/ELT design, data modeling, and incremental data processing
Experience modernizing legacy data platforms and data migration projects
Experience working with large-scale datasets in cloud-based data platforms
Experience with workflow orchestration, scheduling, and pipeline automation
Knowledge of cloud data platforms such as Snowflake and/or Google Cloud
Experience implementing data quality checks, monitoring, logging, and alerting

Job Responsibility

Migrate existing data assets and pipelines to Databricks Unity Catalog
Refactor and optimize existing pipelines using modern engineering standards and best practices
Build and maintain scalable PySpark-based data pipelines
Develop new source-of-truth datasets and modernize legacy data workflows
Design and implement workflow orchestration using Databricks Jobs
Deploy and manage pipelines using Databricks Asset Bundles
Ensure data pipelines are reliable, observable, and production-ready
Implement data quality controls, monitoring, and operational alerting
Support platform migrations, testing, validation, and production cutovers
Partner with engineering teams to improve platform stability, scalability, and data reliability

Fulltime

New

Senior Data Engineer

We are seeking an experienced Senior Data Engineer to join a leading automotive ...

Location

Sweden , Gothenburg

Salary:

53333.00 - 66667.00 SEK / Month

Amaris Consulting

Expiration Date

Until further notice

Requirements

Strong hands-on experience with PySpark and Databricks in production environments
Advanced Python programming skills
Experience with Git/Gerrit and CI/CD pipelines (GitHub Actions, Jenkins, GitLab, or similar)
Solid knowledge of Docker and workflow orchestration tools such as Airflow or Databricks Jobs
Expertise in designing scalable, privacy-compliant data architectures and pipelines
Strong SQL skills and experience handling large-scale datasets
Experience with Azure cloud services and Snowflake (or equivalent cloud data warehouse technologies)
Knowledge of monitoring, observability, automated testing, and cost optimization practices
Familiarity with Power BI or similar BI and reporting tools
Understanding of automotive UDS diagnostics and vehicle signal data

Job Responsibility

Design and develop scalable data pipelines using PySpark and Databricks
Build and maintain raw and refined data products related to vehicle signals, software versions, drive cycles, distance measurements, and driver feedback
Optimize data processing performance, reliability, and cost efficiency
Implement monitoring, observability, automated testing, and usage tracking for data products
Collaborate with architects, engineers, Product Owners, and business stakeholders to deliver robust data solutions
Support documentation, knowledge transfer, and operational handovers
Contribute to technical leadership and best practices within the data engineering domain

What we offer

An international community, bringing together 110+ different nationalities
An environment where trust has a central place: 70% of our key leaders started their careers at the first level of responsibilities
A robust training system with our internal Academy and 250+ available modules
A vibrant workplace that frequently gathers for internal events (afterworks, team buildings, etc.)
Opportunity to turn ideas into action and make a tangible impact through ESG commitments
WeCare Together program empowering employees to design and lead projects that create social or environmental impact

Fulltime

New

Senior Data Engineer

Senior Data Engineer - Media Org (Hybrid NYC or LA). I’m working on a Senior Dat...

Location

United States , New York City or Los Angeles

Salary:

Not provided

Lawrence Harvey

Expiration Date

Until further notice

Requirements

Strong Data Engineering experience building production data pipelines
Strong PySpark and SQL expertise
Experience with Databricks or similar Spark-based cloud platforms
Experience building batch and streaming pipelines
Experience with orchestration tools such as Airflow or similar
Familiarity with AWS environments, data lakes, and modern cloud data architecture
Experience with modern Lakehouse design patterns, including Medallion Architecture (Bronze, Silver / Gold layers) for structuring scalable and modular data pipelines

Job Responsibility

Designing batch and real-time data pipelines
Working heavily within a Databricks environment
Helping shape modern lakehouse architecture
Partnering closely with analytics, product, and data science teams

Fulltime

New

Senior Data Engineer

At AO, we’re all about using data to make smarter decisions and create brilliant...

Location

United Kingdom , Bolton

Salary:

Not provided

AO

Expiration Date

Until further notice

Requirements

Solid experience in data engineering, building and maintaining data pipelines
Strong hands-on knowledge of AWS services like Redshift, Glue, Spectrum and Lambda
Confidence working with Python and TSQL
A good understanding of data modelling, ETL processes and data warehousing
Experience (or exposure to) Infrastructure as Code tools such as Terraform or CloudFormation
Familiarity with CI/CD pipelines and automated deployment practices
A natural problem solver who enjoys improving and optimising the way things work
Comfortable collaborating with different teams and bringing ideas to life together
Someone who’s keen to share knowledge and support others’ development

Job Responsibility

designing and building robust data pipelines that keep our data flowing smoothly and reliably, using AWS tools like Redshift, Glue, Spectrum and Lambda
Working closely with teams across AO, you’ll turn business needs into practical, scalable solutions that help unlock the value of our data
continuously improve performance, reliability and cost-efficiency across our data systems, while making sure everything is secure and compliant
setting up automated deployments using Infrastructure as Code and CI/CD pipelines, to troubleshooting issues and documenting your work, you’ll help keep things running seamlessly
share your knowledge with others in the team, helping to coach and support colleagues as we grow

What we offer

25 days holidays, plus bank holidays (increasing to 27 days after 2 years with us)
Pension
Contribute 5% of your annual salary and we'll do the same
Be a VIP at the AO Arena
discounted gym membership
an onsite spa
Help @ Hand scheme giving you access to virtual GP’s, Mental Health support and much more
exclusive discounts across our product range
Enhanced Maternity, Paternity and Adoption leave
2 fully paid days a year to donate your time to any charity of your choice

Fulltime

New

Senior Data Engineer

Are you a Senior Data professional who enjoys mentoring talent and designing hig...

Location

Greece , Athens

Salary:

Not provided

Randstad

Expiration Date

July 10, 2026

Requirements

University degree in Computer Science, Statistics, Mathematics, or a related Quantitative field.
5+ years of professional experience in Data Engineering with a mastery of MS SQL Server (T-SQL, SSIS, Performance Tuning).
Proven experience in mentoring or leading technical team members.
Exposure to VBM methodologies or a strong understanding of financial/business data modeling.
Hands-on experience with QlikSense or Qlikview (or similar BI visualization tools like Tableau/Power BI).
Excellent command of the English language.
A proactive leader with an analytical mindset and a passion for knowledge sharing.

Job Responsibility

Lead the design and implementation of robust data architectures using on-premise MS SQL Server technologies.
Mentor and guide junior developers, assisting them in technical design and ensuring best practices in database management and ETL processes.
Develop complex data models that drive strategic business decisions and high-level reporting.
Collaborate with business stakeholders to translate VBM methodologies into technical requirements.
Oversee the integration of data flows into visualization tools, ensuring data accuracy and top-tier performance.

New

Senior Data Engineer

We're looking for an experienced Senior Data Engineer to lead the design, develo...

Location

United Kingdom; Netherlands; Germany; Sweden , Luton; Rijswijk; Hanover; Stockholm

Salary:

Not provided

TUI

Expiration Date

June 22, 2026

Requirements

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent professional experience in data engineering or software development
Master's degree in Computer Science, Data Science, or related field would be beneficial
Proven experience in data engineering and leading technical teams
Strong data engineering skills including SQL and Python, with experience managing codebases, CI/CD pipelines, and code reviews
Knowledge of cloud-based data systems such as Google Cloud Platform and cloud storage solutions like Snowflake/AWS
Deep understanding of data pipeline design, ETL processes, and data integration tools
Expertise in relational and NoSQL databases
Knowledge of data quality assurance methodologies
Excellent problem-solving, analytical, communication, and leadership skills
Professional certifications in cloud platforms

Job Responsibility

Lead the design and implementation of data pipelines and integration processes for customer and marketing data from digital sales channels
Design scalable ETL processes for analytics data
Develop data integration solutions between various platforms
Implement data transformation and enrichment processes
Establish and maintain data quality frameworks
Develop automated data quality checks and validation processes
Implement monitoring systems for data pipeline health
Create documentation and standards for data quality assurance
Collaborate with the Architect to implement technical designs
Translate architectural designs into implementation plans

What we offer

Attractive remuneration
Discretionary bonus schemes
Generous travel benefits
Extensive health & well-being support
Flexible working
Access the TUI Learning Hub
Opportunities to work on global projects and teams
Local charity and sustainability initiatives

Fulltime

New

Senior Data Engineer

Within COO Technology, Wells Fargo is seeking a Senior Data Engineer to help sha...

Location

United States , Iselin; Charlotte; Irving

Salary:

100000.00 - 196000.00 USD / Year

Wells Fargo

Expiration Date

June 11, 2026

Requirements

4+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
4+ years of data management experience within Public Cloud (GCP, AWS, Azure)
4+ years of hands on experience of Python or Java, plus Spark SQL for building data pipelines, libraries, and automation tooling
4+ years with orchestration tools (Cloud Composer/Airflow) and CI/CD (Cloud Build, Git-based workflows) for data workloads

Job Responsibility

Design and implement scalable, secure data platforms on Google Cloud using managed services (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer)
Build reusable frameworks and tooling (ingestion, transformation, quality, orchestration) that can be adopted by multiple product and domain teams
Enable self-service data consumption and governance by standardizing patterns, templates, and platform capabilities rather than one-off pipelines
Design logical and physical data platform architectures leveraging BigQuery, Dataflow/Apache Beam, Dataproc/Spark, Pub/Sub, and Cloud Storage
Define and implement standardized ingestion, transformation, and serving patterns (batch and streaming) as reusable blueprints
Optimize cost, performance, and reliability of GCP data workloads (partitioning, clustering, storage classes, autoscaling strategies)
Build opinionated data ingestion frameworks (e.g., config-driven pipelines, connectors, schema handling, error handling) on top of Dataflow, Dataproc, or Composer
Develop shared transformation libraries in Python/SQL/Beam (e.g., common SCD patterns, data quality checks, masking/tokenization routines)
Provide orchestration capabilities via Cloud Composer or Cloud Workflows with reusable DAGs/templates and CI/CD integration
Implement robust data modeling (dimensional, data vault, or canonical models) and semantic layers in BigQuery and related tools

What we offer

Health benefits
401(k) Plan
Paid time off
Disability benefits
Life insurance, critical illness insurance, and accident insurance
Parental leave
Critical caregiving leave
Discounts and savings
Commuter benefits
Tuition reimbursement

Fulltime

!

Senior Data Engineer

Identify and implement internal process improvements for data management such as...

Location

United States , Thousand Oaks

Salary:

138325.00 - 172744.00 USD / Year

Amgen

Expiration Date

Until further notice

Requirements

Master’s degree (or foreign equivalent) in Computer Science, Information Systems, Software Engineering or related field & 2 years of experience involving the following: 1. Creating Data Quality dashboards and report results
2. Coding languages including: Python, Java, or Scala
3. Writing SQL using RDBMS including: Redshift, Postgres, MySQL, Teradata, or Oracle
4. Software DevOps CI/CD tools including: Git, Jenkins, Linux, or Shell Script
5. Using Databricks, Jupyter, or similar notebook environment
and 6. Working with test-driven development or software test automation.

Job Responsibility

Identify and implement internal process improvements for data management such as automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability
Collaborate with Product Owner, Release Train Engineer, and Scrum Master to plan and execute work
Work with Data Architects to optimize the technical environment for reuse, agility, and performance
Ensure data requirements for applications, data scientists, and cross-functional use cases are met
Maintain high performance and reliability of the system
Contribute to the Exploration and understanding of new tools, and techniques and propose improvements to the existing and new data pipelines
Collaborate cross-functionally with analysts, engineers, data scientists to identify & prioritize requirements, brainstorm solutions, and clarify business objectives for data-centric solutions to achieve continuous improvement
and Assist with data discovery for enhancing reports and designing efficient data stores.

What we offer

stock
retirement
medical
life and disability insurance
eligibility for an annual bonus
other incentive compensation
Retirement and Savings Plan with generous company contributions
group medical, dental and vision coverage
flexible spending accounts
discretionary annual bonus program

Fulltime

Select Country

Senior Data Engineer

Requirements

Looking for more opportunities?

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Our AI answers in your language