CrawlJobs Logo

Senior Data Engineer

India, Bengaluru · Job Posted February 20, 2026
Apply Position
Job Link Share

Job Description

Senior Data Engineer Job Description; We are seeking a Senior Data Engineer who is a self-starter to work in a diverse and fast-paced environment as part of our Enterprise Data team; This individual contributor role is responsible for designing and developing data solutions that are strategic to the business and built on the latest technologies and patterns; This is a global role that requires partnering with the broader JLLT team at the country, regional, and global levels by utilizing in-depth knowledge of data, infrastructure, technologies, and data engineering experience

Job Responsibility

  • Design, develop, and maintain scalable and efficient cloud-based data infrastructure using SQL and PySpark
  • Collaborate with cross-functional teams to understand data requirements, identify potential data sources, and define data ingestion architecture
  • Design and implement efficient data pipeline frameworks, ensuring the smooth flow of data from various sources to data lakes, data warehouses, and analytical platforms
  • Troubleshoot and resolve issues related to data processing, data quality, and data pipeline performance
  • Stay updated with emerging technologies, tools, and best practices in cloud data engineering, SQL, and PySpark
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions that meet their needs
  • Document data infrastructure, data pipelines, and ETL processes, ensuring knowledge transfer and smooth handovers
  • Create complex automated tests and integrate them into testing frameworks

Requirements

  • Bachelor's degree in Computer Science, Data Engineering, or a related field (Master's degree preferred)
  • Minimum 5+ years of experience in data engineering or full-stack development, with a focus on cloud-based environments
  • Advanced expertise in managing big data technologies (Python, SQL, PySpark, Spark) with a proven track record of working on large-scale data projects
  • Strong Databricks experience
  • Advanced database/backend testing with the ability to write complex SQL queries for data validation and integrity
  • Strong streaming and real-time API/service validation including automation
  • Experience with automated web services (WSDL) and microservices (REST) using custom scripts and assertions for data validation and data-driven testing
  • Experience with cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
  • Proficiency in object-oriented programming and software design patterns
  • Experience working in DevOps model, including installing, configuring, and integrating automation scripts on continuous integration tools (CI/CD) and GitHub for real-time test suite execution and troubleshooting
  • Experience with Unit, Functional, Integration, User Acceptance, System, and Security testing of data pipelines
  • Strong experience in designing and implementing data pipelines, ETL processes, and workflow automation
  • Familiarity with data warehousing concepts, dimensional modeling, data governance best practices, and cloud-based data warehousing platforms (e.g., AWS Redshift, Google BigQuery, Snowflake)
  • Familiarity with cutting-edge AI technologies and demonstrated ability to rapidly learn and adapt to emerging concepts and frameworks
  • Strong problem-solving skills and ability to analyze complex data processing issues
  • Excellent communication and interpersonal skills to collaborate effectively with cross-functional teams
  • Attention to detail and commitment to delivering high-quality, reliable data solutions
  • Ability to adapt to evolving technologies and work effectively in a fast-paced, dynamic environment

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer

8 matching positions

Senior Data Engineer

We are seeking a Senior Data Engineer to design, build, and optimize modern clou...
Location
Location
United States , Madison
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field
  • 7+ years of experience designing and supporting enterprise data platforms
  • Extensive hands-on experience with Databricks, Apache Spark, Python, SQL, and Delta Lake
  • Strong experience with Azure data services, including Azure Data Factory
  • Experience designing and supporting modern data lake and data warehouse architectures
  • Strong understanding of ETL/ELT development, data modeling, and database design
  • Experience with CI/CD pipelines, Infrastructure as Code, and cloud-based deployment practices
  • Familiarity with Azure, AWS, or hybrid cloud environments
  • Excellent analytical, problem-solving, and communication skills
  • Experience working in Agile development environments
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, Python, Spark, and SQL
  • Build and optimize cloud-based data pipelines supporting structured and semi-structured data
  • Develop and maintain data lake and data warehouse solutions for enterprise reporting and analytics
  • Optimize data processing performance, reliability, and cost efficiency
  • Implement data quality, validation, and governance practices across the data platform
  • Collaborate with business and technical stakeholders to gather requirements and deliver scalable data solutions
  • Design integrations with cloud services, APIs, databases, and third-party systems
  • Develop dashboards, reporting datasets, and curated data products that enable self-service analytics
  • Contribute to cloud architecture, Infrastructure as Code, CI/CD automation, and platform best practices
  • Document data models, pipelines, and technical solutions while mentoring team members on modern data engineering practices
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Senior Data Engineer

You will join the OneMIS stream, responsible for management, regulatory & risk r...
Location
Location
Romania , Bucuresti
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • University degree in computer science or a comparable qualification
  • At least 5 years of experience as a Data Engineer, building scalable data pipelines and working with cloud-based data ecosystems
  • Strong expertise in SQL and hands‑on experience building performant datasets in BigQuery (or similar cloud data warehouses)
  • Proven experience with Python and PySpark for scalable data processing in distributed environments
  • Solid understanding of data modeling, ELT/ETL patterns, and data quality best practices
  • Experience with Google Cloud Platform, particularly BigQuery, Dataflow, Cloud Composer, GCS, or equivalent cloud data services
  • Hands‑on experience building scalable data pipelines (batch and near real‑time) in a cloud‑native environment
  • Proficiency with version control, CI/CD pipelines, and automated testing frameworks
  • Ability to troubleshoot and optimize performance across compute, storage, and processing layers
Job Responsibility
Job Responsibility
  • Build scalable data pipelines: Design and deliver batch and real-time ETL/ELT pipelines across cloud environments to support analytics and reporting
  • Develop SQL and BigQuery solutions: Write and optimize advanced SQL transformations and build performant, cost‑efficient BigQuery data models
  • Develop Python workflows: Implement scalable data processing solutions using Python and PySpark, ensuring maintainable and high‑quality code
  • Design data models and ensure quality: Build robust data models and apply validation practices to maintain accuracy and reliability
  • Build cloud‑native data solutions: Use GCP services such as BigQuery, Dataflow, Cloud Composer, Pub/Sub, and GCS to build and operate modern data platforms
  • Optimize performance and reliability: Troubleshoot complex pipeline issues and continuously improve compute, storage, and processing performance
  • Collaborate using strong engineering practices: Work with engineering, analytics, and business teams while contributing to CI/CD, code reviews, and testing standards
What we offer
What we offer
  • Smooth integration and a supportive mentor
  • Pick your working style: choose from Remote, Hybrid or Office work opportunities
  • Our projects have different working hours to suit your needs
  • Sponsored certifications, trainings and top e-learning platforms
  • Private Health Insurance – it’s custom-made for you
  • Individual coaching sessions or accredited Coaching School
  • Epic parties or themed events for our people and their families
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are looking for a Senior Data Engineer to design, build, and maintain scalabl...
Location
Location
Indonesia , Jakarta
Salary
Salary:
Not provided
axa.com Logo
Axa
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Statistics, Mathematics, or related fields
  • Minimum 3 years of experience in Data Engineering or Analytics
  • Strong skills in Python and SQL
  • Experience with databases and big data tools (e.g. Spark, Hadoop)
  • Familiar with cloud platforms (AWS, GCP, or Azure)
  • Good communication skills and ability to mentor junior engineers
Job Responsibility
Job Responsibility
  • Design, build, and maintain data pipelines and centralized data platforms
  • Integrate and transform data from multiple internal and external sources
  • Ensure data quality through validation, monitoring, and best practices
  • Provide clean, ready-to-use data for analytics and modeling needs
  • Automate data processing and delivery processes
  • Collaborate with cross-functional teams to align data solutions with business goals
  • Support data governance, security, and compliance requirements
  • Mentor junior data engineers and lead technical initiatives
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

As a Senior Data Engineer at Mozilla, you will be a key member of our Data Engin...
Location
Location
Canada; United States
Salary
Salary:
Not provided
mozilla.org Logo
Mozilla
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At a minimum, 4 years of professional experience in data engineering
  • Proficiency in SQL and Python, and an eagerness to integrate AI into data engineering workflows to help us scale
  • Experience mapping complex business processes into extensible, analytical data models
  • Strong software engineering fundamentals
  • Self directed execution
  • Collaborative spirit
  • A track record of recommending and implementing new data collection methods to improve data model quality
  • You have used data to answer specific questions and guide company decisions
  • You have experience with cloud distributed systems (we use GCP) including distributed databases, message queues or batch / stream processing
  • You ensure data is safe to depend on through smart orchestration, error handling, and idempotency
Job Responsibility
Job Responsibility
  • Build the pipes: Build and manage business data pipelines as well as transform Firefox telemetry data into structured high quality datasets
  • Make data make sense: Partner with data scientists, product, and marketing teams to turn complex datasets into the models and metrics that drive Mozilla's decisions
  • Be a guardian of data quality: Ensure datasets stay accurate and performant by using observability tools to monitor quality and joining a weekly triage rotation to resolve data issues
  • Evolve our platform: Partner with other data engineers and platform engineers to improve how we work
  • Maintain data integrity: Ensure data governance and privacy policies are implemented and enforced across the tens of terabytes of data flowing through systems daily
What we offer
What we offer
  • Generous performance-based bonus plans
  • Rich medical, dental, and vision coverage
  • Generous retirement contributions with 100% immediate vesting
  • Quarterly all-company wellness days
  • Country specific holidays plus a day off for your birthday
  • One-time home office stipend
  • Annual professional development budget
  • Quarterly well-being stipend
  • Considerable paid parental leave
  • Employee referral bonus program
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin; Warren
Salary
Salary:
153000.00 - 227000.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Software Engineering, or related field, or equivalent experience
  • 7+ years of data engineering/development experience, including Python or Scala, SQL, and relational/non-relational data storage. (ETL frameworks, big data processing, NoSQL)
  • 3+ years of experience in distributed data processing (Spark) and container orchestration (Kubernetes)
  • Proficiency in data streaming in Kubernetes and Kafka
  • Experience with cloud platforms – Azure preferred
  • AWS or GCP also considered
  • Solid understanding of CI/CD principles and tools
  • Familiarity with big data technologies such as Hadoop, Hive, HBase, Object Storage (ADLS/S3), Event Queues
  • Strong understanding of performance optimization techniques such as partitioning, clustering, and caching
  • Proficiency with SQL, key-value datastores, and document stores
Job Responsibility
Job Responsibility
  • Assemble large, complex data sets that meet functional and non-functional business requirements
  • Identify, design, and implement process improvements, including automation, data delivery optimization, and infrastructure redesign for scalability
  • Lead and deliver data-driven solutions across multiple languages, tools, and technologies
  • Contribute to architecture discussions, solution design, and strategic technology adoption
  • Build and optimize highly scalable data pipelines incorporating complex transformations and efficient code
  • Design and develop new source system integrations from varied formats (files, database extracts, APIs)
  • Design and implement solutions for delivering data that meets SLA requirements
  • Work with operations teams to resolve production issues related to the platform
  • Apply best practices such as Agile methodologies, design thinking, and continuous deployment
  • Develop tooling and automation to make deployments and production monitoring more repeatable
What we offer
What we offer
  • Health and wellbeing benefit programs
  • Medical
  • Dental
  • Vision
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

We are seeking an experienced Senior Data Engineer to design, build, and optimiz...
Location
Location
Sri Lanka
Salary
Salary:
Not provided
Creative Software
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3-5 years of experience in Data Engineering or related fields
  • Strong expertise in SQL and at least one programming language (Python, Scala, or Java)
  • Hands-on experience with Azure data services such as Data Factory, Synapse, Databricks, Azure SQL, and Storage
  • Experience with on-premise data platforms, especially SQL Server and SSIS
  • Strong Power BI skills, including: Designing efficient data models (star schema, proper relationships), Writing optimized DAX measures, Applying best practices for performance, data loading, and semantic modeling, Supporting BI teams with dataset design and dashboard optimization
  • Solid experience building and maintaining ETL/ELT pipelines
  • Good understanding of data warehousing concepts, data governance, and data quality frameworks
  • Experience with version control and structured development workflows (Git, CI/CD)
  • Strong communication and ability to work with both technical and business teams
  • Excellent analytical and problem-solving abilities
Job Responsibility
Job Responsibility
  • Build and Manage Data Pipelines
  • Design Data Models & Warehouses
  • Optimize Existing Data Solutions
  • Work Across Cloud and On-Prem Platforms
  • Support BI & Visualization Teams
  • Lead and Collaborate
  • Leverage Multi-Platform Experience
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin, Texas; Warren, Michigan
Salary
Salary:
138700.00 - 175450.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent experience
  • 5+ years of relevant full-time experience
  • or equivalent knowledge
  • Strong experience in data engineering, including pipeline development, data modeling, data integration, and production support for enterprise data platforms
  • Data engineering experience, including Python or Scala, SQL, and relational/non-relational data storage (ETL frameworks, big data processing, NoSQL)
  • Experience with cloud platforms – Azure preferred
  • AWS or GCP also considered
  • Proficiency with SQL, key-value datastores, and document stores
  • Design, build, and optimize scalable batch and streaming data pipelines using Databricks (Apache Spark, Delta Lake) to support Medallion Architecture
  • Experience with modern cloud data platforms, distributed processing, and production-grade data pipelines
Job Responsibility
Job Responsibility
  • Design, build, and productionize reliable, scalable, and secure data pipelines and data products in Azure Databricks that support AI, analytics, and operational use cases
  • Lead the transformation of raw data from multiple source systems into trusted, well-structured datasets suitable for downstream analytics, model development, and AI enablement
  • Drive improvements in internal processes, delivery patterns, and technical solutions that support broader functional strategy and increase team efficiency
  • Solve complex and non-standard data engineering problems using advanced analytical and problem-solving techniques, with strong ownership and sound technical judgment
  • Partner closely with data scientists, analysts, software engineers, product stakeholders, and business teams to ensure data is accessible, trustworthy, and aligned to business outcomes
  • Support AI and data science use cases by enabling high-quality feature-ready data, experimentation workflows, and scalable patterns for model development and deployment
  • Contribute to technical direction within the team, influence key engineering decisions in their area, and act as a go-to resource for peers and less experienced engineers
  • Mentor team members through technical guidance, knowledge sharing, and strong engineering practices consistent with Level 7 expectations
What we offer
What we offer
  • Relocation benefits
  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

The Data, Analytics and Reporting Technology team is responsible for a cross-cut...
Location
Location
United States , San Francisco; Charlotte
Salary
Salary:
100000.00 - 196000.00 USD / Year
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 4+ years of experience creating analytics or data science solutions in Public Cloud (GCP, AWS, Azure)
  • 4+ years of hands on experience of Python and/or Go for building data pipelines, libraries, and automation tooling
  • 4+ years with GCP or equivalent open source orchestration tools (Composer/Airflow/Dataflow/Beam) and CI/CD (Git, Liquibase, ) for data workloads
  • 2+ years of hands-on experience building and implementing predictive AI models using machine learning algorithms (e.g., regression, classification, forecasting).
Job Responsibility
Job Responsibility
  • Develop scalable, secure data pipelines from on-premise systems of record to Google Cloud Platform services (BigQuery, BigTable, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer)
  • Leverage and extend capability roadmaps for reusable frameworks and tooling (ingestion, transformation, quality, orchestration) actively being developed by the larger organization
  • Enable self‑service data consumption and governance by standardizing patterns, templates, and sandbox capabilities rather than one‑off pipelines
  • Support use cases for training, validation and monitoring leveraging BigQuery, Dataflow/Apache Beam, Dataproc/Spark, Pub/Sub, and Cloud Storage
  • Create standardized feature transformation pipelines and a common feature store with strong lineage, dictionary and high availability for models
  • Ensure appropriate cost, performance, and reliability of GCP data workloads (partitioning, clustering, storage classes, autoscaling strategies)
  • Develop transformation libraries in Python/SQL/Beam (e.g., common SCD patterns, data quality checks, masking/tokenization routines)
  • Provide orchestration capabilities via Cloud Composer or Cloud Workflows with reusable DAGs/templates and CI/CD integration
  • Implement robust data modeling (dimensional, data vault, or canonical models) and semantic layer implementations with BigQuery or similar tools
  • Enforce data quality, lineage, and observability using standardized metrics, validation rules, and monitoring dashboards
What we offer
What we offer
  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Fulltime
Read More
Arrow Right