CrawlJobs Logo

Senior Cloud Engineer, Data Processing

India, Chennai · Job Posted February 19, 2026
Apply Position
Job Link Share

Job Description

As a Senior Cloud Engineer, Data Processing on the Sustaining Engineering L3 team, you will support, enhance, and maintain Aptiv’s cloud-based data processing infrastructure for automotive datalogger data. This includes systems for data ingest, ETL pipelines, real-time and batch processing, and analytics. You’ll work with technologies such as Kubernetes, Python, Go, MySQL, MongoDB, message queues, and other scripting languages to ensure scalable, reliable, and efficient data flow across production environments.

Job Responsibility

  • Support and enhance Aptiv’s cloud-based data processing systems for automotive datalogger data, including ingest pipelines, ETL workflows, and analytics infrastructure
  • Investigate, root-cause, and resolve production issues across distributed systems, often involving complex legacy code and minimal documentation
  • Collaborate with systems analysts, engineers, and developers to troubleshoot issues, implement improvements, and ensure system reliability and performance
  • Partner with internal stakeholders to develop and execute validation plans that confirm fixes and enhancements meet operational and customer expectations
  • Stay current with evolving cloud technologies, data processing frameworks, and tooling to continuously improve support capabilities and system efficiency

Requirements

  • Bachelor's Degree – Computer Science, Computer Engineering, or similar
  • 8+ years Python and/or Golang software development experience
  • Proven ability to analyze and navigate legacy codebases, including independently investigating, debugging, and resolving issues without detailed documentation
  • Demonstrated skill at navigating ambiguity and resolving issues without detailed instructions or oversight
  • Experience interfacing applications with relational and non-relational databases (e.g., MySQL, MongoDB), including CRUD operations and schema design
  • Proficient in Linux environments and shell scripting
  • Deep experience with Kubernetes, AWS, RabbitMQ, MongoDB, and MySQL in production settings
  • Familiarity with debugging tools, performance profiling, and system optimization techniques
  • Strong written and oral communication skills, with the ability to clearly document and explain technical concepts

What we offer

  • Higher Education Opportunities (UDACITY, UDEMY, COURSERA are available for your continuous growth and development)
  • Life and accident insurance
  • Sodexo cards for food and beverages
  • Well Being Program that includes regular workshops and networking events
  • EAP Employee Assistance
  • Access to fitness clubs (T&C apply)
  • Creche facility for working parents

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Cloud Engineer, Data Processing

8 matching positions

Senior Google Cloud Data Engineer

We are seeking a Senior Google Cloud Data Engineer with a strong background in d...
Location
Location
United States , New York City
Salary
Salary:
170000.00 - 240000.00 USD / Year
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Candidates must be legally authorized to work in the United States and must hold either U.S. citizenship or lawful permanent resident (Green Card) status.
  • Strong expertise in Python - for building data pipelines, processing tasks, and automation
  • SQL - Advanced SQL capabilities (nested fields, analytic functions)
  • Hands-on experience with Core GCP Data Stack: BigQuery: Expert-level SQL, performance tuning, and specifically BigQuery ML (BQML) for implementing logistic regression or k-means clustering on data in-place
  • Dataflow (Apache Beam): Strong proficiency in writing data pipelines (Python or Java) handling windowing, watermarks, and triggers for streaming data
  • Pub/Sub: Experience with event-driven architecture and message queuing
  • Hands-on experience with Visualization & BI: Looker Core – Advanced proficiency in LookML (not just drag-and-drop), including derived tables, explores, and Liquid syntax
  • Semantic Modeling: Develop robust LookML models to create a trusted layer of data governance, ensuring metrics are consistent across the organization
  • Dashboard Creation: Design intuitive, high-impact dashboards in Looker for two distinct audiences: Operational teams (real-time threat monitoring) and Executives (risk posture and compliance reporting
  • Familiarity with Alerting Frameworks
Job Responsibility
Job Responsibility
  • Drive projects independently, ensuring timely delivery and high-quality outcomes
  • Lead and execute projects related to cybersecurity, including anomaly detection in data to identify potential security threats
  • Develop dashboards and visuals for operational and executive use, leveraging Looker Core and BigQuery
  • Implement alerting systems to proactively detect anomalies and security issues
  • Design and implement data ingestion and transformation pipelines leveraging Google Cloud Dataflow / Apache Beam and BigQuery for analytics and large-scale querying
  • Implement Machine Learning models (specifically leveraging BigQuery ML or Vertex AI) to identify statistical outliers, potential intrusions, and fraudulent patterns in network traffic
  • Build fault-tolerant, self-healing, adaptive, and highly accurate streaming and batch data pipelines on GCP
  • Perform data manipulation and analysis to support threat detection and reporting
  • Collaborate closely with cross-functional teams to ensure data quality, availability, and reliability across cloud environments
  • Develop and maintain technical documentation for all assigned systems and projects
What we offer
What we offer
  • Flexibility, with remote and hybrid work options (country-dependent)
  • Career advancement, with international mobility and professional development programs
  • Learning and development, with access to cutting-edge tools, training and industry experts
  • Medical, dental, and vision insurance for you and your family, plus employer contributions to Health Savings Accounts
  • Fulltime
Read More
Arrow Right

Senior Google Cloud Data Engineer

We are seeking a Senior Data Engineer with a strong background in data engineeri...
Location
Location
Canada
Salary
Salary:
90000.00 - 140000.00 CAD / Year
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong expertise in Python for building data pipelines, processing tasks, and automation
  • Advanced SQL capabilities (nested fields, analytic functions)
  • Hands-on experience with Core GCP Data Stack: BigQuery, Dataflow (Apache Beam)
  • Strong proficiency in building reliable batch and incremental pipelines for GA4/Google Ads data into BigQuery
  • Experience with Pub/Sub: event-driven architecture and message queuing
  • Hands-on experience with Visualization & BI: Looker Core – Advanced proficiency in LookML
  • Ability to independently own workstreams while collaborating closely with data science, analytics, and engineering peers in agile delivery
  • Advanced English skills
Job Responsibility
Job Responsibility
  • Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data pipelines
  • Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
  • Provide consultation and lead the implementation of complex programs
  • Develop and maintain documentation relating to all assigned systems and projects
  • Tune queries running over billions of rows of data running in a distributed query engine
  • Perform root cause analysis to identify permanent resolutions to software or business process issues
  • Implement and maintain dbt transformation models, CI pipelines, and data contracts for curated campaign, ad group, keyword, audience, and landing-page marts
  • Build and monitor data quality gates (Great Expectations and reconciliation checks) and freshness SLOs
  • Optimize BigQuery cost and performance using query tuning, storage design, and reservation strategy
  • Implement platform hardening controls including retries, dead-letter queues, DR runbooks, and support for VPC-SC and DLP validation
What we offer
What we offer
  • A comprehensive insurance plan
  • Dialogue via Sun Life provides virtual healthcare services
  • Access to the Employee and Family Assistance Program
  • A complete mental health support program
  • A $500 Personal Spending Account
  • A retirement plan where Valtech will match 100% of your RRSP contributions through a Deferred Profit Sharing Plan (DPSP), up to a maximum of 4%
  • Access to a flexible vacation under Valtech's policy
  • Personal Technology Reimbursement – $30/month
  • We close during the winter holidays and offer flexible scheduling throughout the year
  • Fulltime
Read More
Arrow Right

Senior Google Cloud Data Engineer

We are seeking a Senior Data Engineer with a strong background in data engineeri...
Location
Location
Brazil
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong expertise in Python for building data pipelines, processing tasks, and automation
  • Advanced SQL capabilities (nested fields, analytic functions)
  • Hands-on experience with Core GCP Data Stack: BigQuery (expert-level SQL, performance tuning, partitioning and clustering strategy, production-grade curated marts and feature tables, working knowledge of BQML)
  • Dataflow (Apache Beam)
  • Strong proficiency in building reliable batch and incremental pipelines for GA4/Google Ads data into BigQuery, with streaming patterns
  • Pub/Sub: Experience with event-driven architecture and message queuing
  • Hands-on experience with Visualization & BI: Looker Core – Advanced proficiency in LookML (derived tables, explores, Liquid syntax)
  • Semantic Modeling: Develop robust LookML models
  • Dashboard Creation: Design intuitive dashboards in Looker for operational teams and executives
  • Ability to independently own workstreams while collaborating closely with data science, analytics, and engineering peers in agile delivery
Job Responsibility
Job Responsibility
  • Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data pipelines
  • Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
  • Provide consultation and lead the implementation of complex programs
  • Develop and maintain documentation relating to all assigned systems and projects
  • Tune queries running over billions of rows of data running in a distributed query engine
  • Perform root cause analysis to identify permanent resolutions to software or business process issues
  • Implement and maintain dbt transformation models, CI pipelines, and data contracts for curated campaign, ad group, keyword, audience, and landing-page marts
  • Build and monitor data quality gates (Great Expectations and reconciliation checks) and freshness SLOs
  • Optimize BigQuery cost and performance using query tuning, storage design, and reservation strategy
  • Implement platform hardening controls including retries, dead-letter queues, DR runbooks, and support for VPC-SC and DLP validation
What we offer
What we offer
  • Growth opportunities
  • A values-driven culture
  • International careers
  • The chance to shape the future of experience
  • An environment designed for continuous learning, meaningful impact, and professional growth
  • A workplace culture that fosters creativity, diversity and autonomy
  • A borderless, global framework, which enables seamless collaboration
Read More
Arrow Right

Senior Data Engineer - Data Platform

We are looking for a Senior Data Engineer - Data Platform to join our Data & AI ...
Location
Location
France , Paris
Salary
Salary:
Not provided
doctolib.fr Logo
Doctolib
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • More than 7 years of experience as Site Reliability Engineer, Data Ops, Data Platform Engineer or in a similar role, with a proven track record of building and maintaining complex data infrastructures
  • Strong proficiency in data engineering and infrastructure tools and technologies, such as stream and events processing (Kafka, PubSub, Firehose) and Kubernetes
  • Expertise in programming languages like Python
  • Familiar with cloud infrastructure and services, preferably AWS, Azure, or GCP, and have experience with infrastructure-as-code tools such as Terraform
  • Excellent problem-solving skills with a focus on identifying and resolving data infrastructure bottlenecks and performance issues
Job Responsibility
Job Responsibility
  • Design and implement a scalable and reliable data infrastructure that supports the collection, processing, storage, and analysis of large-scale datasets while pushing security and privacy best practices
  • Build and maintain data pipelines that efficiently extract, transform, and load data from various sources into our data warehouse
  • Implement automation and orchestration tools to streamline infrastructure provisioning, data workflows, reduce manual effort, and improve operational efficiency
  • Monitor data platform for performance and reliability, identify and troubleshoot issues, and implement proactive solutions to ensure data quality and availability
  • Streamline and monitor platform costs, identify optimizations and saving opportunities while collaborating with data engineers, data scientists, and other stakeholders
What we offer
What we offer
  • Free comprehensive health insurance for you and your children
  • Parent Care Program: receive one additional month of leave on top of the legal parental leave
  • Free mental health and coaching services through our partner Moka.care
  • For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
  • Work from EU countries and the UK for up to 10 days per year, thanks to our flexibility days policy
  • Up to 14 days of RTT
  • A subsidy from the work council to refund part of the membership to a sport club or a creative class
  • Lunch voucher with Swile card
  • Fulltime
Read More
Arrow Right

Software Developer - Senior / Senior Data Engineer

Imagine being at the forefront of protecting financial integrity and enabling cr...
Location
Location
United States , Southlake, TX or Austin, TX
Salary
Salary:
55.92 - 62.13 USD / Hour
aquent.com Logo
Aquent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
  • 8+ years of hands-on experience in data management, including gathering data from diverse sources, consolidating it into centralized locations, and transforming it with business logic for consumption in visualization and data analysis
  • Strong expertise in BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and related cloud platform services
  • Proficiency in Python and SQL for data processing and automation
  • Extensive experience with ETL processes and data pipeline design
  • Excellent problem-solving skills and meticulous attention to detail
  • Strong communication and collaboration skills, with the ability to actively listen, dialogue freely, and verbalize ideas effectively
  • Ability to thrive in an Agile work environment, delivering incremental value to customers by effectively managing and prioritizing tasks
Job Responsibility
Job Responsibility
  • Design, build, and maintain robust and scalable data pipelines using cloud platform tools such as BigQuery, Cloud Storage, Dataflow (Apache Beam), Cloud Composer (Airflow), and Pub/Sub
  • Develop high-performance, production-grade Python and SQL code, optimizing queries for efficient data extraction, transformation, and loading (ETL) processes
  • Implement complex data models in BigQuery, leveraging partitioning, clustering, and materialized views to achieve optimal performance
  • Collaborate closely with cross-functional teams, including business customers and Subject Matter Experts, to gather data requirements and deliver impactful solutions
  • Implement and uphold best practices for data quality, data governance, and data security
  • Proactively monitor and troubleshoot data pipeline issues, ensuring high availability and performance of critical data flows
  • Contribute to strategic data architecture decisions, providing recommendations for continuous improvement of data pipelines
  • Stay current with emerging trends and technologies in cloud-based data engineering and cyber security to drive innovation
  • Lead investigation and resolution efforts for identified data issues, taking ownership to resolve them in a timely manner
  • Document processes and procedures thoroughly for producing accurate metrics and ensuring operational clarity
What we offer
What we offer
  • subsidized health, vision, and dental plans
  • paid sick leave
  • retirement plans with a match
Read More
Arrow Right

Senior Data Entitlements Engineer - Market Data Platform

Join us as a Senior Data Entitlements Engineer - Market Data Platform at Barclay...
Location
Location
Czechia , Prague
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert-level experience designing and implementing entitlement and license governance frameworks for data platforms, including defining policies, rules, and workflows that control access to sensitive market data at scale
  • Expertise and hands-on experience with entitlements engines and access-control models (RBAC, ABAC, ...), with a proven track record of building or configuring fine-grained permission structures in production environments
  • Demonstrated experience implementing and managing entitlements across multiple analytics and data platforms — specifically AWS (IAM, Lake Formation), Snowflake, Databricks, and/or KDB — understanding platform-specific security models and how to harmonise them under a unified governance layer
  • Strong AWS cloud experience, including identity federation, and security services relevant to data access and governance
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right

Senior Staff Engineer – Cybersecurity Data Protection Engineer

GEICO’s Cybersecurity organization has an exciting opportunity for an accomplish...
Location
Location
United States , Chevy Chase; Palo Alto; Seattle
Salary
Salary:
115000.00 - 260000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience with data discovery, classification, handling, access, inventory, and retention
  • Proven experience with data protection technologies, such as encryption, tokenization and data loss prevention tools
  • Familiar with programming languages such as Python, Java, or .NET
  • Experience with designing and implementing data security solutions for enterprise environments
  • Experience in managing and supervising other Data Protection Engineers
  • Experience in developing and managing data protection programs focused on data discovery, data inventory, data risk assessments, and encryption for both structured and unstructured data
  • Strong knowledge of cybersecurity laws, regulations, and best practices
  • Knowledge of data security frameworks, standards, and protocols
  • Strong understanding of data privacy laws and regulations (i.e. NYDFS, PCI, etc.)
  • Strong analytical and problem-solving skills
Job Responsibility
Job Responsibility
  • Develop and Implement data protection strategies and initiatives, including classification and handling, data access controls, inventory, encryption, and retention
  • Work closely with other stakeholders to enforce data protection related policy and respond to regulatory requirements
  • Develop and maintain data security policies, procedures, standards, and ensure that they are followed by the entire organization
  • Create and maintain data inventories and data flows, and manage data sharing controls
  • Drive the design and implementation of data access controls, ensuring only authorized access to sensitive data
  • CO-develop and implement data retention policy and procedures, ensure compliance with internal policy and external regulations
  • Enforce data encryption standards and strategies to secure data at rest and in transit
  • Lead incident response efforts related to data breach and work with stakeholders to mitigate impact
  • Lead and conduct regular data risk assessments to identify potential vulnerabilities and threats to the organization's data and information systems
  • Stay abreast of new developments in the field of cybersecurity and ensure that the organization's risk assessment and data security processes are aligned with industry standards and best practices
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Senior Cloud Solution Architect - Cloud & AI Data Platform

We are looking for a Senior Cloud Solution Architect – Cloud & AI Data Platform ...
Location
Location
United States , Multiple Locations
Salary
Salary:
106400.00 - 251900.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, Information Technology, Engineering, Business, Liberal Arts, or related field AND 4+ years experience in cloud/infrastructure technologies, information technology (IT) consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or consulting OR equivalent experience
  • This position is not eligible for visa sponsorship. Candidates must have authorization to work in the United States that does not now or in the future require employer sponsorship.
Job Responsibility
Job Responsibility
  • Operates according to required operational excellence and proven practice standards throughout all sales stages/activities/tools of record (e.g., pipeline updates, time tracking)
  • Collaborates across Microsoft and customer/partner teams through on-strategy delivery to achieve customer/partner objectives and increase customer/partner satisfaction
  • Proactively manages business and technical risks, adapts methodology and applies governance principles to identify, communicate, and minimize business and technical risks
  • Executes work in compliance with industry and Microsoft guidelines and procedures
  • Continuously prioritizes among competing demands in their work and identifies where impact occurs with customers, ensuring alignment with business priorities and goals
  • Delivers solutions in line with company methodologies (e.g., product offerings such as value-based deliverables [VBDs], advice, training, technical validation), ensuring proven practices and patterns are followed to prepare customers for operational readiness and achievement of their business goals and targets
  • Leveraging knowledge of change management proven practices and/or involving the change management team, proactively helps the customer deploy for long-term organizational adoption to increase customer satisfaction and drive consumption/usage
  • Guides customers/partners towards a well-architected (e.g., secure, resilient, artificial intelligence [AI]-enabled), and cost- and performance-optimized solution to increase retention and expansion opportunities
  • Provides feedback to Unified Delivery Team on VBDs to refine and further develop content
  • Proactively identifies new opportunities for Consumption, Usage & Unified expansion (especially Enhanced Solutions) at scale based on business value to customer/partner and clear understanding of the Microsoft value proposition for supported platforms to empower cloud success, foster and strengthen security and resiliency, and drive AI innovation
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation.
  • Fulltime
Read More
Arrow Right