CrawlJobs Logo

Data Engineering

Brazil, São Caetano do Sul · Job Posted March 21, 2026
Apply Position
Job Link Share

Job Description

As a part of data engineering in Digital Services and Experience, you will design and maintain scalable data pipelines and curated data products that enable GM to deliver future-focused, consumer-centric solutions. You will support multiple lines of business (Loyalty, OnStar, Digital Services & Experience, Manufacturing, Growth Businesses) by ensuring reliable, high-quality data is available for decision making and advanced analytics.

Job Responsibility

  • Design, build, and maintain data pipelines and ETL/ELT processes using Python, SQL, and Spark (e.g., in Databricks)
  • Develop curated, production-grade datasets from large, complex data sources to support business and advanced analytics use cases
  • Implement data quality checks, monitoring, and documentation for data products and pipelines
  • Work with cross-functional teams to translate business needs into scalable data solutions and resolve data-related technical issues
  • Identify opportunities for automation and process optimization in data ingestion, transformation, and delivery
  • Manage and maintain data models, metadata, and data standards, ensuring consistency across systems

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Information Technology, or related field
  • Fluency in English language
  • Strong experience with big data and processing frameworks (e.g., Spark, Hadoop, Kafka) and cloud platforms (Azure or AWS)
  • Advanced SQL skills and experience with relational and NoSQL data stores (e.g., Postgres, Cassandra)
  • Proficiency in Python and experience with Databricks, Spark, and Git/GitHub for version control
  • Practical experience working with large-scale event or customer data and turning it into reliable, reusable datasets
  • Demonstrated ability to identify tasks for automation and implement automated solutions
  • Strong problem-solving, communication, and collaborative skills, with the ability to manage multiple priorities in a dynamic environment

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineering

8 matching positions

Manager, Data Engineering - Finance Data Foundations

Manager, Data Engineering - Finance Data Foundations The Manager, Data Engineer...
Location
Location
Canada , Toronto
Salary
Salary:
110000.00 - 130000.00 USD / Year
fourseasons.com Logo
Four Seasons
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 5-8 years experience Data Engineering
  • with experience in Azure using Databricks
  • Bachelor’s degree Required
  • MBA or Master’s in Engineering preferred
  • Expert in Data Engineering in Microsoft Azure Environment + Toolsets (ADF, Synapse, Data Bricks, Cosmos DB, FunctionApps, Logic Apps etc)
  • Lakehouse experience using Databricks
  • Azure platform administration
  • Data Governance Software experience
  • Microsoft Power BI delivery and support
  • Strong SQL query skills
Job Responsibility
Job Responsibility
  • Leading the delivery of finance domain data migration projects with clear milestones, quality controls, and operational readiness
  • Designing and maintaining reusable data ingestion and transformation frameworks aligned with enterprise engineering standards
  • Ensuring data consistency, lineage, and trustworthiness across finance and enterprise data domains
  • Collaborating with business and technical stakeholders to enable analytics, forecasting, and AI readiness for finance data
  • Driving operational excellence across engineering practices, optimizing for cost, performance, and maintainability
  • Design, develop, and maintain robust batch and streaming data pipelines across Azure Data Factory, Databricks, Informatica, and SQL environments, ensuring scalability, reliability, and operational efficiency
  • Closely work with vendors, contractors and other FS teams to operationalize the data migration process for the hotels
  • Implement and oversee CI/CD workflows, Infrastructure as Code (IaC), and automated testing frameworks (unit, integration, and data validation) with built-in monitoring and observability to meet defined SLAs and SLOs
  • Operationalize data quality by integrating Informatica IDQ into finance workflows for profiling, rule-based validation, and continuous data quality monitoring
  • Apply governance standards by embedding metadata, cataloging, and lineage practices in collaboration with the Data Strategy & Governance team
  • Fulltime
Read More
Arrow Right

Engineering Director Data Engineering

Location
Location
India , Gurugram
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 26, 2026
Flip Icon
Requirements
Requirements
  • Proficiency in Data Engineering
  • Strong knowledge of data pipeline development and data integration techniques
  • 5+ years of overall IT experience, which includes building & deployment of Bigdata applications using PySpark and AWS cloud
  • Extensive experience in design, build and deployment of Python-based applications
  • Hands-on experience in relational databases preferably Oracle and PostgreSQL and writing complex SQL queries
  • Experience in various AWS services such as EMR, API Gateway, RDS instance, and Lambda
  • Understand complex data sets and ETL processes, and how they can be optimized using Spark
  • Experience with cloud-based data platforms and distributed computing frameworks
  • Ability to optimize data workflows for performance and scalability
  • Familiarity with database management systems and data warehousing concepts
Job Responsibility
Job Responsibility
  • Expected to be an SME, collaborate and manage the team to perform
  • Responsible for team decisions
  • Engage with multiple teams and contribute on key decisions
  • Provide solutions to problems for their immediate team and across multiple teams
  • Lead the coordination of project activities to ensure timely delivery of software components
  • Mentor junior team members to support their professional growth and skill development
  • Facilitate effective communication between stakeholders to align technical solutions with business objectives
  • Collaborate with other teams to integrate Spark jobs into the overall data pipeline
  • Monitoring and tuning data loads and queries
Read More
Arrow Right

Principal Software Engineering Manager - Data Science & Engineering

The MSRC Data Science team is responsible in building data pipelines, data minin...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Leads team on the disciplined use of, and improving artificial intelligence (AI) tools and practices across the software development lifecycle (SDLC)
  • Guides team on proactively taking responsibility for the content of their AI-generated requirements, design documents, code, and other assets, and assisting other members of the team to do the same
  • Leads team on incorporating Responsible AI practices into the SDLC to ensure appropriate controls over AI-generated assets
  • Coaches team on applying SDLC and engineering health measures (e.g., Accelerate, SPACE framework, Engineering System Success Playbook [ESSP]) to guide improvements to processes and practices, especially those involving AI
  • Leads team on experimenting with AI tools and practices to improve their own capabilities, and providing recommendations on how to adopt them to others
  • Reviews debugging tools, tests, logs, telemetry, and other methods, and acts as an expert for others to proactively verify assumptions while developing code before issues occur across products in production
  • Guides team to perform machine learning/data extraction, transformation, and loading (ETL) pipelines (e.g., data collection, cleaning) based on data prepared
  • Guides the architecture of scalable pipelines and datasets
  • Influences the direction of the team
  • Begins to anticipate potential data pipeline issues and provides solutions
  • Fulltime
Read More
Arrow Right

Associate Data Scientist (Data Engineering)

The Associate – Data Engineering role is an entry‑level engineering position wit...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s (3 to 6 Yrs) or Master’s (2 to 4 Yrs) degree in Computer Science, Engineering, Information Systems, Data Science, or a related quantitative/technical field
  • Experience in data engineering, software engineering, analytics engineering, or data/tech role
  • Familiarity with data concepts (tables, schemas, joins, basic transformations)
  • Proficiency in SQL and data analysis and structured data
  • Strong problem‑solving and analytical reasoning skills
  • Effective written and verbal communication skills
  • Strong learning mindset and willingness to work with new tools, datasets, and business contexts
Job Responsibility
Job Responsibility
  • Support building and maintaining data ingestion and transformation workflows (ETL/ELT) for marketing and media datasets
  • Assist with implementing data validations and QA checks (schema checks, null checks, duplication checks, count reconciliation) to ensure datasets are reliable and analytics‑ready
  • Help monitor pipeline runs and refresh schedules, investigate failures using logs, and escalate issues with clear context and evidence
  • Support development of reusable, governed datasets / data products that are consistent and easy for BI and analytics teams to consume
  • Contribute to documentation (data flow notes, runbooks, assumptions, source mapping) to improve operational stability and handoffs
  • Collaborate with cross‑functional partners (MSO BI, MSO Ops, Analytics teams, Vendors) to ensure inputs and outputs are aligned and dependable
  • Participate in continuous learning and improvement to strengthen engineering fundamentals, reliability practices, and delivery discipline
  • Analyze and understand the functional & non-functional requirements for Investment and Media Analytics function, and translate them into prototype, technical specifications
Read More
Arrow Right

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...
Location
Location
India , Chennai, Madurai, Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
  • Excellent Python programming skills with data engineering libraries and frameworks
  • Advanced SQL capabilities including window functions, CTEs, and performance tuning
  • Solid understanding of distributed processing using Spark/PySpark
  • Experience designing and implementing scalable ETL/ELT workflows
  • Good understanding of data modeling concepts (dimensional, star, snowflake)
  • Familiarity with GenAI/LLM-based integration for data workflows
  • Experience working with Git, CI/CD, and Agile delivery frameworks
  • Strong communication skills for interacting with clients, stakeholders, and internal teams
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
  • Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
  • Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
  • Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
  • Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
  • Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
  • Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
  • Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations
What we offer
What we offer
  • Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
  • Hands-on exposure to modern data stacks and emerging AI technologies
  • Collaboration with experts across Data, AI/ML, and cloud practices
  • Access to structured learning, certifications, and leadership mentoring
  • Competitive compensation with fast-track career growth and visibility
  • Fulltime
Read More
Arrow Right

Engineering Program Manager - Data Center Design, Engineering, and Construction

Meta is seeking an Engineering Program Manager, Technical Operations to join our...
Location
Location
United States , Reston
Salary
Salary:
160000.00 - 223000.00 USD / Year
meta.com Logo
Meta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in a directly related field, or equivalent practical experience
  • 7+ years of experience in Technical Program Management/Project Management
  • Proven track record driving results on complex problems with many stakeholders
  • Large scale critical infrastructure, Research and Development, and/or data center experience
  • Experience building relationships and driving collaboration from cross-functional teams
  • Analytical, problem-solving, negotiation and organizational experience
  • Understanding of engineering details and the impacts of change across multiple disciplines
Job Responsibility
Job Responsibility
  • Manage highly-complex, cross-functional systems designs and component research & development projects from concept through to completion
  • Drive complex problem statement development and create milestone schedules that end in decisions and implementation
  • Interface with Engineering, Facilities, Electrical/Mechanical Engineers, Construction, Network, Cabling, Security and business owners for project requirements and scope
  • Provide hands-on program management during analysis, design, development, and testing phases
  • Digest technical drawings, questioning the inputs of the engineers across multiple highly technical engineering departments and helping to bring all of it together into a cohesive executable package
  • Manage dependencies and handoffs effectively and optimize schedules accordingly
  • Drive internal process improvements across multiple teams and functions
  • Conduct business process re-engineering reviews to innovate on business processes and define ways to improve their efficiency and effectiveness
  • Drive continual improvement of productivity
  • Identify areas of risk and drive solution with subject matter experts within the organization
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Engineering Manager, Community Support Engineering (Routing and Data Services)

Lead the China Routing and Data Service team within Community Support Engineerin...
Location
Location
China
Salary
Salary:
Not provided
airbnb.com Logo
Airbnb
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 9+ years of relevant software development industry experience in a fast paced tech environment
  • Bachelor’s and/or Master’s degree, preferably in CS, or equivalent experience
  • Excellent communication and collaboration skills
  • Proven experience working with many engineering teams and cross functional partners
  • Strong expertise in building large-scale backend systems and experience in user facing features
  • Strong product and design instinct, previous proven experience building delightfully designed experiences
  • Flexible in leadership style, can adapt to a variety of ways of working depending on the situation
  • Experience leading and shipping large initiatives with high business impact
  • Creating a strong culture of operational excellence with focus on raising the bar for quality, reliability and availability
  • Good judgment in making tradeoffs to balance short-term business needs with long-term technical quality
Job Responsibility
Job Responsibility
  • Ramp up on the team’s technology, product, and business goals, including hands-on work to develop a deep technical understanding
  • Lead, mentor, and grow a high-performing engineering team in a fast-paced environment
  • Foster a team culture that emphasizes product thinking, technical depth, and customer-centric problem solving
  • Drive and partner closely with teams across CSE to understand business cases and deliver intuitive, scalable routing and data solutions
  • Set clear priorities and strategic direction in collaboration with cross functional partners
  • Improve team processes to strengthen collaboration and ways of working, execution efficiency, and delivery quality
  • Lead complex, cross-functional projects that align with business goals and deliver measurable impact
  • Collaborate with other senior leaders and peers to define and drive long-term technical strategy and architecture that enables the company’s future vision
  • Collaborate with and influence cross-functional partners to design and deliver high-quality products
  • Lead team technical initiatives, and work cross-functionally to identify opportunities for business impact, refine, and prioritize requirements for engineering systems
Read More
Arrow Right
New

Senior Manager, Data Engineering

Senior Manager, Data Engineering (Enterprise Platforms Technology) Do you love ...
Location
Location
United States , McLean
Salary
Salary:
229900.00 - 262400.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 6 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
  • At least 4 years of people management experience
Job Responsibility
Job Responsibility
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using data movement tools and technologies
  • Work, as a lead developer, with a team of developers with deep experience in data movement, distributed computing, and full stack systems
  • Utilize programming languages like Python, SQL and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake, Databricks
  • Optimize information system for end-user and downstream application consumers by using sound data design practices
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Competitive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right