CrawlJobs Logo

Senior Data Engineer

United States, Austin 153000.00 - 227000.00 USD / Year · Job Posted May 04, 2026
Apply Position
Job Link Share

Job Description

This role is categorized as hybrid. This means the successful candidate is expected to report to Austin Technical Center in Austin, TX or GM Global Tech Center in Michigan, MI three times per week, at minimum [or other frequency dictated by the business if more than 3 days]. The Role: As a Data Engineer, you will design, build, and optimize industrialized data assets and data pipelines in support of Business Intelligence and Advanced Analytics objectives. In this role within the Intelligent Manufacturing organization under Data Engineering Software, you will deliver high-quality, scalable solutions that meet both functional and non-functional business requirements. You will contribute to projects across databases, streaming technology, CI/CD, and cloud platforms. The Intelligent Manufacturing teams are responsible for ideating, incubating, and delivering new plant data solutions for General Motors Manufacturing and our partners. We integrate with business and IT teams to develop real-time solutions that leverage plant floor data to improve decisions, plant asset maintenance, safety, and operational performance, as well as Vehicle Build Data. This is a senior-level role that blends strong data engineering skills with modern software engineering practices. You will help lead and deliver innovative, scalable, and maintainable data-driven solutions—writing high-quality, tested, production-ready code that meets customer needs and scales without rework. You will work in a collaborative, cross-disciplinary environment, handle complex challenges, contribute to architectural discussions, and help shape solutions that improve performance, scalability, and maintainability, while also ensuring alignment with business priorities.

Job Responsibility

  • Assemble large, complex data sets that meet functional and non-functional business requirements
  • Identify, design, and implement process improvements, including automation, data delivery optimization, and infrastructure redesign for scalability
  • Lead and deliver data-driven solutions across multiple languages, tools, and technologies
  • Contribute to architecture discussions, solution design, and strategic technology adoption
  • Build and optimize highly scalable data pipelines incorporating complex transformations and efficient code
  • Design and develop new source system integrations from varied formats (files, database extracts, APIs)
  • Design and implement solutions for delivering data that meets SLA requirements
  • Work with operations teams to resolve production issues related to the platform
  • Apply best practices such as Agile methodologies, design thinking, and continuous deployment
  • Develop tooling and automation to make deployments and production monitoring more repeatable
  • Collaborate with business and technology partners, providing leadership, best practices, and coaching
  • Mentor peers and junior engineers
  • educate colleagues on emerging industry trends and technologies

Requirements

  • Bachelor's degree in Computer Science, Software Engineering, or related field, or equivalent experience
  • 7+ years of data engineering/development experience, including Python or Scala, SQL, and relational/non-relational data storage. (ETL frameworks, big data processing, NoSQL)
  • 3+ years of experience in distributed data processing (Spark) and container orchestration (Kubernetes)
  • Proficiency in data streaming in Kubernetes and Kafka
  • Experience with cloud platforms – Azure preferred
  • AWS or GCP also considered
  • Solid understanding of CI/CD principles and tools
  • Familiarity with big data technologies such as Hadoop, Hive, HBase, Object Storage (ADLS/S3), Event Queues
  • Strong understanding of performance optimization techniques such as partitioning, clustering, and caching
  • Proficiency with SQL, key-value datastores, and document stores
  • Familiarity with data architecture and modeling concepts to support efficient data consumption
  • Strong collaboration and communication skills
  • ability to work across multiple teams and disciplines

Nice to have

  • Master's degree in Computer Science, Software Engineering, or related field
  • Knowledge of data governance, metadata management, or data quality/observability
  • Familiarity with schema design and data contracts
  • Experience handling various file formats (video, audio, image)
  • Experience with Databricks, Snowflake, or similar platforms

What we offer

  • Health and wellbeing benefit programs
  • Medical
  • Dental
  • Vision
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Tuition assistance programs
  • Employee assistance program
  • GM vehicle discounts

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer

8 matching positions

New

Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, build, and opt...
Location
Location
Poland
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake, and strong programming skills in Python and SQL. Proven experience building batch and streaming data pipelines and production-grade data platforms, with solid understanding of data modeling, data quality, and governance principles. Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP. Familiarity with modern data platforms such as Databricks and Snowflake is expected. Experience with lakehouse architectures and distributed data systems, and strong understanding of scalability, reliability, and performance considerations in data pipelines. Strong problem-solving skills focused on scalability and reliability, with a collaborative approach to working in cross-functional teams.
Job Responsibility
Job Responsibility
  • Design and implement scalable data platforms and pipelines across cloud environments
  • develop reliable batch, streaming, and near-real-time pipelines
  • implement modern data architectures including lakehouse patterns and medallion layering
  • deliver high-quality datasets supporting analytics, machine learning, causal modeling, and optimization systems
  • enable data pipelines for GenAI use cases
  • design scalable logical and physical data models
  • orchestrate workflows using tools such as Airflow, dbt, Lakeflow
  • apply modern architecture patterns including event-driven and streaming architectures
  • ensure adherence to best practices in data governance, lineage, quality, and access control
  • establish strong data observability
What we offer
What we offer
  • 24 working days of paid vacation
  • National holidays covered
  • Sick leave (up to 20/year)
  • Unpaid leave (up to 20/year)
  • Medical insurance
  • Multisport card OR Multikafeteria
  • Maternity & paternity leave support
  • Internal workshops & learning initiatives
  • Professional certifications reimbursement
  • Participation in professional local & global communities
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

At Schwab, you’re empowered to make an impact on your career. Here, innovative t...
Location
Location
United States , Southlake
Salary
Salary:
164000.00 - 183000.00 USD / Year
schwab.com Logo
Charles Schwab
Expiration Date
June 22, 2026
Flip Icon
Requirements
Requirements
  • Bachelor of Science in Computer Science or a related field
  • The ideal candidate should have at least 7+ years of data engineering experience, 5+ years development experience and 3 years or more experience with Postgres database management. The candidate must additionally have experience with Oracle, SQL Server, MySQL, and/or Mongo DB
  • Must have worked as alongside a business vertical to establish nomenclature, data catalogs, provenance, standards, semantics and usage of data
  • Deep knowledge and experience with query development and optimization (SQL, PL/SQL, and No SQL)
  • Experience in performance-tuning database applications is a MUST
  • Experience in multi-datacenter DB installations, disaster recovery, and replication techniques
  • Advanced knowledge of database backup and recovery strategies
  • Ability to work in a Unix environment including an ability to write scripts in Unix
  • Provide database technical support for Technology and Application Delivery projects
  • Must have excellent written and verbal communications skills
Job Responsibility
Job Responsibility
  • Define and maintain conceptual, logical, and physical database models by working with business stakeholders and identifying optimal database specifications. Ensures that database design and system capabilities meet validated user requirements. Work with application development teams designing, developing, and enhancing database schemas, creating database views, helping with query optimization, and figuring out ways to increase application performance. Enhance and recommend solutions / processes for downstream impact analysis associated with data and/or model changes. Support, maintain and enhance applications (when necessary) written with ETL tools such as Informatica, Airflow, Snowflake and additionally support teams using custom ingestion and transformation processes. Collaborate with enterprise stakeholders to implement and adhere to data storage standards and maintain catalogs to facilitate consistent data management practices. Establish data quality metrics and monitoring processes to proactively identify and resolve data quality issues. Work with various IT departments within Schwab to perform preventive and corrective maintenance and incident management measures. Ensure database integrity, availability, and restorability by working with enterprise operational excellence teams. Evaluates the integration of new tools or technologies based on the capabilities of the existing infrastructure. Recommend solutions and help with functional and performance testing needs (mock data, test environments, data refresh processes). Responsible for coordination of planning the installation of operating systems, databases, applications, development upgrades, and new releases. Follow and develop database standards, guidelines, and best practices. Establishes standards, controls, and procedures to ensure data integrity and security. Perform capacity planning and projection for future growth. And finally, be able to work in an Agile Scrum environment
What we offer
What we offer
  • 401(k) with company match and Employee stock purchase plan
  • Paid time for vacation, volunteering, and 28-day sabbatical after every 5 years of service for eligible positions
  • Paid parental leave and family building benefits
  • Tuition reimbursement
  • Health, dental, and vision insurance
  • Medical, dental and vision benefits
  • 401(k) and employee stock purchase plans
  • Tuition reimbursement to keep developing your career
  • Paid parental leave and adoption/family building benefits
  • Sabbatical leave available after five years of employment
  • Fulltime
!
Read More
Arrow Right
New

Senior Data Engineer

As a Senior Data Engineer, you will provide thought leadership and deliver cutti...
Location
Location
Australia , Brisbane
Salary
Salary:
Not provided
aurizon.com.au Logo
Aurizon
Expiration Date
June 28, 2026
Flip Icon
Requirements
Requirements
  • Relevant degree in computer science, engineering, statistics, mathematics or similar
  • Senior data engineering or data warehousing expertise
  • Deep experience architecting scalable modern data platforms (cloud and/or on‑prem)
  • Strong capability across data modelling, transformation, cleansing and publication
  • Experience with machine learning frameworks, modern programming tools and agile delivery
  • Ability to explain technical concepts simply to business stakeholders
  • Strong collaboration skills — you enjoy working with SMEs, senior managers and executives
  • Exceptional communication and problem‑solving abilities
Job Responsibility
Job Responsibility
  • Build and deliver end‑to‑end enterprise data pipelines to drive operational, financial and commercial improvements
  • Provide expert guidance on data architecture, solution design, standards and best practice
  • Lead the development and continuous improvement of scalable data platforms
  • Support acquisition, integration, retention and publication of complex data across diverse business use cases
  • Prototype and develop next‑generation on‑prem and cloud-based data solutions across structured and unstructured datasets
  • Balance innovation with value, practicality and risk
  • Improve service delivery, technical support and change management processes
What we offer
What we offer
  • Development and growth opportunities
  • Access to mentoring and development programs
  • Discounts on selected health insurance funds, personal travel, gyms, vehicles and retail brands
  • Parental leave program and super booster
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

In this role, you will work closely with the Digital Innovation team to design, ...
Location
Location
Canada , Vancouver
Salary
Salary:
140000.00 - 175000.00 USD / Year
klohn.com Logo
Klohn Crippen Berger
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field (or equivalent practical experience)
  • 7+ years in data engineering and enterprise data platforms, including hands-on Microsoft Fabric experience
  • Hands-on experience with Microsoft Fabric, OneLake, and Power BI
  • Experience designing and implementing enterprise data pipelines and architectures
  • Strong understanding of Medallion Architecture and modern data platform concepts
  • Experience with Azure data services and cloud-based data platforms
  • Knowledge of RBAC, and compliance best practices
  • Strong analytical and troubleshooting skills
  • Experience working with large-scale enterprise datasets
  • Strong oral and written communication skills
Job Responsibility
Job Responsibility
  • Support the implementation, optimization and governance of Microsoft Fabric and OneLake environments
  • Develop and maintain scalable data ingestion pipelines, workflows and enterprise data models
  • Design and implement Medallion Architecture (Bronze, Silver, Gold) solutions
  • Support Power BI semantic modeling, reporting, and analytics initiatives
  • Integrate and support Microsoft Purview governance capabilities
  • Assist with data quality, RBAC, security, compliance, and governance requirements
  • Collaborate with technical stakeholders to support enterprise reporting and AI initiatives
  • Troubleshoot and optimize Fabric workloads, pipelines, and data models for scalability and performance
  • Document technical solutions, processes, and standards
What we offer
What we offer
  • Hybrid work opportunities
  • Annual performance and salary review
  • Vacation policy that aligns to your experience
  • Flexible benefits, including RSP, social, and mental well-being initiatives
  • Paid OT, and sick days
  • Commitment to global ESG standards
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Location
Location
United Kingdom , London
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineering & Pipeline Architecture: End-to-end data engineering covering real-time and batch ingestion, ETL pipelines, and full lifecycle (ingestion → processing → consumption) using AWS, SQL, Java, and Python
  • Cloud Data Platforms & Distributed Systems: Hands-on experience with AWS data platforms, Data Lakes, Databricks, and federated architectures, including integration across multiple enterprise data sources
  • Data Governance, Modelling & Metadata Management: Strong expertise in large-scale SQL data modelling, enterprise data cataloguing (Alation), data governance, metadata management, and regulatory-aligned data frameworks
Job Responsibility
Job Responsibility
  • Provision of guidance and expertise to engineering teams to ensure alignment with best practices and foster a culture of technical excellence
  • Contribution to strategic planning by aligning technical decisions with business goals, anticipating future technology trends, and providing insights to optimize product roadmaps
  • Design and implementation of complex, scalable, and maintainable software solutions, considering long-term viability and business objectives
  • Mentoring and coaching to junior and mid-level engineers to foster professional growth and knowledge sharing, elevating the overall skillset and capabilities of the organization
  • Collaboration with business partners, product managers, designers, and other stakeholders to translate business requirements into technical solutions and ensure a cohesive approach to product development
  • Innovation within the organization by identifying and incorporating new technologies, methodologies, and industry practices into the engineering process
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Senior Data Engineer - UKRAINE - REMOTE. We are looking for an experienced Senio...
Location
Location
Ukraine
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake
  • strong programming skills in Python and SQL
  • proven experience building batch and streaming data pipelines and production-grade data platforms
  • solid understanding of data modeling, data quality, and governance principles
  • experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP
  • familiarity with modern data platforms such as Databricks and Snowflake
  • experience with lakehouse architectures and distributed data systems
  • strong understanding of scalability, reliability, and performance considerations in data pipelines
  • strong problem-solving skills focused on scalability and reliability
  • collaborative approach to working in cross-functional teams
Job Responsibility
Job Responsibility
  • Build & Data Platform Engineering: design and implement scalable data platforms and pipelines across cloud environments
  • develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
  • build ingestion, transformation, and curation workflows for both structured and unstructured data
  • implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold)
  • Enable AI, GenAI & Data Products: deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems
  • enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows) and agent-based architectures and intelligent workflows
  • Data Modeling, Orchestration & Automation: design scalable logical and physical data models for analytical and operational use cases
  • orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents
  • Architecture, Governance & Observability: apply modern architecture patterns including event-driven and streaming architectures
  • ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC)
What we offer
What we offer
  • Mental and physical health: Medical insurance
  • Sports reimbursement budget
  • Home office support
  • A number of free psychological and legal consultations
  • Maternity and paternity leave support
  • Personal and professional development: Internal workshops and learning initiatives
  • English language classes compensation
  • Professional certifications reimbursement
  • Participation in professional local and global communities
  • Growth Framework to manage expectations and define the steps to move towards the selected career
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

The Opportunity: We are currently partnering with several leading technology con...
Location
Location
United Kingdom , United Kingdom
Salary
Salary:
100.00 GBP / Day
myn.co.uk Logo
Myn
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience in designing, building, and maintaining production-grade data pipelines
  • Proficiency in Python and SQL for data manipulation and transformation
  • Strong understanding of cloud architecture and services
  • Experience with DevOps practices, including CI/CD and infrastructure as code
  • Proven ability to design and optimise data models and architectures
  • Experience implementing data quality, governance, and compliance standards
  • Excellent documentation and technical communication skills
  • Demonstrable ability to collaborate effectively with cross-functional teams
Job Responsibility
Job Responsibility
  • End-to-end lifecycle of robust, scalable data pipelines
  • Ensure data systems are efficient, reliable, and capable of supporting complex analytical and operational requirements
  • Work closely with cross-functional teams to translate business needs into technical solutions
  • Drive the evolution of cloud-based systems while maintaining rigorous standards for data quality, governance, and infrastructure automation
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are seeking an experienced Data Engineer to help build and scale our modern d...
Location
Location
India , Pune
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience in a cloud environment
  • Strong proficiency with Microsoft Fabric (Lakehouses, Spark, Data Factory, Pipelines)
  • Hands-on experience with Apache Airflow for workflow orchestration
  • Experience with DBT (Data Build Tool) for transformations, testing, and documentation
  • Proficiency in SQL and at least one scripting language (Python preferred)
  • Familiarity with cloud infrastructure concepts and CI/CD practices
  • Understanding of data modelling concepts (dimensional, medallion architecture)
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ELT/ETL pipelines using Microsoft Fabric and DBT
  • Orchestrate data workflows using Apache Airflow (scheduling, monitoring, alerting)
  • Implement data quality checks, testing frameworks, and data contract standards
  • Collaborate with analytics engineers and BI developers to deliver trusted data products
  • Contribute to data governance, cataloguing, and documentation practices
  • Fulltime
Read More
Arrow Right