CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Data Engineer

United States, Houston · Job Posted April 06, 2026
Apply Position
Job Link Share

Job Description

We are looking for a skilled Data Engineer to join our team on a long-term contract basis in Houston, Texas. In this role, you will design, develop, and maintain data pipelines and systems that support critical business operations within the manufacturing industry. Your expertise in data engineering technologies and frameworks will be key to ensuring efficient data processing and integration.

Job Responsibility

  • Develop, optimize, and maintain scalable data pipelines to process large datasets efficiently
  • Implement ETL processes to extract, transform, and load data from various sources into centralized systems
  • Leverage Apache Spark, Hadoop, and Kafka to design solutions for real-time and batch data processing
  • Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions
  • Monitor and troubleshoot data systems to ensure reliability and performance
  • Document data workflows and processes to ensure clarity and maintainability
  • Conduct testing and validation of data systems to ensure accuracy and quality
  • Apply Python programming to automate data tasks and streamline workflows
  • Stay updated on industry trends and emerging technologies to propose innovative solutions
  • Ensure compliance with data security and privacy standards in all engineering efforts

Requirements

  • Proficiency in Apache Spark for distributed data processing
  • Strong knowledge of Python programming and its application in data engineering
  • Experience with Apache Hadoop for big data management
  • Familiarity with Apache Kafka for real-time data streaming
  • Hands-on experience in designing and implementing ETL processes
  • Ability to work collaboratively in a team environment and communicate effectively
  • Solid understanding of data security and privacy practices
  • Bachelor's degree in Computer Science, Information Technology, or a related field

What we offer

  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

Campbell Property Group (CPG), one of Australia’s leading residential constructi...
Location
Location
Australia , Norwest, New South Wales 2153
Salary
Salary:
Not provided
domainehomes.com.au Logo
DOMAINE HOMES
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Demonstrated experience leading a data and analytics function or team (construction or property industry highly desirable)
  • 5–10 years’ experience across data management, business intelligence, analytics and data engineering
  • Proven delivery of analytics, data platform and/or AI initiatives that produced measurable business value
  • Experience establishing data governance, quality and ethical-use practices
  • Strong knowledge of data management, governance and master data management practices
  • Data engineering, pipelines/ETL, data modelling and warehousing concepts Cloud data platform strategy and delivery (e.g. Azure or AWS) spanning data storage, pipelines, analytics and AI services
  • specific platform direction to be confirmed
  • Microsoft SQL Server is a core requirement
  • strong SQL and relational database skills
  • Machine learning, AI agents and automation concepts and their responsible application
Job Responsibility
Job Responsibility
  • Designing and building data pipelines, integrations and data structures
  • Identifying and resolving data quality, performance and integration issues
  • Recommending improvements to data engineering processes and tooling
  • Design, build, test and maintain data pipelines and ETL processes to acquire and prepare data
  • Monitor and optimise pipeline performance, reliability and scalability
  • Build integration components to consume vendor APIs and database extracts (e.g. construction, finance and CRM systems)
  • Implement improvements to integration processes and tools
  • Develop and maintain logical and physical data models for warehouse and reporting purposes
  • Maintain and support databases (primarily Microsoft SQL Server) that store and serve data
  • Identify, escalate and remediate data-quality issues
What we offer
What we offer
  • Secure undercover parking
  • A welcome gift when you start
  • Competitive pay and flexible work options
  • A focus on your health and wellbeing – with multiple gym and health insurance discounts
  • Great retail deals – including travel, groceries, and more
  • Big savings on home builds, trades, suppliers and utilities
  • Ongoing learning through the CPG Academy, with mentoring and unlimited training
  • Opportunities to give back through our charity partners
  • Generous leave – including parental, volunteer, reservist and emergency services leave
  • Free wellbeing support for you and your family, including EAP and health coaching
  • Fulltime
Read More
Arrow Right

Data Engineer

This role will focus on designing, developing, and supporting Databricks-based p...
Location
Location
United States , Austin; Mountain View; Warren
Salary
Salary:
138700.00 - 206950.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Data Engineering, Data Science, Engineering, or a related field
  • or equivalent experience
  • 5+ years of experience as a data engineer, ETL developer, or integration engineer building production-grade data pipelines and data products
  • Hands-on experience with Databricks for data engineering and analytics enablement, including: Strong SQL skills in Databricks
  • Experience building and supporting ETL/ELT pipelines in Databricks
  • Experience developing pipelines using Python, notebooks, DataStage, and scalable data transformation patterns
  • Experience with workflow orchestration, dependency management, scheduling, monitoring, and operational support of production pipelines
  • Proven experience designing and implementing dimensional, layered, or medallion-style data models for analytics and operational use cases
  • Strong knowledge of data warehousing and ETL/ELT concepts, including how upstream design impacts downstream performance, usability, and trust in data products
  • Experience integrating data from enterprise applications, especially operational platforms such as ServiceNow
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines in Databricks to ingest, transform, validate, and publish trusted data products for analytics, reporting, and AI use cases
  • Develop and support end-to-end ETL/ELT workflows using Databricks notebooks, Python, Spark, and SQL, including orchestration, parameterization, error handling, restartability, and performance optimization
  • Build and maintain Bronze, Silver, and Gold data products that are reusable, governed, and aligned to business and downstream consumption needs
  • Build and support integrations both into Databricks and between enterprise applications, including legacy and modern integration patterns such as DataStage-based workflows
  • Implement pipeline logic for ingestion, standardization, cleansing, enrichment, joins, aggregations, and publishing of curated data assets for downstream use
  • Partner with product owners, architects, source-system teams, report and analytics teams, and data consumers to translate business needs into well-defined technical solutions and trusted data products
  • Define and implement data transformations, semantic structures, and curated data assets that improve usability, consistency, downstream performance, and trust in the data
  • Apply strong data quality, validation, reconciliation, and documentation practices to ensure data products are accurate, discoverable, reliable, and production-ready
  • Use GitHub-based development practices for version control, code review, collaboration, and promotion of pipeline changes across environments
  • Support secure and compliant data delivery by implementing access controls, permissions, and governance requirements in alignment with GM policies
What we offer
What we offer
  • health and wellbeing benefit programs
  • medical
  • dental
  • vision
  • Health Savings Account
  • Flexible Spending Accounts
  • retirement savings plan
  • sickness and accident benefits
  • life insurance
  • paid vacation & holidays
  • Fulltime
Read More
Arrow Right

Data Engineer

We are currently seeking a Data Engineer to join our team in Bangalore, Karnātak...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 9+ years in Data Engineering / Big Data / Platform Engineering with end to end delivery of large enterprise programs
  • Multi tenant database and data modeling expertise—designing tenant aware schemas and delivering efficient, robust database code and designs for websites and products
  • Advanced SQL across Oracle, Azure SQL Managed Instance (SQL MI), MySQL, and Snowflake
  • strong performance tuning and query optimization
  • Hands on with cloud data platforms: Azure (preferred), including big data services and integrations
  • Deep experience building ETL/ELT pipelines using Informatica, SnapLogic, Azure Functions, Python targeting Snowflake and other cloud data warehouses
  • Proven track record designing, developing, and deploying batch data processing pipelines and feature generation platforms using Azure, Python, and SQL
  • Strong DataOps/CI/CD for data and code: GitHub based workflows, automated database releases, and source control best practices across the SDLC
  • Experience with event/streaming: Azure Event Hubs, Kafka, or Amazon Kinesis
  • Azure platform proficiency, including: Azure Data Factory, Azure Databricks, AKS, Azure Service Bus (ASB), API Management, Storage Accounts, Event Hub/Event Grid, Redis Cache
  • Fulltime
Read More
Arrow Right
New

Data Engineer

As a Data Engineer, you will join Genus and work within the Data Platform Engine...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
September 03, 2026
Flip Icon
Requirements
Requirements
  • Travel Occasional Travel will be required
  • Education Bachelors Degree or Equivilent in Computing related subject
  • Licenses/Certifications Desirable: Databricks Certified Professions
  • Dbt Certified
  • Microsoft Certified
  • SQL / T-SQL and analytical data warehouse development - 8+ years
  • Apache Spark experience using Python, PySpark and SparkSQL at scale - 5+ years
  • Expertise on performance optimisation and production stability of the data workloads - 3+ years
  • Expertise on building metadata-driven, reusable data pipelines using Databricks and ADF - 3+ years
  • Hands-on experience working with Delta-based datasets, multi-layer Lakehouse architectures, and evolving schemas - 3+ years
Job Responsibility
Job Responsibility
  • Design, develop, test, and deploy advanced data engineering solutions using Azure SQL Server, Python, PySpark, Databricks, and Azure Synapse
  • Optimize data models and queries for performance and resource efficiency
  • Build scalable data processing pipelines using Python and PySpark for large-scale data transformation and analytics
  • Implement and manage Databricks and Azure Synapse environments for big data processing and analytics
  • Develop and maintain data transformation models in dbt and Azure Data Factory
  • Ensure proper source control and deployment practices using Git and CI/CD tools (Azure DevOps, GitHub)
  • Collaborate with stakeholders to understand requirements and deliver technical solutions aligned with business needs
  • Guarantee data accuracy and integrity through data quality checks and cleansing processes
  • Performance tuning of SQL queries and data processing scripts
  • Manage and optimize the data platform for cost and performance, including proactive monitoring and self-healing design patterns
  • Fulltime
Read More
Arrow Right

Data Engineer

The Data Engineer position in Dallas, Texas, requires a Bachelor’s or Master’s d...
Location
Location
United States , Dallas
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Education: Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or related field
  • Experience: Minimum 3–5 years of hands-on coding experience
  • ability to troubleshoot SQL and basic scripting
  • 3+ Years of Professional proficiency in Python or Java
  • 3+ Years of experience with SDLC, CI/CD best practices and Kubernetes (K8s) deployment experience
Job Responsibility
Job Responsibility
  • Engineer will be part of the datastore-migration Factory team responsible for end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
  • Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Executing the physical migration of underlying datasets while ensuring data integrity
  • Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners
  • Translating and optimizing legacy SQL and Spark-based consumption patterns for compatibility with Snowflake and Iceberg
  • Understanding usage patterns to deliver the required data products
  • Working on data reconciliation frameworks to ensure migrated data is functionally equivalent to production data
  • Working with internal data management platforms and learning new workflows and language constructs as necessary
  • Fulltime
Read More
Arrow Right

Data Engineer

Engineer will be part of the datastore-migration Factory team that will be respo...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
  • Ability to troubleshoot (SQL) and basic scripting experience
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices & K8s deployment experience
  • Sophisticated understanding of Temporal Data Modeling, Schema Management, Performance Optimization, Architectural Theory
  • Experience with Kafka, ANSI SQL, FTP, Apache Spark
  • Data formats JSON, Avro, Parquet
  • Platforms Hadoop (HDFS/Hive), Snowflake, Apache Iceberg, Sybase IQ
Job Responsibility
Job Responsibility
  • Pipeline migration
  • Logic & Scheduling refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Data Transfer executing the physical migration of underlying datasets while ensuring data integrity
  • Stakeholder Engagement acting as a technical liaison to internal clients, facilitating handoff and sign-off with data owners
  • Code Conversion translating and optimizing legacy SQL and Spark-based consumption patterns for compatibility with Snowflake and Iceberg
  • Usage analysis to deliver required data products
  • Data Reconciliation & Quality working with reconciliation frameworks to build confidence that migrated data is functionally equivalent
  • Working with other internal data management platform
  • Fulltime
Read More
Arrow Right

Data Engineer

The Data Engineer will play a crucial role in migrating data from on-prem DataLa...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
  • Ability to troubleshoot SQL and basic scripting experience
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices and K8s deployment experience
  • Sophisticated understanding of Temporal Data Modeling, Schema Management, Performance Optimization, Architectural Theory
  • Kafka, ANSI SQL, FTP, Apache Spark
  • JSON, Avro, Parquet
  • Hadoop (HDFS/Hive), Snowflake, Apache Iceberg, Sybase IQ
Job Responsibility
Job Responsibility
  • Perform end-to-end datastore migration from on-prem DataLake to AWS LakeHouse
  • Pipeline Migration including refactoring and migrating extraction logic and job scheduling
  • Data Transfer executing physical migration of underlying datasets while ensuring data integrity
  • Stakeholder Engagement acting as technical liaison to internal clients
  • Consumption Pattern Migration including code conversion translating and optimizing legacy SQL and Spark-based consumption patterns for Snowflake and Iceberg
  • Usage analysis to understand usage patterns and deliver required data products
  • Data Reconciliation and Quality working with reconciliation frameworks to ensure data equivalence
  • Work with internal data management platform and learn new workflows
  • Fulltime
Read More
Arrow Right

Data Engineer

Goldman Sachs is seeking a Data Engineer to join their datastore-migration Facto...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
  • Ability to trouble shoot (SQL) and basic scripting experience
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices & K8s deployment experience
  • Demonstrated understanding of Temporal Data Modeling (e.g., SCD Type 2)
  • Expertise in Schema Evolution (Ref: Iceberg Apache) and enforcement strategies
  • Advanced knowledge of data partitioning and clustering
  • Balancing Normalization vs. Denormalization and the strategic use of Natural vs. Surrogate Keys
  • Good conduct and ethical decision-making
Job Responsibility
Job Responsibility
  • Engineer will be part of the datastore-migration Factory team that will be responsible to perform for the end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
  • Pipeline Migration - Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Data Transfer - Executing the physical migration of underlying datasets while ensuring data integrity
  • Stakeholder Engagement - Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners to ensure migrated assets meet business requirements
  • Consumption Pattern Migration - Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg
  • Usage analysis: Understand usage patterns to deliver the required data products
  • Stakeholder Engagement - Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners to ensure migrated assets meet business requirements
  • Data Reconciliation & Quality - A rigorous approach to data validation is required
  • Candidates must work with reconciliation frameworks to build confidence that migrated data is functionally equivalent to that already used within production flows
  • Engineer will also need to work with our other internal data management platform, and must have an aptitude for learning new workflows and language constructs as necessary
  • Fulltime
Read More
Arrow Right