CrawlJobs Logo
Tier4 Group Logo Tier4 Group · IT - Software Development

Data Engineer

United States, Milwaukee · Job Posted April 11, 2026
Apply Position
Job Link Share

Job Description

We are seeking a Data Engineer to support cloud-based data solutions and AWS migration initiatives within HR workforce analytics. In this role, you will design, build, deploy, and maintain scalable data and software solutions across the full development lifecycle. You’ll partner closely with cross‑functional teams to solve complex technical challenges, influence architecture decisions, and continuously improve development and integration practices. This role requires strong experience with AWS, Python, Spark, SQL, modern data integration patterns, and DevOps methodologies, along with a passion for data quality, operational excellence, and production stability.

Job Responsibility

  • Design, develop, deploy, and support cloud-based applications using established SDLC and CI/CD practices
  • Troubleshoot and resolve technical issues during development and deployment
  • Conduct thorough code reviews to ensure quality, security, and adherence to best practices
  • Collaborate with engineers and stakeholders to align on technical approaches and architecture
  • Contribute to system‑wide technical and architectural discussions
  • Recommend improvements to development pipelines, tooling, and integration practices
  • Ensure high standards of data quality, reliability, and operational performance

Requirements

  • Bachelor’s degree or equivalent practical experience
  • 4+ years of professional experience working with AWS
  • 4+ years of experience with modern engineering tools, languages, and development practices
  • 2+ years of experience with data integration patterns and tooling, including: ETL / ELT, Event streaming and real‑time processing, Replication and virtualization
  • Strong coding experience in Python, Apache Spark, and SQL
  • Experience working in Agile and DevOps environments
  • Solid understanding of database concepts, data modeling, and data quality principles
  • Experience with cloud-based development (PaaS/SaaS), containerization (Docker and/or Kubernetes), Infrastructure as Code, and Terraform
  • Familiarity with centrally governed CI/CD pipelines
  • Understanding of automated testing practices, including unit testing and Test‑Driven Development
  • Strong communication skills with the ability to explain complex technical concepts to both technical and non‑technical audiences

Nice to have

  • Strong passion for operational excellence, ownership, and problem‑solving
  • Experience delivering reliable, high‑performance production systems
  • Ability to break down complex solutions into actionable work for agile teams
  • Experience refining features, defining solutions, and driving continuous improvement initiatives
  • 3–5 years of professional software development experience
  • 3–5+ years working with AWS services such as Lambda and Kubernetes
  • Proficiency in domain data modeling and API‑first design
  • Proven track record of designing and delivering impactful technology solutions

What we offer

Benefits, free daily lunch when onsite

Tier4 Group - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

Data Engineer

The Data Engineer position in Dallas, Texas, requires a Bachelor’s or Master’s d...
Location
Location
United States , Dallas
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Education: Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or related field
  • Experience: Minimum 3–5 years of hands-on coding experience
  • ability to troubleshoot SQL and basic scripting
  • 3+ Years of Professional proficiency in Python or Java
  • 3+ Years of experience with SDLC, CI/CD best practices and Kubernetes (K8s) deployment experience
Job Responsibility
Job Responsibility
  • Engineer will be part of the datastore-migration Factory team responsible for end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
  • Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Executing the physical migration of underlying datasets while ensuring data integrity
  • Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners
  • Translating and optimizing legacy SQL and Spark-based consumption patterns for compatibility with Snowflake and Iceberg
  • Understanding usage patterns to deliver the required data products
  • Working on data reconciliation frameworks to ensure migrated data is functionally equivalent to production data
  • Working with internal data management platforms and learning new workflows and language constructs as necessary
  • Fulltime
Read More
Arrow Right

Data Engineer

Engineer will be part of the datastore-migration Factory team that will be respo...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
  • Ability to troubleshoot (SQL) and basic scripting experience
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices & K8s deployment experience
  • Sophisticated understanding of Temporal Data Modeling, Schema Management, Performance Optimization, Architectural Theory
  • Experience with Kafka, ANSI SQL, FTP, Apache Spark
  • Data formats JSON, Avro, Parquet
  • Platforms Hadoop (HDFS/Hive), Snowflake, Apache Iceberg, Sybase IQ
Job Responsibility
Job Responsibility
  • Pipeline migration
  • Logic & Scheduling refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Data Transfer executing the physical migration of underlying datasets while ensuring data integrity
  • Stakeholder Engagement acting as a technical liaison to internal clients, facilitating handoff and sign-off with data owners
  • Code Conversion translating and optimizing legacy SQL and Spark-based consumption patterns for compatibility with Snowflake and Iceberg
  • Usage analysis to deliver required data products
  • Data Reconciliation & Quality working with reconciliation frameworks to build confidence that migrated data is functionally equivalent
  • Working with other internal data management platform
  • Fulltime
Read More
Arrow Right

Data Engineer

The Data Engineer will play a crucial role in migrating data from on-prem DataLa...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
  • Ability to troubleshoot SQL and basic scripting experience
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices and K8s deployment experience
  • Sophisticated understanding of Temporal Data Modeling, Schema Management, Performance Optimization, Architectural Theory
  • Kafka, ANSI SQL, FTP, Apache Spark
  • JSON, Avro, Parquet
  • Hadoop (HDFS/Hive), Snowflake, Apache Iceberg, Sybase IQ
Job Responsibility
Job Responsibility
  • Perform end-to-end datastore migration from on-prem DataLake to AWS LakeHouse
  • Pipeline Migration including refactoring and migrating extraction logic and job scheduling
  • Data Transfer executing physical migration of underlying datasets while ensuring data integrity
  • Stakeholder Engagement acting as technical liaison to internal clients
  • Consumption Pattern Migration including code conversion translating and optimizing legacy SQL and Spark-based consumption patterns for Snowflake and Iceberg
  • Usage analysis to understand usage patterns and deliver required data products
  • Data Reconciliation and Quality working with reconciliation frameworks to ensure data equivalence
  • Work with internal data management platform and learn new workflows
  • Fulltime
Read More
Arrow Right

Data Engineer

Goldman Sachs is seeking a Data Engineer to join their datastore-migration Facto...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Applied Mathematics, Engineering, or a related quantitative field
  • Minimum of 3-5 years of professional hands-on-keyboard coding experience in a collaborative, team-based environment
  • Ability to trouble shoot (SQL) and basic scripting experience
  • Professional proficiency in Python or Java
  • Deep familiarity with the full Software Development Life Cycle (SDLC) and CI/CD best practices & K8s deployment experience
  • Demonstrated understanding of Temporal Data Modeling (e.g., SCD Type 2)
  • Expertise in Schema Evolution (Ref: Iceberg Apache) and enforcement strategies
  • Advanced knowledge of data partitioning and clustering
  • Balancing Normalization vs. Denormalization and the strategic use of Natural vs. Surrogate Keys
  • Good conduct and ethical decision-making
Job Responsibility
Job Responsibility
  • Engineer will be part of the datastore-migration Factory team that will be responsible to perform for the end-to-end datastore migration from on-prem DataLake to AWS hosted LakeHouse
  • Pipeline Migration - Refactoring and migrating extraction logic and job scheduling from legacy frameworks to the new Lakehouse environment
  • Data Transfer - Executing the physical migration of underlying datasets while ensuring data integrity
  • Stakeholder Engagement - Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners to ensure migrated assets meet business requirements
  • Consumption Pattern Migration - Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with Snowflake and Iceberg
  • Usage analysis: Understand usage patterns to deliver the required data products
  • Stakeholder Engagement - Acting as a technical liaison to internal clients, facilitating handoff and sign-off conversations with data owners to ensure migrated assets meet business requirements
  • Data Reconciliation & Quality - A rigorous approach to data validation is required
  • Candidates must work with reconciliation frameworks to build confidence that migrated data is functionally equivalent to that already used within production flows
  • Engineer will also need to work with our other internal data management platform, and must have an aptitude for learning new workflows and language constructs as necessary
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer with 8-12 years of experience to design and b...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8–12 years of experience in Data Engineering
  • Strong hands on expertise in Python and SQL (Snowflake preferred)
  • Experience with REST APIs / data service integrations
  • Working knowledge of AI/ML systems, Agentic AI frameworks
Job Responsibility
Job Responsibility
  • Build and maintain scalable data pipelines using Python and SQL
  • Enable AI/ML and GenAI use cases, including data preparation and feature pipelines
  • Ensure data quality, reliability, security, and observability
  • Fulltime
Read More
Arrow Right

Data Engineer

As our new Data Engineer, you will join a collaborative and skilled organization...
Location
Location
Poland , Katowice
Salary
Salary:
Not provided
vattenfall.com Logo
Vattenfall
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong Python and SQL skills
  • Practical experience with cloud data platforms (Azure, Databricks) and with different data storage solutions, including data lakes, lake houses and analytical databases
  • Hands-on experience with streaming systems (Kafka, Spark or Flink)
  • Familiarity with Airflow, CI/CD, DevOps practices
  • Experience with Docker, Kubernetes, and Infrastructure-as-Code
  • Understanding of data contracts, time-series data, and event-driven systems
  • Fluency in English and interest in the energy domain
Job Responsibility
Job Responsibility
  • Design, build, and operate batch and real-time data pipelines using Azure, Databricks, and Python
  • Ingest and process external and internal data such as weather data, market prices, grid telemetry, and event streams
  • Work with streaming technologies including Kafka, Spark Structured Streaming, and Flink
  • Ensure high data quality through validation, monitoring, and lineage
  • Develop and improve data workflows, standards, and reliability in production systems
What we offer
What we offer
  • Good remuneration
  • challenging and international work environment
  • possibility to work with some of the best in the field
  • opportunities for personal and professional development
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for a Data Engineer to join a team focused on building reliable, ...
Location
Location
United States , Camden
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience with Azure Data Factory, Azure Databricks, and Azure Data Lake in a data engineering environment
  • Strong programming ability in Python and PySpark for large-scale data processing and transformation
  • Proficiency in SQL, including writing and optimizing queries for analytics and data integration workloads
  • Experience building and maintaining ETL or ELT pipelines that combine data from multiple structured and semi-structured sources
  • Familiarity with data modeling concepts, curated dataset design, and preparation of data for BI or analytics consumption
  • Understanding of data governance, lineage, and security practices within modern cloud data platforms
  • Experience using GitHub or similar tools for source control, code review, and deployment automation
  • Ability to communicate effectively with business partners and translate functional needs into scalable technical solutions
Job Responsibility
Job Responsibility
  • Create and support scalable data ingestion and transformation workflows using Azure Data Factory, Databricks, and PySpark
  • Connect and consolidate data from enterprise platforms, operational databases, telematics feeds, APIs, and other internal or external sources
  • Structure and manage data within Azure Data Lake and lakehouse environments to support performance, accessibility, and long-term maintainability
  • Design curated datasets, data models, and schemas that improve usability for analytics, business intelligence, and downstream reporting
  • Apply governance and lineage practices through Unity Catalog while promoting strong data quality, consistency, and security standards
  • Work with business stakeholders and cross-functional teams to gather requirements, define technical specifications, and deliver data solutions aligned with operational needs
  • Improve pipeline stability and efficiency by troubleshooting failures, resolving performance issues, and refining storage and query strategies
  • Support Power BI reporting by preparing datasets, assisting with model improvements, and helping maintain reporting standards and governance practices
  • Use GitHub-based development practices for version control, peer review, CI/CD, and disciplined deployment processes
  • Mentor less-experienced engineers and contribute to a collaborative environment focused on continuous improvement and dependable delivery
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • enrollment in company 401(k) plan
  • Fulltime
Read More
Arrow Right

Data Engineer

We are looking for an experienced Data Engineer to design and support data excha...
Location
Location
United States , Asheboro
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working in a manufacturing environment
  • 7+ years of experience in data engineering, data integration, or ETL-focused roles
  • Proven background working with data transformation, analytics, and system-to-system integrations using APIs, EDI, X12, XML, or similar structured formats
  • Hands-on experience with SQL in support of data movement, validation, and troubleshooting
  • Familiarity with database platforms such as SQL Server and Oracle, including querying and supporting downstream BI solutions
  • Understanding of supply chain operations within a manufacturing environment, with the ability to map business events into technical data processes
  • Experience using Microsoft Excel for data analysis, validation, or reconciliation tasks
Job Responsibility
Job Responsibility
  • Build and maintain business-to-business data interfaces that onboard new partner organizations and align incoming data with internal database structures
  • Develop automated workflows that ingest, transform, validate, and deliver data using file-based exchanges, APIs, and structured transaction formats such as EDI and X12
  • Configure and manage end-to-end integration processes across system interfaces, including flat-file handling, file sharing, and reporting-related data movement
  • Lead data transformation efforts through the full lifecycle by designing solutions, testing functionality, deploying processes, and stabilizing production performance
  • Investigate integration failures or data quality issues, identify root causes, and implement corrective actions to restore reliable processing
  • Partner with business intelligence and reporting teams to provide access to accurate, usable data sources that support analysis and operational decision-making
  • Apply manufacturing and supply chain process knowledge to structure data flows that support purchasing, components, orders, and assembly-related transactions
  • Use available tools and platforms to execute integration projects independently, including extracting data from enterprise applications and translating it into usable formats
  • Create scalable data pipelines that enable customer and order transactions to move through systems with minimal manual intervention
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • enrollment in company 401(k) plan
  • Fulltime
Read More
Arrow Right