CrawlJobs Logo
Robert Half Logo Robert Half · IT - Software Development

Data Engineer

United States, Philadelphia Employment contract · Job Posted June 10, 2026
Apply Position
Job Link Share

Job Description

We are looking for a Data Engineer to support the development and operation of a modern, microservices-based IoT platform. This role focuses on building and maintaining DevOps tools, frameworks, and best practices that enable engineering teams to efficiently develop, deploy, and manage scalable cloud-native applications.

Job Responsibility

  • Design, build, and manage DevOps tools, processes, and technologies supporting the IoT platform lifecycle
  • Develop and maintain horizontal frameworks and tooling to enable engineering teams to build, test, release, and monitor microservices-based applications
  • Establish and implement best practices for source control, CI/CD pipelines, performance optimization, SLAs, security, audit, and monitoring
  • Define and build reusable frameworks and software libraries to support scalable and highly available microservices architectures
  • Troubleshoot platform issues and drive continuous improvements in quality, performance, and security
  • Partner with architects, product managers, and engineering teams to translate system and product requirements into technical solutions
  • Support and enhance cloud infrastructure and system architecture in AWS environments
  • Work within Agile teams to deliver incremental, high-quality software solutions

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or related field
  • 8+ years of hands-on experience in software engineering with a focus on cloud-based systems
  • Strong programming expertise in Java (required), with additional experience in Python
  • Proven experience building and supporting cloud-based services (SaaS) and platforms (PaaS)
  • Deep hands-on experience with AWS, including services such as EC2, S3, DynamoDB, RDS, Lambda, API Gateway, and Fargate
  • Strong background in microservices architecture and distributed systems design
  • Experience designing for scalability, high availability, and performance
  • Experience implementing CI/CD pipelines and DevOps best practices
  • Knowledge of security, audit, and reliability frameworks (latency, uptime, scalability)
  • Experience with relational and NoSQL databases
  • Solid understanding of network architecture and security principles
  • Experience working in Agile development environments

Nice to have

  • Master’s degree in Computer Science or related field
  • Experience with Golang or JavaScript (Node.js)
  • Expertise in developing shared frameworks and internal developer platforms
  • Experience supporting large-scale IoT or distributed platform ecosystems
  • Familiarity with advanced observability, monitoring, and logging tools
  • Strong experience implementing enterprise-grade security and compliance standards
  • Proven ability to influence engineering practices across multiple teams
  • Excellent communication and collaboration skills with both technical and non-technical stakeholders

What we offer

  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training
Robert Half - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

At Schwab, you’re empowered to make an impact on your career. Here, innovative t...
Location
Location
United States , Austin
Salary
Salary:
90000.00 - 145000.00 USD / Year
schwab.com Logo
Charles Schwab
Expiration Date
June 15, 2026
Flip Icon
Requirements
Requirements
  • Bachelors’ degree in Engineering/Technology
  • 8+ years of professional experience in development, support, and maintenance of ETL and database applications
  • Deep understanding of Data Warehousing and Data Modeling concepts
  • 3+ years of hands-on experience with Informatica’s Intelligent Data Management Cloud(IDMC)/Informatica Intelligent Cloud Services (IICS)
  • 2+years of hands-on experience with GCP technologies (GCS, BigQuery, Dataproc)
  • 1+years of experience with Control M
  • Strong SQL Knowledge
  • Experience with Shell, Python, PERL and other scripting languages
  • Familiar and comfortable with agile development techniques
  • Familiarity with SCM and DevOps tool suites and CI/CD best practices
Job Responsibility
Job Responsibility
  • Creation and maintenance of enterprise data assets, reporting, and data analytics that support business leaders in decision making, regulatory reporting, and continuous process improvement
  • Working closely with business and other stakeholders to understand the needs and implementation
  • Planning, estimation, scheduling, prioritization, and coordination of technical activities related to system development
  • Performing ETL design, development, data management and data analysis
  • Creating data model, performance tuning, load plan etc. Making sure that deliverables fulfill both functional and non-functional requirements
  • Provide guidance and technical oversight to junior engineers and vendor contractors, ensuring high-quality execution and fostering professional growth within the team
  • Engaging with both onshore and offshore teams to ensure the timely delivery of high-quality data engineering solutions
  • Ensuring system alignment to Architecture policies and best practices
  • ensure that process methodologies are followed in system development
  • Identifying opportunities for system reuse and system simplification
What we offer
What we offer
  • 401(k) with company match and Employee stock purchase plan
  • Paid time for vacation, volunteering, and 28-day sabbatical after every 5 years of service for eligible positions
  • Paid parental leave and family building benefits
  • Tuition reimbursement
  • Health, dental, and vision insurance
  • Bonus or incentive opportunities
  • Fulltime
!
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays, responsible for supporting the successfu...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in ETL / data processing / data warehousing / data engineering / RDBMS / PySpark
  • Experience in Data Processing and ETL in On-prem and Cloud based systems
  • Preferred AWS cloud development, with a strong understanding of AWS services (e.g., EC2, S3, Lambda, RDS, DynamoDB, etc.)
  • Proficient in at least one Python programming language
  • Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform etc.
  • Experience with CI/CD tools and pipelines (Jenkins, GitLab CI, etc.) for automation and deployment
  • Good understanding of cloud security best practices and experience with IAM, VPC, security groups, and encryption mechanisms
  • Good knowledge of monitoring, logging, and troubleshooting tools (e.g., CloudWatch, CloudTrail)
  • Experience with version control systems (Git, GitHub, Bitbucket)
  • Strong communication skills and ability to work in a collaborative team environment
Job Responsibility
Job Responsibility
  • supporting the successful delivery of location strategy projects to plan, budget, agreed quality and governance standards
  • spearhead the evolution of our digital landscape, driving innovation and excellence
  • harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer responsible for supporting the successful delivery of...
Location
Location
India , Pune
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands on experience in pyspark and strong knowledge on Dataframes, RDD and SparkSQL
  • Hands on Experience in developing, testing and maintaining applications on AWS Cloud
  • Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena)
  • Design and implement scalable and efficient data transformation/storage solutions using Snowflake
  • Experience in Data ingestion to Snowflake for different storage format such Parquet, Iceberg, JSON, CSV etc
  • Experience in using DBT (Data Build Tool) with snowflake for ELT pipeline development
  • Experience in Writing advanced SQL and PL SQL programs
  • Hands On Experience for building reusable components using Snowflake and AWS Tools/Technology
  • Should have worked at least on two major project implementations
  • Ability to engage with Stakeholders, elicit requirements/ user stories and translate requirements into ETL components
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays where you will spearhead the evolution of...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience in developing complex/medium/easy datasets using SQL tools (SQL/Snowflake)
  • Solid working knowledge of writing SQL queries
  • Working Knowledge on scripts (.bteq ) in Unix/ linux environments.
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models.
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness
  • Wellness rooms
  • gyms and mental health support
  • Collaborative areas
  • Access to on-site cafeterias, fitness centers, and tech-equipped workstations
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a Data Engineer to design and build scalable data pipelines and p...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience in cloud environments (AWS and/or Azure)
  • Hands‑on experience with Databricks, Apache Spark, and Delta Lake
  • Strong skills in Python / PySpark and SQL
  • Experience with data pipelines, ETL/ELT, and data modeling
  • Familiarity with orchestration tools (Airflow or similar) and modern data architectures
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines using Databricks, Spark, and cloud-native services
  • Develop and optimize ETL/ELT workflows for batch and streaming data across AWS and Azure environments
  • Build and manage data models, data lakes, and warehousing solutions for analytics and AI use cases
  • Ensure data quality, reliability, and governance across the data lifecycle
  • Collaborate with data science, analytics, and platform teams to deliver data solutions
Read More
Arrow Right
New

Data Engineer

We are seeking a skilled Data Engineer with strong experience in ETL development...
Location
Location
United States , Fort Lauderdale
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field, or equivalent experience
  • 3+ years of experience in data engineering or ETL development
  • Strong hands-on experience with Snowflake
  • Proficiency in Python for data processing and automation
  • Experience developing and supporting ETL/ELT workflows
  • Strong SQL skills and experience with relational databases
  • Familiarity with cloud data platforms and modern data warehouse architecture
  • Experience with data integration, transformation, and orchestration tools
  • Strong analytical, troubleshooting, and communication skills
Job Responsibility
Job Responsibility
  • Design, develop, and maintain robust ETL/ELT pipelines for ingesting, transforming, and loading data from multiple sources
  • Build and optimize data solutions within Snowflake
  • Develop reusable scripts and workflows using Python
  • Integrate data from APIs, databases, flat files, and third-party platforms
  • Monitor, troubleshoot, and enhance data pipeline performance, reliability, and scalability
  • Collaborate with analytics, engineering, and business teams to understand data requirements
  • Ensure data quality, integrity, governance, and security across platforms
  • Support data modeling, warehouse design, and performance tuning
  • Document technical designs, workflows, and operational processes
  • Participate in code reviews, testing, and deployment activities
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to support and enhance critical data operatio...
Location
Location
United States , Greenville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience working in data engineering or data platform operations roles
  • Strong hands-on knowledge of Python for scripting, automation, and operational support
  • Experience managing or supporting Apache Kafka environments and related streaming data workflows
  • Familiarity with Snowflake administration, performance tuning, and resource management
  • Solid understanding of ETL processes, including data ingestion, transformation, and delivery concepts
  • Experience working with AWS services in support of modern data infrastructure
  • Knowledge of Terraform or similar infrastructure-as-code tools for environment management and automation
Job Responsibility
Job Responsibility
  • Oversee the health and performance of data pipelines that run across Snowflake, Kafka, and connected platforms
  • Investigate operational issues affecting data ingestion, transformation, or downstream delivery and drive timely resolution
  • Maintain stable batch and streaming processes by improving resiliency, uptime, and overall execution efficiency
  • Administer Snowflake resources, including warehouses, databases, permissions, and usage optimization
  • Manage Kafka infrastructure by tuning clusters, topics, partitions, and consumer group behavior for reliable throughput
  • Create and maintain automated solutions for deployment, monitoring, failure recovery, and routine workflow support
  • Develop operational scripts and utilities using Python, Bash, and related tools to reduce manual effort and improve consistency
  • Contribute to CI/CD practices that strengthen the release and maintenance process for data infrastructure
  • Partner with engineering and analytics teams to improve pipeline design, data performance, and delivery accuracy
  • Support data governance, security, compliance, and data quality standards through validation checks and alerting frameworks
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are seeking a Data Engineer to design and build scalable data pipelines and p...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience in cloud environments (AWS and/or Azure)
  • Hands‑on experience with Databricks, Apache Spark, and Delta Lake
  • Strong skills in Python / PySpark and SQL
  • Experience with data pipelines, ETL/ELT, and data modeling
  • Familiarity with orchestration tools (Airflow or similar) and modern data architectures
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines using Databricks, Spark, and cloud-native services
  • Develop and optimize ETL/ELT workflows for batch and streaming data across AWS and Azure environments
  • Build and manage data models, data lakes, and warehousing solutions for analytics and AI use cases
  • Ensure data quality, reliability, and governance across the data lifecycle
  • Collaborate with data science, analytics, and platform teams to deliver data solutions
  • Fulltime
Read More
Arrow Right