CrawlJobs Logo

Data Engineer

United States, New York · Job Posted March 13, 2026
Apply Position
Job Link Share

Job Description

We are looking for an experienced Data Engineer to join our team in New York, New York. In this role, you will design, build, and maintain data infrastructure to support business intelligence and analytics needs. The ideal candidate will have a strong technical background, a passion for working with complex datasets, and expertise in cloud-based data platforms.

Job Responsibility

  • Develop, implement, and optimize ETL pipelines to ensure efficient data processing and integration
  • Design and maintain scalable data solutions, including data warehouses and data lakes
  • Collaborate with cross-functional teams to identify data requirements and deliver actionable insights
  • Utilize Snowflake, AWS, and other cloud-based platforms to manage data infrastructure and ensure performance optimization
  • Leverage Python and SQL to build robust data workflows and automate processes
  • Employ orchestration tools like Airflow and dbt to streamline data operations
  • Support data analytics and visualization efforts by enabling the creation of impactful dashboards using tools such as Tableau
  • Work with marketing and product data sources, including platforms like Google Analytics, to extract and integrate valuable insights
  • Implement CI/CD pipelines and DevOps practices to enhance data engineering processes
  • Ensure data security and compliance across all systems and tools

Requirements

  • At least 7 years of experience in data engineering or analytics-related roles
  • Advanced proficiency in Python programming and SQL query development
  • Strong hands-on experience with Snowflake or BigQuery, including expertise in data modeling and optimization
  • Familiarity with orchestration tools such as Airflow and data integration frameworks like dbt
  • Proven experience working with AWS services, including S3, Lambda, and Batch
  • Knowledge of data visualization tools, particularly Tableau, and ability to support dashboard development
  • Experience with CI/CD pipelines and DevOps practices for data engineering
  • Understanding of marketing and product data sources, including Google Analytics and similar platforms

What we offer

  • medical, vision, dental, and life and disability insurance
  • company 401(k) plan
  • free online training

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

Seeking a Data Engineer to build and optimize scalable data pipelines and platfo...
Location
Location
United States , Atlanta, GA
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Platforms: Apache Spark (DataFrames, SQL, RDDs, streaming, tuning, Catalyst/Tungsten)
  • Delta Lake (ACID, MERGE, OPTIMIZE, Z-ORDER, CDC, time travel)
  • Databricks SQL (queries, views, UDFs)
  • Delta Live Tables (DLT), Jobs, Workflows
  • Architecture & Ingestion: Lakehouse (Medallion, partitioning, clustering, data contracts)
  • Auto Loader / Lakeflow (batch & streaming ingestion, CDC)
  • Unity Catalog (governance, access control)
  • Core Data Engineering: Advanced SQL & data modeling (dimensional, Data Vault)
  • ETL/ELT pipelines
  • Data quality & monitoring
Job Responsibility
Job Responsibility
  • Build ETL/ELT pipelines (batch & streaming)
  • Design scalable data architectures (Lakehouse, warehouse)
  • Ensure data quality, governance, and security
  • Optimize performance, cost, and reliability
  • Partner with analytics, BI, and engineering teams
What we offer
What we offer
  • Competitive compensation and benefits
  • Free online training
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for an experienced Data Engineer to join a long-term contract eng...
Location
Location
United States , Centennial
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in data engineering or a closely related technical field
  • Strong programming ability in Python and solid experience developing enterprise-grade ETL and data integration solutions
  • Hands-on expertise with Microsoft Fabric and practical experience working with Synapse Analytics and Azure Data Factory
  • Proven experience using Databricks to build, manage, and optimize large-scale data processing solutions
  • Strong understanding of cloud-based data engineering principles, including pipeline design, orchestration, and performance tuning
  • Experience working with large datasets and distributed processing technologies such as Apache Spark or PySpark
  • Familiarity with modern data platforms and architectures, including lakehouse, data warehouse, or hybrid cloud data environments
Job Responsibility
Job Responsibility
  • Design, develop, and enhance scalable data pipelines to support enterprise reporting, analytics, and AI use cases
  • Transform, cleanse, and organize complex data from multiple sources so it can be used effectively by downstream engineering and machine learning teams
  • Build and maintain robust data workflows in a cloud-based ecosystem using Microsoft Fabric, Synapse Analytics, Azure Data Factory, and Databricks
  • Collaborate with data engineers, ML engineers, and other technical stakeholders to create efficient and dependable data architecture
  • Monitor pipeline performance and resolve issues related to data quality, reliability, and processing efficiency across platforms
  • Orchestrate data ingestion, movement, and transformation processes for large-volume datasets in a backend-focused engineering environment
  • Support AI and machine learning initiatives by delivering well-structured datasets optimized for model development and operational use
  • Contribute to scalable lakehouse or warehouse-oriented data solutions while helping align engineering practices with cloud data best practices
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • enrollment in company 401(k) plan
Read More
Arrow Right
New

Data Engineer

The Data Engineer is accountable for developing high quality data products to su...
Location
Location
United States , Irving
Salary
Salary:
96400.00 - 144600.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
June 20, 2026
Flip Icon
Requirements
Requirements
  • 4+ years experience implementing data-intensive solutions using agile methodologies
  • Experience of modelling data for analytical consumers
  • Hands on Mantas expert throughout the full development life cycle, including: requirements analysis, functional design, technical design, programming, testing, documentation, implementation, and on-going technical support
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • ETL: Hands on experiencing in building data pipelines using Apache Spark
  • Big Data: Hands on experience of working on 'Big Data' platforms such as Hadoop, Hive or Snowflake for data storage and processing
  • Data Warehousing & Database Management: Understanding of Data Warehousing concepts, Relational (Oracle, MSSQL, MySQL) and NoSQL (MongoDB, DynamoDB) database design
  • Data Modeling & Design: Good exposure to data modeling techniques
Job Responsibility
Job Responsibility
  • Developing and supporting scalable, extensible, and highly available data solutions
  • Deliver on critical business priorities while ensuring alignment with the wider architectural vision
  • Identify and help address potential risks in the data supply chain
  • Follow and contribute to technical standards
  • Design and develop analytical data models
  • Considers the business implications of the application of technology to the current business environment
  • identifies and communicates risks and impacts
  • Drives communication between business leaders and IT
  • exhibits sound and comprehensive communication and diplomacy skills to exchange complex information
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
!
Read More
Arrow Right
New

Data Engineer

Be a part of a place where challenges are measured in billions, qubits and nanos...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineering & ETL Development: Strong hands-on experience in ETL development, data transformation, and end-to-end pipeline workflows (ingestion → processing → consumption) including structured dataset creation and analytics outputs
  • SQL, Data Modelling & Data Warehousing: Solid database and querying skills with expertise in SQL, joins, and large-scale data modelling for warehouse-style analytics and dataset integration
  • Data Integration & Distributed Systems: Experience integrating multiple enterprise data sources including API/feed handling and working with distributed data environments
  • Cloud & Data Lake Fundamentals: Exposure to AWS, data lake architectures, and catalogue-based querying environments, supporting scalable data processing
  • Data Quality, Testing & Debugging: Strong capability in debugging pipelines, resolving data issues, validating datasets, and working with data quality frameworks and controls
  • Financial Data Domain & Collaboration: Understanding of financial datasets with ability to collaborate across teams and stakeholders to deliver data solutions
Job Responsibility
Job Responsibility
  • Delivering a set of enterprise, non-negotiable data strategy outcomes across the end-to-end lifecycle
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Location
Location
United Kingdom , Edinburgh
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A basic understanding of IT systems, including operating systems, networks, databases, and cloud fundamentals
  • Experience using scripting languages such as Python, PowerShell, Bash or Groovy to support automation and problem-solving
  • Exposure to troubleshooting approaches, including working with logs, error messages, and monitoring tools, and the ability to break down technical issues and identify possible causes
Job Responsibility
Job Responsibility
  • Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
  • Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
  • Development of processing and analysis algorithms fit for the intended data complexity and volumes
  • Collaboration with data scientist to build and deploy machine learning models
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to join a growing financial services organiza...
Location
Location
United States , Chicago
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7-8 years of experience in data engineering or a closely related field
  • Strong hands-on background in building and supporting ETL or data pipeline solutions
  • Proven experience working with Snowflake in a production environment
  • Proficiency in Python for scripting, automation, and data processing tasks
  • Familiarity with modern cloud platforms
  • Experience with data ingestion technologies such as Fivetran or similar platforms
  • Ability to work through imperfect or incomplete data while communicating clearly with technical and business partners
Job Responsibility
Job Responsibility
  • Design and support data workflows that collect, refine, and deliver information across a contemporary cloud ecosystem
  • Develop and enhance scalable data pipelines using Python and automated ingestion platforms such as Fivetran or comparable tools
  • Model and transform datasets within Snowflake to enable reliable analytics and downstream business intelligence reporting
  • Collaborate closely with the data architect to expand and improve the organization’s overall data infrastructure
  • Contribute to reporting readiness by preparing curated datasets for visualization tools including Power BI and Sigma
  • Monitor pipeline performance and resolve data issues to maintain accuracy, consistency, and dependable delivery
  • Assess emerging technologies and recommend practical additions to the data stack as business needs evolve
  • Work effectively in a fast-paced team environment where priorities can shift and new tooling may be introduced regularly
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right
New

Data Engineer

We believe in the power of ingenuity to build a positive human future. We challe...
Location
Location
United Kingdom , Belfast
Salary
Salary:
Not provided
paconsulting.com Logo
PA Consulting
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You thrive in problem-solving and analytical thinking
  • You enjoy collaborating with multiple stakeholders in a fast-paced environment
  • Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL
  • Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc
  • Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native or custom programming
  • Be a British citizen or have been resident in the UK for the past 5 years
Job Responsibility
Job Responsibility
  • Work to agile best practices and cross-functionally with multiple teams and stakeholders
  • Use technical skills to problem solve with clients, as well as working on internal projects
  • Live in-person whiteboarding sessions to problem solve as a team, alongside asynchronous communication on Teams
  • Work alongside colleagues from across PA delivering transformative digital solutions
  • Design and build for the AWS cloud
What we offer
What we offer
  • Private healthcare for you and your family
  • 25 days annual leave (plus a bonus half day on Christmas Eve) with the opportunity to buy 5 additional days
  • Generous company pension scheme
  • Opportunity to get involved with community and charity-based initiatives
  • Annual performance-based bonus
  • PA share ownership
  • Tax efficient benefits (cycle to work, give as you earn)
  • Fulltime
Read More
Arrow Right

Data Engineer

Robert Half is seeking a Contract Data Engineer to support our client's data and...
Location
Location
United States , Nashville
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a Data Engineer or in a similar role
  • Strong proficiency in SQL and Python (or similar languages)
  • Experience with cloud platforms (AWS, Azure, GCP)
  • Hands-on experience with ETL / ELT tools (Airflow, dbt, Fivetran, Matillion, Glue, ADF, etc.)
  • Experience with data warehousing platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Familiarity with streaming and big data tools (Kafka, Spark, Databricks, Hadoop) is a plus
  • Strong understanding of data modeling, performance tuning, and pipeline optimization
  • Experience with version control systems (Git) and agile development practices
  • Excellent problem-solving, analytical, and communication skills
Job Responsibility
Job Responsibility
  • Data Pipeline Development: Design, build, and maintain scalable ETL / ELT pipelines to ingest, transform, and deliver data from multiple sources
  • Data Architecture: Develop and optimize data models, schemas, and warehouse structures to support analytics, reporting, and business intelligence needs
  • Cloud Data Platforms: Work within cloud environments such as AWS, Azure, or GCP to deploy and manage data solutions
  • Data Warehousing: Design and support enterprise data warehouses using platforms such as Snowflake, Redshift, BigQuery, or Azure Synapse
  • Big Data Processing: Develop solutions using big data technologies such as Spark, Databricks, Kafka, and Hadoop when required
  • Performance Optimization: Tune queries, pipelines, and storage solutions for performance, scalability, and cost efficiency
  • Data Quality & Reliability: Implement monitoring, validation, and alerting processes to ensure data accuracy, integrity, and availability
  • Collaboration: Work closely with Data Analysts, Data Scientists, Software Engineers, and business stakeholders to understand requirements and deliver data solutions
  • Documentation: Maintain detailed documentation for pipelines, data flows, and system architecture
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right