Data Engineer Job at Junction

Data Engineer

We are looking for a Data Engineer to join a team focused on building reliable, ...

Location

United States , Camden

Salary:

Not provided

Robert Half

Expiration Date

Until further notice

Requirements

Hands-on experience with Azure Data Factory, Azure Databricks, and Azure Data Lake in a data engineering environment
Strong programming ability in Python and PySpark for large-scale data processing and transformation
Proficiency in SQL, including writing and optimizing queries for analytics and data integration workloads
Experience building and maintaining ETL or ELT pipelines that combine data from multiple structured and semi-structured sources
Familiarity with data modeling concepts, curated dataset design, and preparation of data for BI or analytics consumption
Understanding of data governance, lineage, and security practices within modern cloud data platforms
Experience using GitHub or similar tools for source control, code review, and deployment automation
Ability to communicate effectively with business partners and translate functional needs into scalable technical solutions

Job Responsibility

Create and support scalable data ingestion and transformation workflows using Azure Data Factory, Databricks, and PySpark
Connect and consolidate data from enterprise platforms, operational databases, telematics feeds, APIs, and other internal or external sources
Structure and manage data within Azure Data Lake and lakehouse environments to support performance, accessibility, and long-term maintainability
Design curated datasets, data models, and schemas that improve usability for analytics, business intelligence, and downstream reporting
Apply governance and lineage practices through Unity Catalog while promoting strong data quality, consistency, and security standards
Work with business stakeholders and cross-functional teams to gather requirements, define technical specifications, and deliver data solutions aligned with operational needs
Improve pipeline stability and efficiency by troubleshooting failures, resolving performance issues, and refining storage and query strategies
Support Power BI reporting by preparing datasets, assisting with model improvements, and helping maintain reporting standards and governance practices
Use GitHub-based development practices for version control, peer review, CI/CD, and disciplined deployment processes
Mentor less-experienced engineers and contribute to a collaborative environment focused on continuous improvement and dependable delivery

What we offer

Medical, vision, dental, and life and disability insurance
enrollment in company 401(k) plan

Fulltime

Data Engineer

We are looking for an experienced Data Engineer to design and support data excha...

Location

United States , Asheboro

Salary:

Not provided

Robert Half

Expiration Date

Until further notice

Requirements

Experience working in a manufacturing environment
7+ years of experience in data engineering, data integration, or ETL-focused roles
Proven background working with data transformation, analytics, and system-to-system integrations using APIs, EDI, X12, XML, or similar structured formats
Hands-on experience with SQL in support of data movement, validation, and troubleshooting
Familiarity with database platforms such as SQL Server and Oracle, including querying and supporting downstream BI solutions
Understanding of supply chain operations within a manufacturing environment, with the ability to map business events into technical data processes
Experience using Microsoft Excel for data analysis, validation, or reconciliation tasks

Job Responsibility

Build and maintain business-to-business data interfaces that onboard new partner organizations and align incoming data with internal database structures
Develop automated workflows that ingest, transform, validate, and deliver data using file-based exchanges, APIs, and structured transaction formats such as EDI and X12
Configure and manage end-to-end integration processes across system interfaces, including flat-file handling, file sharing, and reporting-related data movement
Lead data transformation efforts through the full lifecycle by designing solutions, testing functionality, deploying processes, and stabilizing production performance
Investigate integration failures or data quality issues, identify root causes, and implement corrective actions to restore reliable processing
Partner with business intelligence and reporting teams to provide access to accurate, usable data sources that support analysis and operational decision-making
Apply manufacturing and supply chain process knowledge to structure data flows that support purchasing, components, orders, and assembly-related transactions
Use available tools and platforms to execute integration projects independently, including extracting data from enterprise applications and translating it into usable formats
Create scalable data pipelines that enable customer and order transactions to move through systems with minimal manual intervention

What we offer

Medical, vision, dental, and life and disability insurance
enrollment in company 401(k) plan

Fulltime

Data Engineer

Join us as a Data Engineer at Barclays, where you will spearhead the evolution o...

Location

India , Pune

Salary:

Not provided

Barclays

Expiration Date

Until further notice

Requirements

AWS hands on with S3, EC2, Lambda, RDS, Glue, Athena, data pipelines, step function and knowledge of Analytical services
Experience of distributed computing architecture, Core Hadoop components (HDFS, Spark, Yarn, HIVE, Impala)
Expertise in SQL, advanced SQL skills
Expertise in shell scripting and programming (Scala/Python)
Experience of Ab Initio implementation on Hadoop (Optional)
Experience of Technical Design for ETL/Hadoop/AWS components

Job Responsibility

Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data
Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures
Development of processing and analysis algorithms fit for the intended data complexity and volumes
Collaboration with data scientist to build and deploy machine learning models

What we offer

Competitive holiday allowance
Life assurance
Private medical care
Pension contribution

Fulltime

Data Engineer

In this vital role as Data Engineer at Amgen, you will play a key role in design...

Location

India , Hyderabad

Salary:

Not provided

Amgen

Expiration Date

Until further notice

Requirements

Bachelor's or Master's degree in Computer Science, Data Engineering, IT, or a related field
4–7 years of relevant data engineering experience, with strong hands-on ETL background
Strong experience with Informatica (PowerCenter, IICS)
Strong SQL skills for data extraction, transformation, and analysis
Solid understanding of data modeling and entity relationships
Working knowledge of Python and/or PySpark
Experience supporting production data pipelines and resolving data issues
Ability to work effectively in global, cross-regional teams
Strong problem-solving and analytical mindset
Excellent communication and collaboration skills

Job Responsibility

Design, develop, maintain, and optimize ETL pipelines using Informatica, ensuring high data quality, performance, and reliability
Support and contribute to the future transition of Informatica workloads to Databricks (Spark, Delta Lake)
Build and enhance data pipelines for ingestion, transformation, and processing of large-scale datasets supporting OUS Field Engagement use cases
Collaborate with Data Architects, Business SMEs, Product Owners, and Senior Data Engineers across JAPAC and ELMAC regions to deliver end-to-end data solutions
Participate actively in a SAFe/Agile team, contributing to PI planning, sprint execution, and continuous improvement
Support data governance, metadata management, and data quality initiatives
Identify, troubleshoot, and resolve complex data issues across systems
Apply best practices for coding, testing, documentation, and reusable component design
Translate business and technical requirements into well-structured development tasks
Execute unit and integration testing to ensure solution robustness and compliance with quality standards

Fulltime

Data Engineer

Ever-expanding technology like IoT, machine learning, and artificial intelligenc...

Location

United States , Fort Meade

Salary:

77600.00 - 176000.00 USD / Year

Booz Allen Hamilton

Expiration Date

Until further notice

Requirements

6+ years of experience as a data engineer
Experience designing, implementing, and maintaining scalable data pipelines for structured and unstructured data
Experience preparing validated, normalized, and secure datasets for AI/ML model development
Experience implementing data governance practices, including access control, lineage tracking, and dataset documentation
Experience developing dashboards and metrics for data and pipeline monitoring
Experience building automated ETL workflows and CI/CD pipelines for data processes
Experience optimizing data workflows across on‑prem, cloud, or hybrid environments
Ability to monitor and improve pipeline performance in coordination with operations teams
TS/SCI clearance with a polygraph
HS diploma or GED

Job Responsibility

Help clients find answers in their data to impact important missions—from fraud detection to cancer research to national intelligence
Build advanced technology solutions and lead data engineering activities
Guide data engineering activities by overseeing the development and deployment of pipelines and platforms that organize and make disparate data meaningful
Collaborate closely with AI Model Engineers, Network and Cloud Architects, the ISSE, and other technical leaders to guide the development of scalable, mission‑aligned data pipelines
Apply expertise in data engineering, exploratory analysis, and feature development to shape how datasets are assessed, designed, transformed, and maintained for AI/ML workloads
Help ensure high‑quality, well‑governed data flows that enable reliable model performance across operational, research, and enterprise systems

What we offer

Health, life, disability, financial, and retirement benefits
Paid leave
Professional development
Tuition assistance
Work-life programs
Dependent care
Recognition awards program

Fulltime

Data Engineer

We are seeking a skilled Data Engineer to support a critical enterprise data mig...

Location

United States , Austin

Salary:

55.00 - 70.00 USD / Hour

Solomon Page

Expiration Date

Until further notice

Requirements

3–5+ years of experience as a Data Engineer
Strong expertise in SQL with experience working on large-scale and complex datasets
Hands-on experience with modern Data Warehouse platforms such as Snowflake, Redshift, BigQuery, Teradata, or equivalent
Experience with ETL/ELT tools including DBT, Airflow, Informatica, Talend, or similar technologies
Strong programming skills in Python, Scala, or Java for data processing and automation
Experience building or contributing to REST APIs
Strong understanding of relational databases and SQL optimization techniques
Experience with backend data flows, ETL workflows, batch processing, and event-driven architectures
Knowledge of data modeling concepts including Star Schema, Dimensional Modeling, and Normalization
Strong analytical, troubleshooting, and problem-solving skills

Job Responsibility

Analyze existing HDM tables and associated transformation logic
Re-engineer HDM structures into optimized and scalable Data Warehouse tables
Design, develop, and maintain automated ETL/ELT pipelines for production environments
Build and support backend data processing workflows, integrations, and transformation pipelines
Develop and contribute to REST APIs supporting data services and integrations
Collaborate with Data Architects, Product Teams, and Business Stakeholders to validate requirements and ensure successful implementation
Ensure high data quality, consistency, scalability, and performance across migrated datasets
Create detailed technical documentation and support knowledge transfer activities
Support data migration efforts from legacy systems to modern enterprise data platforms

What we offer

medical
dental
401(k)
direct deposit
commuter benefits

Fulltime

Data Engineer

Collinson is the global, privately-owned company dedicated to helping the world ...

Location

South Africa , Cape Town

Salary:

Not provided

Collinson

Expiration Date

Until further notice

Requirements

Extensive experience leading AWS and cloud data platform transformations
Proven track record of delivering large-scale data and analytical solutions in a cloud environment
Hands-on experience with end-to-end data pipeline implementation on AWS, including data preparation, extraction, transformation & loading, normalization, aggregation, warehousing, data lakes, and data governance
Expertise in developing Data Warehouses
In-depth understanding of modern data architecture such as Data Lake, Data Warehouse, Lakehouse, and Data Mesh
Strong knowledge of data architecture and data modelling practices
Cost-effective management of data pipelines
Familiarity with CI/CD driven data pipeline and infrastructure
Agile delivery approach using Scrum and Kanban methodologies
Ability to scope, estimate, and deliver committed work within deadlines, both independently and as part of an agile team

Job Responsibility

Design, develop, and maintain data pipelines for collecting, transforming, and loading data into various data stores
Build and maintain data warehousing and data lake solutions
Develop and deploy data models that support various business requirements
Write efficient and scalable code in languages such as Python, Scala, or Java
Lead the design of data solutions with quality, automation, and performance in mind
Own the data pipelines feeding into the Data Platform ensuring they are reliable and scalable
Ensure data is available in a fit-for-purpose and timely manner for business and analytics consumption
Work with Data Governance team to ensure solutions are compliant with regulations such as GDPR and CISO policies and data quality is baked-in to pipelines
Maintain and optimise existing data pipelines to improve performance and quality, minimising impacts to business
Collaborate with cross-functional teams to understand data requirements and provide support for data-driven initiatives

Fulltime

Data Engineer

We believe in the power of ingenuity to build a positive human future. We challe...

Location

United Kingdom , Belfast

Salary:

Not provided

PA Consulting

Expiration Date

Until further notice

Requirements

You thrive in problem-solving and analytical thinking
You enjoy collaborating with multiple stakeholders in a fast-paced environment
Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL
Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc
Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native or custom programming

Job Responsibility

Work to agile best practices and cross-functionally with multiple teams and stakeholders
Use technical skills to problem solve with clients and work on internal projects
Live in-person whiteboarding sessions to problem solve as a team, alongside asynchronous communication on Teams
Work alongside colleagues from across PA – delivering transformative digital solutions to today’s most complex business challenges
Design and build for the AWS cloud

What we offer

Health and lifestyle perks accompanying private healthcare for you and your family
25 days annual leave (plus a bonus half day on Christmas Eve) with the opportunity to buy 5 additional days
Generous company pension scheme
Opportunity to get involved with community and charity-based initiatives
Annual performance-based bonus
PA share ownership
Tax efficient benefits (cycle to work, give as you earn)

Fulltime

Select Country

Data Engineer

Job Description

Job Responsibility

Requirements

Nice to have

What we offer

Looking for more opportunities?

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Our AI answers in your language