CrawlJobs Logo

Data Engineer

Canada, Oshawa 92.00 - 100.00 CAD / Hour · Job Posted April 01, 2026
Apply Position
Job Link Share

Job Description

As an Azure and Databricks Data Engineer, you will be responsible for designing, building and supporting the data driven applications which enable innovative, customer centric digital experiences.

Job Responsibility

  • Designing, building and supporting the data driven applications which enable innovative, customer centric digital experiences
  • Building reliable, supportable & performant data lake & data warehouse products
  • Employing best practice in development, security, and accessibility
  • Building and productionizing modular and scalable data ELT/ETL pipelines and data infrastructure
  • Building curated common data models designed by the Data Modelers
  • Working closely with infrastructure, and cyber teams and Senior Data Developers to ensure data is secure
  • Cleaning, preparing and optimizing datasets for performance
  • Supporting Business Intelligence Analysts in modelling data for visualization and reporting
  • Troubleshooting issues related to ingestion, data transformation and pipeline performance
  • Collaborating with Business Analysts, data scientists, Senior Data Engineers, data Data Analysts and, solution Architects and Data Modelers
  • Assisting in identifying, designing, and implementing internal process improvements
  • Working with tools in the Microsoft Stack
  • Working within the agile SCRUM work management framework
  • Assisting in building data catalog and maintenance of relevant metadata
  • Developing optimized, performant data pipelines and models at scale using technologies such as Python, Spark and SQL
  • Documenting as-built pipelines and data products
  • Implementing orchestration of data pipeline execution
  • Creating tooling in collaboration with senior data engineers and data architects
  • Working with Continuous Integration/Continuous Delivery and DevOps pipelines
  • Monitoring the ongoing operation of in-production solutions
  • Implementing and managing appropriate access to data products
  • Writing and performing automated unit and regression testing for data product builds
  • Participating in peer code review sessions

Requirements

  • Completion of a four-year University education in computer science, computer/software engineering or other relevant programs within data engineering, data analysis, artificial intelligence, or machine learning
  • Experience as a Data Engineer designing and building data pipelines
  • Fluent in creating data processing frameworks using Python, PySpark, SparkSQL and SQL
  • Experience with Azure Data Factory, ADLS, Synapse Analytics and Databricks
  • Experience building data pipelines for Data Lakehouses and Data Warehouses
  • Good understanding of data structures and data processing frameworks
  • Knowledge of data governance and data quality principles
  • Effective communication skills to translate technical details to non-technical stakeholders

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Data Engineer

8 matching positions

New

Data Engineer

As a Data Engineer in our Finance Systems and Analytics team, you’ll help design...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience building and maintaining data pipelines and scalable data products using structured and unstructured data
  • Strong knowledge of SQL, ideally within a Snowflake environment
  • Experience with at least one server-side language such as Python, Java, Kotlin or NodeJS or experience with Alteryx
  • Knowledge of event-driven, loosely coupled architectures and data processing patterns
  • Experience working with CI/CD tools such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development approaches
  • Experience with automated testing techniques within data or software engineering environments
  • Proven experience working in the energy industry
  • Ability to translate complex data concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Building and maintaining scalable data products that deliver insight across finance systems
  • Designing and optimising ETL processes to ensure data integrity and performance
  • Collaborating with engineers, analysts, and business teams to define and deliver data solutions
  • Contributing to agile delivery, including planning, retrospectives, and continuous improvement
  • Supporting the operational performance, monitoring, and reliability of data platforms
What we offer
What we offer
  • Competitive salary and potential for an annual bonus
  • Market-leading pension scheme
  • Electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
!
Read More
Arrow Right
New

Data Engineer

Design, develop, and maintain data solutions, pipelines and analytics applicatio...
Location
Location
United States , Alpharetta
Salary
Salary:
Not provided
iqzsystems.com Logo
IQZ Systems
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • MS or foreign equivalent in Computer Science or Engineering (any) or Information Systems or Data Science or Related
  • 1 year experience in data storage, analysis and pipelines, ETL, Apache Kafka and Apache Storm
Job Responsibility
Job Responsibility
  • Design, develop, and maintain data solutions, pipelines and analytics applications using various tools and technologies including Hadoop, Spark, Hive, Kafka, SQL, MapReduce, Apache Kafka, Apache Storm, AWS, Snowflake etc
  • Gather & analyze requirements
  • Identify and implement process improvements
  • Assemble large, complex data sets to meet requirements
  • Implement methods to improve data reliability and data quality
  • Design and develop frameworks to stream data
  • Optimize data delivery and re-design infrastructure for greater scalability
  • Perform troubleshooting and provide issue resolution and similar duties
  • Fulltime
Read More
Arrow Right
New

Data Engineer

The Role: We are seeking a passionate Data Engineer to design scalable, robust s...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
July 16, 2026
Flip Icon
Requirements
Requirements
  • Deep expertise in data engineering with the ability to extend into backend services
  • Proven experience building pipelines for large-scale transactional or financial data
  • Fluency in Scala (Scio/Dataflow) and comfort with cloud-native development on GCP
  • Strong communication skills to collaborate with Finance, Product, and Engineering teams to ship auditable, reliable systems that meet regulatory scrutiny
  • Ability to thrive in fast-moving, ambiguous spaces while prioritizing long-term sustainability
Job Responsibility
Job Responsibility
  • Design scalable, robust systems that turn large-scale consumption and royalty data into accurate payouts
  • Build self-serve tools for our Finance team
  • Develop modular, easily maintainable platform capabilities
  • Fulltime
Read More
Arrow Right
New

Data Engineer

We are looking for a Data Engineer to help shape and scale a modern cloud-based ...
Location
Location
United States , Wood Dale
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering, analytics engineering, or a closely related discipline
  • Strong practical experience with Google Cloud Platform, including deep expertise in BigQuery
  • Advanced SQL skills with a proven ability to design semantic models and curated data layers
  • Experience developing integrations and pipelines through APIs, ingestion frameworks, or ETL processes
  • Hands-on familiarity with BI and reporting platforms such as Looker Studio, Tableau, or comparable tools
  • Solid communication skills with the ability to work effectively across technical teams and business functions
  • Demonstrated success in ambiguous environments where processes, models, and standards must be built from scratch.
Job Responsibility
Job Responsibility
  • Create and refine scalable data models and curated datasets within BigQuery to support accurate analysis and reporting
  • Build, manage, and optimize ETL workflows and data pipelines that connect information from SaaS applications and other source systems
  • Develop reporting-ready data structures and dashboards that provide clear, dependable insights for business users
  • Establish data quality practices, documentation standards, and performance metrics to strengthen trust in enterprise reporting
  • Collaborate with cross-functional stakeholders to translate reporting objectives into well-structured data solutions
  • Automate repetitive data tasks through scripting and lightweight engineering approaches using tools such as Python
  • Apply governance and maintainability best practices to improve how data is organized, accessed, and supported over time
  • Contribute to modernization efforts by helping move data processes away from legacy workflows into scalable cloud-based platforms.
What we offer
What we offer
  • Medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Free online training
Read More
Arrow Right
New

Data Engineer

Location
Location
Malaysia , Gelang Patah
Salary
Salary:
Not provided
content.perkinelmer.com Logo
PerkinElmer
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field, or equivalent work experience
  • Expert-level proficiency in Microsoft SQL Server, including complex query writing, performance tuning, stored procedures, CTEs, window functions, and view creation in production environments
  • Demonstrated ability to read and interpret complex, multi-layered SQL queries and understand underlying data structures
  • 3+ years experience creating and managing Python data pipelines and ETL for analytics use cases
  • 3+ years of hands-on Power BI development experience, including report building, data modeling, DAX authoring, and managing connections across a large number of diverse data sources
  • Proven ability to gather and translate business requirements into functional data and reporting solutions.
Job Responsibility
Job Responsibility
  • Manage, maintain, and continuously improve a portfolio of 40+ Power BI reports connected to 100+ data sources, ensuring data accuracy, performance optimization, and alignment with business needs
  • Collaborate with business stakeholders from Operations, Production, Engineering, Quality, Planning, Procurement, Service, Logistics and IT, to gather, analyze, and document reporting requirements, translating them into technical specifications
  • Architect and create SQL views and queries to support data models, reporting layers, and downstream analytics
  • Read, interpret, and refactor complex data pipelines to improve performance, readability, and maintainability across existing data infrastructure
  • Maintain and improve Python data pipeline scripts that extract, transform, and load data between SAP, Salesforce, ServiceMax, SFTP, Email, and MES systems, ensuring reliability and performance
  • Build and publish new Power BI reports and dashboards from initial requirements through final delivery, including data modeling, DAX measures, and visual design
  • Manage, monitor and troubleshoot PowerBI gateway, report refresh failures, data discrepancies, and pipeline issues
  • drive resolution in a timely manner
  • Document data pipelines, SQL views, and report logic to ensure knowledge transfer and sustainability of the reporting environment
  • Experience designing, implementing, and configuring both public and private API endpoints to enable seamless system integrations and scalable solutions.
Read More
Arrow Right
New

Data Engineer

Join us as a Data Engineer at Barclays, where you'll spearhead the evolution of ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in ETL / data processing / data warehousing / data engineering / RDBMS / PySpark
  • Experience in Data Processing and ETL in On-prem and Cloud based systems
  • Preferred AWS cloud development, with a strong understanding of AWS services (e.g., EC2, S3, Lambda, RDS, DynamoDB, etc.)
  • Proficient in at least one Python programming language
  • Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform etc.
  • Experience with CI/CD tools and pipelines (Jenkins, GitLab CI, etc.) for automation and deployment
  • Good understanding of cloud security best practices and experience with IAM, VPC, security groups, and encryption mechanisms
  • Good knowledge of monitoring, logging, and troubleshooting tools (e.g. CloudWatch, CloudTrail)
  • Experience with version control systems (Git, GitHub, Bitbucket)
  • Strong communication skills and ability to work in a collaborative team environment
Job Responsibility
Job Responsibility
  • Spearhead the evolution of our digital landscape, driving innovation and excellence
  • Deliver the technology stack, using strong analytical and problem-solving skills to understand the business requirements and deliver quality solutions coming up with the ETL process design / data pipeline of the Foundational / Consolidated and Business data Products for the Tesco Tenancy on EDP
  • Work on complex technical problems that will involve detailed analytical skills and analysis
  • Develop and delivery of high-quality software solutions by using industry aligned programming languages, frameworks, and tools
  • Ensure that code is scalable, maintainable, and optimized for performance
  • Cross-functional collaboration with product managers, designers, and other engineers to define software requirements, devise solution strategies, and ensure seamless integration and alignment with business objectives
  • Collaborate with peers, participate in code reviews, and promote a culture of code quality and knowledge sharing
  • Stay informed of industry technology trends and innovations and actively contribute to the organization's technology communities to foster a culture of technical excellence and growth
  • Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions
  • Implementation of effective unit testing practices to ensure proper code design, readability, and reliability
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Health and wellness
  • A place where you can belong
  • Collaborative Areas
  • More than work
  • Hybrid working
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Design, build, and optimize scalable data pipelines for ingesting, processing, a...
Location
Location
United States , Jonesboro
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field
  • 3+ years of experience in Data Engineering or related role
  • Strong SQL skills and experience working with relational databases
  • Experience building ETL/ELT pipelines using modern data tools
  • Proficiency in Python, Java, Scala, or similar programming languages
  • Experience with cloud platforms such as Amazon Web Services, Microsoft, or Google
  • Experience with data warehouses such as Snowflake, Amazon Redshift, or Google BigQuery
  • Experience with orchestration and pipeline tools such as Apache Airflow, dbt, or Apache Spark
  • Strong understanding of data architecture, data modeling, and database optimization
  • Excellent troubleshooting and problem-solving skills
Job Responsibility
Job Responsibility
  • Design, build, and optimize scalable data pipelines for ingesting, processing, and transforming large datasets
  • Develop and maintain ETL/ELT workflows from multiple structured and unstructured data sources
  • Build data models and optimize data warehouse performance for analytics and reporting
  • Ensure data quality, integrity, governance, and security across all data platforms
  • Partner with business stakeholders, analysts, data scientists, and application teams to understand data requirements
  • Monitor pipeline performance and troubleshoot data-related issues in production environments
  • Implement automation for data validation, monitoring, and alerting
  • Support cloud-based data infrastructure and architecture improvements
  • Create and maintain documentation for data flows, architecture, and processes
  • Continuously improve data engineering standards, tools, and best practices
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • 401(k) plan
  • Fulltime
Read More
Arrow Right
New

Data Engineer

Technology Doesn't Change the World, People Do.® Robert Half is the world’s firs...
Location
Location
United States , Memphis
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field
  • 3+ years of experience in Data Engineering or related role
  • Strong SQL skills and experience working with relational databases
  • Experience building ETL/ELT pipelines using modern data tools
  • Proficiency in Python, Java, Scala, or similar programming languages
  • Experience with cloud platforms such as Amazon Web Services, Microsoft, or Google
  • Experience with data warehouses such as Snowflake, Amazon Redshift, or Google BigQuery
  • Experience with orchestration and pipeline tools such as Apache Airflow, dbt, or Apache Spark
  • Strong understanding of data architecture, data modeling, and database optimization
  • Excellent troubleshooting and problem-solving skills
Job Responsibility
Job Responsibility
  • Design, build, and optimize scalable data pipelines for ingesting, processing, and transforming large datasets
  • Develop and maintain ETL/ELT workflows from multiple structured and unstructured data sources
  • Build data models and optimize data warehouse performance for analytics and reporting
  • Ensure data quality, integrity, governance, and security across all data platforms
  • Partner with business stakeholders, analysts, data scientists, and application teams to understand data requirements
  • Monitor pipeline performance and troubleshoot data-related issues in production environments
  • Implement automation for data validation, monitoring, and alerting
  • Support cloud-based data infrastructure and architecture improvements
  • Create and maintain documentation for data flows, architecture, and processes
  • Continuously improve data engineering standards, tools, and best practices
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • enrollment in company 401(k) plan
  • free online training
  • Fulltime
Read More
Arrow Right