CrawlJobs Logo

Senior Data Solution Developer

Canada, Administrative Centre Employment contract · Job Posted April 23, 2026
Apply Position
Job Link Share

Job Description

Job Description

Job Responsibility

  • Administer the enterprise data platforms (DWH, Data Lake, BI)
  • Create and maintain performance- and cost-optimized data pipelines, with high reliability, to meet business needs
  • Define and operate the infrastructure required for optimal extraction, loading and transformation (ELT) of data from a wide variety of data sources using SQL, API and Spark technologies
  • Design and implement improvements to life-cycle management processes (DevOps) enabling continuous integration, testing and deployment (CI/CT/CD) of data systems
  • Integrate data from various sources (including external data sources and IoT) and manage the big data as a key enterprise asset
  • Create and maintain backend data solutions for data analysts and data scientists
  • Assist data analysts and data scientists in unlocking insights from enterprise data
  • Identify, design, and implement internal processes and frameworks to improve the data platform (e.g. eliminating manual processes, optimizing data delivery, evolving data infrastructure capabilities, etc.)
  • Work with stakeholders including product, data and architecture SMEs to assist with data-related technical issues and support their data infrastructure needs
  • Ensure compliance with data architecture, data governance principles and security requirements
  • Implement and maintain the data platform’s semantic layer
  • Identify data quality issues and make recommendations for addressing root causes
  • Lead the Data Platform team process improvement by leveraging AI and other forms of automation
  • Set up observability/monitoring to measure reliability of the data pipelines and act quickly (e.g. operational support) in case of incident

Requirements

  • You hold a bachelor’s degree in computer science, Statistics, Informatics, Information Systems or another quantitative field
  • You have 8+ years of experience in a Data Engineer / Data Solution Developer role
  • You have knowledge of Agile / SCRUM project delivery, DevOps and CI/CD practices related to data solutions
  • You have advanced knowledge of SQL, query authoring/optimization and relational databases
  • You have experience optimizing ‘big data’ pipelines (storage, file formats, partitioning, Spark, Python, streaming)
  • You are efficient at performing root cause analysis to address data pipeline issues and applying long-term fixes
  • You have experience designing and building data transformation, data structures, metadata frameworks, semantic layer and automated workload management
  • You have experience implementing data protection measures, understanding data privacy and collaborating with Cybersecurity teams
  • You have good knowledge of Azure data services (Azure Data Factory, Azure Data Lake Storage, Event Hub, Databricks, Lakehouse Medallion Architecture) and PowerBI
  • You have good knowledge of object-oriented and functional programming languages: Python, Java, C++, Scala, etc
  • You have good people skills and are a team player, motivated by developing other people with technical coaching
  • You are a good communicator, who can simplify complex technical issues for non-technical people
  • You are fluent in French and English

What we offer

  • Insurance plans (Dental, medical, life insurance, disability, and more)
  • Competitive base salary
  • Retirement savings plan
  • Employee Assistance Program
  • Tele Health Program

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Solution Developer

8 matching positions

Senior Data Solution Developer

At Bombardier, we design, build and maintain the world’s peak-performing aircraf...
Location
Location
Canada , Dorval
Salary
Salary:
Not provided
bombardier.com Logo
Bombardier
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • You hold a bachelor’s degree in computer science, Statistics, Informatics, Information Systems or another quantitative field
  • You have 8+ years of experience in a Data Engineer / Data Solution Developer role
  • You have knowledge of Agile / SCRUM project delivery, DevOps and CI/CD practices related to data solutions
  • You have advanced knowledge of SQL, query authoring/optimization and relational databases
  • You have experience optimizing ‘big data’ pipelines (storage, file formats, partitioning, Spark, Python, streaming)
  • You are efficient at performing root cause analysis to address data pipeline issues and applying long-term fixes
  • You have experience designing and building data transformation, data structures, metadata frameworks, semantic layer and automated workload management
  • You have experience implementing data protection measures, understanding data privacy and collaborating with Cybersecurity teams
  • You have good knowledge of Azure data services (Azure Data Factory, Azure Data Lake Storage, Event Hub, Databricks, Lakehouse Medallion Architecture) and PowerBI
  • You have good knowledge of object-oriented and functional programming languages: Python, Java, C++, Scala, etc.
Job Responsibility
Job Responsibility
  • Administer the enterprise data platforms (DWH, Data Lake, BI)
  • Create and maintain performance- and cost-optimized data pipelines, with high reliability, to meet business needs
  • Define and operate the infrastructure required for optimal extraction, loading and transformation (ELT) of data from a wide variety of data sources using SQL, API and Spark technologies
  • Design and implement improvements to life-cycle management processes (DevOps) enabling continuous integration, testing and deployment (CI/CT/CD) of data systems
  • Integrate data from various sources (including external data sources and IoT) and manage the big data as a key enterprise asset
  • Create and maintain backend data solutions for data analysts and data scientists. Assist them in unlocking insights from enterprise data
  • Identify, design, and implement internal processes and frameworks to improve the data platform (e.g. eliminating manual processes, optimizing data delivery, evolving data infrastructure capabilities, etc.)
  • Work with stakeholders including product, data and architecture SMEs to assist with data-related technical issues and support their data infrastructure needs
  • Ensure compliance with data architecture, data governance principles and security requirements
  • Implement and maintain the data platform’s semantic layer
What we offer
What we offer
  • Insurance plans (Dental, medical, life insurance, disability, and more)
  • Competitive base salary
  • Retirement savings plan
  • Employee Assistance Program
  • Tele Health Program
  • Fulltime
Read More
Arrow Right

AI Solution Developer II / Senior AI Solution Developer

This role will work within our Scientific Data Technology and AI department whic...
Location
Location
United Kingdom
Salary
Salary:
Not provided
parexel.com Logo
Parexel
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Educated to BSc. or MSc level in Engineering or Computer Science with a focus on Machine Learning (and GenAI) or other equivalent qualification/experience
  • Experience in Palantir Foundry, it’s ecosystem and components, including building Workshop Apps, building and deploying Modelling Objectives and managing Code Repos and Pipelines
  • Machine Learning, Generative AI (Gen AI), Deep Learning (building and deploying NLP systems within Palantir Foundry)
  • Proven CS fundamentals including data structures, algorithms, and distributed systems
  • Proven theoretical and practical experience in modern ML technologies, including transformers, graphical models, information retrieval techniques, LLMs, time series models, Reinforcement Learning, etc.
  • Proven software engineering fundamentals, including the ability to write production ready code, establish and enforce high engineering standards, architect packages, and own architectural and procedural choices for effective shared codebases within Foundry
  • Knowledge of Python and scientific computing packages (PyTorch, NumPy, Scikit-learn, TensorFlow)
  • Experience with data modeling and pipeline development in Palantir Foundry
  • Experience with frontend development for intuitive user experience
  • Practical understanding of database technologies including relational, non-relational and graph
Job Responsibility
Job Responsibility
  • Leverage Palantir Foundry to build and deploy reusable custom machine learning models, Ontologies and end-user applications
  • Design, implement, and document new ML/Gen AI modeling techniques and strategies
  • Develop ML pipelines and workflows in Foundry to support AI solution development and deployment
  • Review and adapt recent research in ML and Gen AI into Foundry-based prototypes and production solutions
  • Review code and pipelines of other engineers to enhance ML quality and security within Foundry
  • Understand business needs and user workflows and support interpretation in the context of potential AI solutions in Foundry
  • Support development of custom models and AI / Gen AI solutions using Foundry's ML capabilities to address business needs
  • Lead experiment and model evaluation design based on well-founded best practices in machine learning to ensure safe, effective, and principled AI development practices within Foundry
  • Carry out AI solution prototyping and experimentation using Foundry's tools, various LLMs and environments
  • Collaborate with Product to define and implement features to satisfy customer requirements within Foundry
What we offer
What we offer
  • competitive base salary
  • holiday
  • private healthcare
  • dental insurance
  • Fulltime
Read More
Arrow Right

Software Developer - Senior / Senior Data Engineer

Imagine being at the forefront of protecting financial integrity and enabling cr...
Location
Location
United States , Southlake, TX or Austin, TX
Salary
Salary:
55.92 - 62.13 USD / Hour
aquent.com Logo
Aquent
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field
  • 8+ years of hands-on experience in data management, including gathering data from diverse sources, consolidating it into centralized locations, and transforming it with business logic for consumption in visualization and data analysis
  • Strong expertise in BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and related cloud platform services
  • Proficiency in Python and SQL for data processing and automation
  • Extensive experience with ETL processes and data pipeline design
  • Excellent problem-solving skills and meticulous attention to detail
  • Strong communication and collaboration skills, with the ability to actively listen, dialogue freely, and verbalize ideas effectively
  • Ability to thrive in an Agile work environment, delivering incremental value to customers by effectively managing and prioritizing tasks
Job Responsibility
Job Responsibility
  • Design, build, and maintain robust and scalable data pipelines using cloud platform tools such as BigQuery, Cloud Storage, Dataflow (Apache Beam), Cloud Composer (Airflow), and Pub/Sub
  • Develop high-performance, production-grade Python and SQL code, optimizing queries for efficient data extraction, transformation, and loading (ETL) processes
  • Implement complex data models in BigQuery, leveraging partitioning, clustering, and materialized views to achieve optimal performance
  • Collaborate closely with cross-functional teams, including business customers and Subject Matter Experts, to gather data requirements and deliver impactful solutions
  • Implement and uphold best practices for data quality, data governance, and data security
  • Proactively monitor and troubleshoot data pipeline issues, ensuring high availability and performance of critical data flows
  • Contribute to strategic data architecture decisions, providing recommendations for continuous improvement of data pipelines
  • Stay current with emerging trends and technologies in cloud-based data engineering and cyber security to drive innovation
  • Lead investigation and resolution efforts for identified data issues, taking ownership to resolve them in a timely manner
  • Document processes and procedures thoroughly for producing accurate metrics and ensuring operational clarity
What we offer
What we offer
  • subsidized health, vision, and dental plans
  • paid sick leave
  • retirement plans with a match
Read More
Arrow Right

Cloud Solution Architect and Senior Cloud Solution Architect - Data and AI

We are looking for Cloud Solution Architect (CSA) and Senior Cloud Solution Arch...
Location
Location
United States , Multiple Locations
Salary
Salary:
85100.00 - 169800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, Information Technology, Engineering, Business, Liberal Arts, or related field AND 2+ years experience in cloud/infrastructure technologies, information technology (IT) consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or consulting OR equivalent experience
  • Authorization to work in the United States that does not now or in the future require employer sponsorship
  • 1+ years of experience with AI/ML and/or Generative AI technology
  • 2+ years of customer facing experience providing recommendations to, or collaborating with, mid-to-senior level executives to address and advance technology transformation initiatives, entablements, and outcomes, including Data and AI solutions
  • 2+ years of enterprise experience in ANY of the following: Microsoft Fabric, Azure Databricks, Microsoft Purview, Azure SQL, PostgreSQL, MySQL, and Cosmos DB
Job Responsibility
Job Responsibility
  • Seek to understand customers’ overall data estate Business and IT priorities and success measures to design Data & Analytics solutions that drive business value and drive positive Customer Satisfaction & become a trusted advisor
  • Ensure that solution exhibits high levels of performance, security, scalability, maintainability, repeatability, appropriate reusability, and reliability upon deployment and provide feedback and insights from customers/partners
  • Develop opportunities to drive Customer Success business results & help Customers get value from their Microsoft investments and identify resolutions to Customer blockers by leveraging SA subject matter expertise
  • Deliver according to MS best practices & using repeatable Intellectual Property (IP)
  • Apply technical knowledge to architect and design solutions that meet business and IT needs, create AI roadmaps, drive Proof of Concepts (POC) and Minimal Viable Product (MVP), and ensure long term technical viability of new deployments, infusing key AI technologies where appropriate
  • Be the Voice of Customer to share insights and best practices, connect with Engineering team to remove key blockers and drive product improvements
  • Maintain technical skills and knowledge, keep up to date with market trends and competitive insights
  • collaborate and share with the AI technical community while educating customers on Azure platform
  • Accelerate customer outcomes - Share expertise, contribute to IP creation & re-use to accelerate customer outcomes and obtain relevant accreditations and certifications
  • Fulltime
Read More
Arrow Right

Pyspark Big Data Senior Developer - Vice President

We are building an A-team of highly skilled and autonomous engineers, and we are...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of extensive, hands-on experience as a Senior Big Data Developer, with a strong emphasis on PySpark and the Apache Spark ecosystem, operating as a player/coach
  • Expert proficiency in Python, with a proven track record of developing robust, scalable, and high-performance PySpark applications for large-scale data processing
  • Deep understanding and extensive hands-on experience with Apache Spark (Spark Core, Spark SQL, Spark Streaming) and its ecosystem
  • Experience with distributed computing frameworks such as Hadoop (HDFS, YARN)
  • Expert proficiency in SQL and extensive experience with data warehousing concepts and technologies (e.g., Hive, Snowflake, Redshift, Databricks SQL)
  • Proven experience with various data storage formats (e.g., Parquet, ORC, Avro) and data lake solutions (e.g., Delta Lake, Iceberg)
  • Experience with NoSQL databases (e.g., MongoDB, Cassandra, HBase) is a significant plus
  • Strong experience with Apache Kafka for building real-time data pipelines and event-driven architectures
  • Demonstrated experience with big data services on major cloud platforms (e.g., AWS EMR/Glue/Redshift, Azure Databricks/Data Factory/Synapse, GCP Dataflow/Dataproc/BigQuery) is highly desirable
  • Proven effectiveness with AI coding tools (e.g., Claude Code, Codex, Antigravity) is a mandatory requirement
Job Responsibility
Job Responsibility
  • Operate end-to-end in the design, development, and implementation of robust big data solutions, ensuring optimal performance, scalability, data quality, and security
  • Collaborate closely within small, co-located squads (4-7 person teams), fostering high communication and low coordination overhead, to translate complex business requirements into technical specifications for big data processing and analytical solutions
  • Act as a player/coach within the team, mentoring junior members and leading by example in the development of efficient and innovative big data architectures
  • Design, develop, and optimize large-scale data pipelines using PySpark for data ingestion, transformation, and aggregation, always with an eye towards efficiency and domain relevance
  • Implement and manage real-time data streaming and event-driven architectures using technologies like Apache Kafka
  • Design and implement sophisticated data warehousing solutions and dimensional models for efficient data storage and retrieval, ensuring alignment with business needs
  • Work with various distributed data storage technologies, including distributed file systems (e.g., HDFS, S3) and NoSQL databases (e.g., MongoDB, Cassandra), selecting the right tool for the right problem
  • Implement efficient data processing and storage strategies to optimize the performance and scalability of big data applications, with a strong focus on the 'why' behind the technology choices
  • Champion best practices in software development, including rigorous code reviews, implementing comprehensive testing, and supporting continuous integration and continuous deployment (CI/CD) pipelines
  • Demonstrate high autonomy and agency in driving projects forward, making informed decisions, and proactively identifying areas for improvement
  • Fulltime
Read More
Arrow Right

Senior Data Developer (Azure)

We are looking for a highly skilled and experienced Senior Azure Data Developer ...
Location
Location
Egypt , Cairo
Salary
Salary:
Not provided
coca-colahellenic.com Logo
Coca-Cola HBC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master’s degree in computer science, information technology, data science, or a related field (or an equivalent of 7+ years of practical experience in a tech-domain)
  • Hands-on experience with MS Power BI, MS PowerApps, MS Azure Data Factory, MS Azure Data Lake Store, SQL Database (T-SQL), DAX & Power Query M (3+ years)
  • Proven track record of implementing proof-of-concept (POC) backend solutions
  • Expert knowledge with cloud platforms (Azure, Google Cloud Storage, Amazon), preferably Microsoft Azure – with a focus on data warehousing & backend development
  • Strong programming skills in languages such as C#, .NET, Python, Scala or Java
  • Experience with big data architectures and large data volumes technologies (partitioned tables with billions of records, files with hundreds of GBs)
  • Familiarity with big data technologies such as Hadoop, Spark, and Hive as well as strong knowledge with data manipulation frameworks such a PySpark
  • Strong analytical & problem-solving abilities, as well as good communication skills
  • Strong willingness to learn and adapt to new technologies and tools
  • Good proficiency in English as a day-to-day business language is a must.
Job Responsibility
Job Responsibility
  • Assist in the design, development, and maintenance of ETL (Extract, Transform, Load) processes using Azure Data Factory
  • Implement data ingestion processes from various data sources into Azure data storage solutions
  • Work with Azure SQL Database, Azure Data Lake Storage, and Hive & Databricks to store and manage large datasets (Terabytes of data)
  • Ensure data integrity and availability by implementing appropriate storage solutions
  • Integrate data from various sources, ensuring accuracy, completeness, and consistency
  • Collaborate with data scientists and analysts to understand data requirements and provide necessary support
  • Contribute to the strategy, design and development of our Enterprise and Operational Reporting, providing insights and supporting decision making for end users
  • Integrate & transform data from various data systems into structures that are suitable for building analytical solutions
  • Design, develop and implement Azure-based solutions connecting certified and validated data sources to Power BI front-end visualizations and creating a single source of truth for reporting
What we offer
What we offer
  • Development opportunities
  • Equal opportunity employer
  • IT Equipment
  • Learning programs
  • Work with iconic brands
  • Supportive team
  • Volunteering Opportunities
  • Wellbeing program
Read More
Arrow Right

Senior Data Developer

We are seeking an experienced Data Developer with expertise in Snowflake to adap...
Location
Location
Romania
Salary
Salary:
Not provided
techtalent.ro Logo
TechTalent Software
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in Computer Science, Business Informatics, or a comparable qualification
  • Several years of experience in database development and management, preferably in Snowflake
  • Strong proficiency in SQL and database design
  • Experience implementing automated data solutions
  • Excellent analytical and problem-solving skills
  • Strong communication and consulting abilities
  • Conversational level of German language (B1 or higher)
Job Responsibility
Job Responsibility
  • Analyze and evaluate the existing database environment to identify necessary adjustments
  • Advise business departments and users on requirements and technical solutions
  • Design and implement automated data provisioning and update processes
  • Ensure the provision of requirements-based data packages for reporting
  • Support acceptance and quality assurance of implemented adjustments
  • Provide consulting on analytical topics and prepare implementation in the department’s environment
What we offer
What we offer
  • Relocation package
  • Job rotation
  • Learning through Arnia Academy
  • Attractive projects
  • Flexibile working hours
  • Performance bonuses
  • Medical benefits
  • Trainings
  • Competitive compensation package
  • Referral program
  • Fulltime
Read More
Arrow Right

Senior Data Warehouse Developer

We are looking for an experienced Senior Data Warehouse Developer to join a crit...
Location
Location
Australia , Adelaide
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
June 10, 2026
Flip Icon
Requirements
Requirements
  • Proven, hands-on experience with the Informatica IDMC Platform, including its data integration, data governance, and data catalog features
  • Strong expertise in data modeling and architecture
  • A solid understanding of data management principles
  • Experience with Informatica PowerCenter and the ability to manage migration tasks
  • Demonstrated ability to perform detailed data analysis
  • Tertiary qualifications in the field of computer science
  • Technology or IT and/or equivalent experience
  • Full Working Rights in Australia
Job Responsibility
Job Responsibility
  • Design, develop, and implement robust data integration solutions using Informatica IDMC, with a focus on Cloud Data Integration (CDI) and other related services
  • Lead the migration of existing Informatica PowerCenter workflows to the new IDMC cloud environment
  • Provide ongoing monitoring and support for the Enterprise Data Warehouse and its associated ETL processes
  • Ensure all development work aligns with defined local standards and best practices
  • Conduct detailed data analysis for both source and target tables and columns to ensure data quality and integrity
!
Read More
Arrow Right