CrawlJobs Logo

Senior Data Engineer

United States of America, Boston 90000.00 - 125000.00 USD / Year · Job Posted February 14, 2026
Apply Position
Job Link Share

Job Description

We’re an innovation and transformation consultancy that believes in the power of ingenuity to build a positive-human future in a technology-driven world. Our diverse teams of experts combine innovative thinking with breakthrough-technologies to progress further, faster. Are you ready to harness the power of data to drive advancements in healthcare? Are you passionate about both developing new capabilities and ensuring the optimization and reliability of existing data systems? Are you passionate about designing, building, and operating data infrastructure that plays a pivotal role in improving patient outcomes and shaping the future of medicine? If you're seeking a rewarding career at the intersection of healthcare and technology, we invite you to be part of our dynamic team. This is a unique, multi-year, project-based opportunity to build and grow a clinical data registry platform over many years working with a dedicated team of collaborators and customers. As a Data Engineer for our cutting-edge medical data registry, you'll be at the forefront of managing, optimizing, and expanding our data infrastructure, enabling critical insights that can positively impact patient outcomes. This role provides a dynamic mix of innovative new development—enhancements, optimizations, and Proofs of Concept—alongside meaningful hands‑on ownership of production pipelines, data flows, and platform operations. You will contribute to system improvements while also owning the monitoring, troubleshooting, tuning, and day-to-day reliability of the existing data ecosystem. If you're excited about leveraging your data engineering skills to make a difference in the world of healthcare, we want to hear from you.

Job Responsibility

  • Managing, optimizing, and expanding data infrastructure
  • Contributing to system improvements
  • Owning the monitoring, troubleshooting, tuning, and day-to-day reliability of the existing data ecosystem
  • Building and growing a clinical data registry platform over many years

Requirements

  • At least 6 years of industry working experience
  • Advanced SQL and Python
  • Expertise in the design and construction of Big Data Lakes and Data Warehouses capable of ingesting, standardizing, and serving billions of data rows spanning diverse datasets ranging from tens to hundreds
  • Experience building dynamic, metadata driven pipelines and analyses
  • Experience maintaining and supporting production data systems, including pipeline monitoring, troubleshooting, and delivering long‑term reliability and optimization enhancements
  • Building and managing fully automated data pipelines (ETL, ELT, ELTL) including: Designing and building data interfaces to source systems
  • Combining and transforming data into the appropriate format for storage
  • Developing data sets for analytics purposes
  • Developing pipelines that can handle common issues/errors in a robust and automated way
  • Implementing data quality checks, observability, and cost/performance optimization
  • Cloud experience in Azure, AWS or GCP
  • Ability to balance enhancement work with operational responsibilities in a production environment

Nice to have

  • Spark / PySpark experience highly preferable
  • Working in Agile and DevOps environments
  • Basic Python, Bash, or PowerShell for automation
  • Data modelling – Kimball, Data Vault, Star/Snowflake schema, Query-first etc.
  • Data visualisation in Power BI, Tableau, Qlik or similar
  • Architecting Data Platforms - designing BI/MI/Analytics solutions using Big Data, Relational or Streaming technologies
  • Experience with monitoring/observability tools (logging, alerting, pipeline health dashboards)
  • One or more of the following certifications: Microsoft Certified: Azure Data Engineer Associate
  • AWS Certified Data Analytics - Specialty
  • GCP Professional Data Engineers

What we offer

  • Group medical insurance
  • Health Savings Account with company match
  • Teladoc and informed Nurse line resources
  • Long term care plan
  • Group dental insurance
  • Vision plan
  • 401(k) Savings Plan with company profit sharing contribution
  • Commuter and Parking tax-savings benefit
  • 15 days paid vacation days with the opportunity to buy five additional days
  • 10 paid Holidays plus 10 paid sick days
  • Company and Voluntary income protection benefits
  • Gym and health incentive reimbursement
  • Pet and legal insurance Plans
  • Employee Assistance Plan
  • Annual performance-based bonus

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer

8 matching positions

Senior Data Engineer

The Product Engineering Partnership pillar is the connective tissue between Data...
Location
Location
United States , Multiple Locations
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years of experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years of experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience
  • Ability to meet Microsoft, customer, and/or government security screening requirements may be required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check — this position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Own telemetry contracts and instrumentation that ship with Global Skilling products (e.g., Microsoft Learn, ASN, Skilling Catalog)
  • Design and operate experimentation data infrastructure, including A/B testing pipelines, metric definitions, and significance tooling
  • Build catalog and content management data integrations across the Global Skilling product surface
  • Lead semantic model design for product analytics in partnership with Reporting and Analytics teams
  • Build and maintain external (end-customer) reporting pipelines for ASN and partner-facing products
  • Operate Insights and Analytics feedback loops, including pipelines that surface usage patterns, customer feedback, and product signals to engineering teams
  • Mentor Data Engineer II (DE II) engineers on telemetry design, experimentation practices, and product–engineering partnership approaches
  • Partner with Microsoft-wide alignment forums to align WISE telemetry standards with broader Microsoft frameworks
  • Provide on-call leadership for product-tier pipelines (severity levels 1–3)
  • Embody our Culture and Values
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation.
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Senior Data Engineer - The Senior Data Engineer is responsible for executing the...
Location
Location
Canada , Toronto
Salary
Salary:
110000.00 - 130000.00 USD / Year
fourseasons.com Logo
Four Seasons
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum 5-8 years experience Data Engineering
  • with experience in Azure using Databricks
  • Bachelor’s degree Required
  • Expert in Data Engineering in Microsoft Azure Environment + Toolsets (ADF, Synapse, Data Bricks, Cosmos DB, FunctionApps, Logic Apps etc)
  • Lakehouse experience using Databricks
  • Azure platform administration
  • Data Governance Software experience
  • Microsoft Power BI delivery and support
  • Strong SQL query skills
  • Strong history in Python, Pyspark, or Scala
Job Responsibility
Job Responsibility
  • Leading the delivery of finance domain data migration projects with clear milestones, quality controls, and operational readiness
  • Designing and maintaining reusable data ingestion and transformation frameworks aligned with enterprise engineering standards
  • Ensuring data consistency, lineage, and trustworthiness across finance and enterprise data domains
  • Collaborating with business and technical stakeholders to enable analytics, forecasting, and AI readiness for finance data
  • Driving operational excellence across engineering practices, optimizing for cost, performance, and maintainability
  • Design, develop, and maintain robust batch and streaming data pipelines across Azure Data Factory, Databricks, Informatica, and SQL environments
  • Closely work with vendors, contractors and other FS teams to operationalize the data migration process for the hotels
  • Implement and oversee CI/CD workflows, Infrastructure as Code (IaC), and automated testing frameworks
  • Operationalize data quality by integrating Informatica IDQ into finance workflows
  • Apply governance standards by embedding metadata, cataloging, and lineage practices
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

As a Data Engineer, you will join our Data Platform team and contribute to the d...
Location
Location
Poland , Cracow
Salary
Salary:
18000.00 - 23000.00 PLN / Month
medius.com Logo
Medius
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience developing with Python, including Pandas and PySpark
  • Strong SQL skills and experience working with large-scale datasets
  • Hands-on experience designing and implementing ETL/ELT processes in Data Lakehouse environments
  • Practical experience with Azure cloud services
  • Experience working with Apache Spark and Azure Databricks
  • Understanding of data modeling, data integration, and modern data engineering best practices
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable data processing infrastructure and ETL/ELT pipelines on Azure
  • Build and optimize data solutions within Azure Databricks and Data Lakehouse environments
  • Deliver high-quality, reliable data to support AI/ML applications, analytics, reporting, and other data consumers
  • Ensure data governance, security, integrity, and availability across the data platform
  • Monitor, troubleshoot, and improve data workflows and platform performance
  • Collaborate with cross-functional teams to understand data requirements and implement effective solutions
  • Stay current with emerging technologies and best practices in data engineering
  • Share knowledge and contribute to continuous learning within the team
What we offer
What we offer
  • 26 days PTO
  • medical, dental, and vision coverage
  • paid time off
  • retirement benefits
  • variable compensation (performance bonus or commission)
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

This role is categorized as hybrid. This means the successful candidate is expec...
Location
Location
United States , Austin
Salary
Salary:
133000.00 - 188600.00 USD / Year
gm.com Logo
General Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant full-time experience
  • or equivalent knowledge
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field, or equivalent practical experience.
  • Strong proficiency in Scala, Python, SQL, Spark, and Databricks, with production-quality software engineering practices.
  • Strong experience building and supporting cloud-based ETL/ELT pipelines, data platforms, and pipeline orchestration patterns for both batch and streaming operations.
  • Experience deploying machine learning models into production environments and supporting model development through operational release.
  • Strong experience with Databricks jobs, workflows, repos, Unity Catalog, and MLflow-based experimentation and model lifecycle management.
  • Experience building CI/CD pipelines with Git-based workflows, automated testing, and deployment of data or ML products.
  • Strong troubleshooting, communication, and cross-functional collaboration skills.
Job Responsibility
Job Responsibility
  • Design and develop batch and streaming ETL/ELT pipelines in Azure Databricks to support ingestion, transformation, curation, and delivery of manufacturing and enterprise data
  • Build reusable Bronze, Silver, and Gold data pipelines, data quality frameworks, and governed data products in Unity Catalog
  • Build and operationalize ML workflows for data preparation, feature engineering, model training, evaluation, deployment, batch scoring, retraining, and inference
  • Establish and maintain MLflow-based model lifecycle controls, including experiment tracking, model registration, versioning, lineage, traceability, and controlled promotion across environments
  • Implement CI/CD pipelines for data products, ML code, workflows, and deployment bundles using Git-based development practices, automated testing, and release automation
  • Build and support Databricks jobs and workflows for orchestration, scheduled execution, retraining, scoring, and downstream operational consumption
  • Improve reliability, observability, and production readiness through testing, monitoring, validation, alerting, documentation, and automation that reduce deployment risk and manual intervention
  • Partner with data scientists, data engineers, platform teams, architecture, manufacturing, and business stakeholders to productionize scalable, supportable solutions aligned to production constraints
  • Support modernization of legacy data and ML workflows into standardized cloud-native Databricks patterns and help bridge proof-of-concept work into repeatable production solutions
What we offer
What we offer
  • Medical
  • Dental
  • Vision
  • Health Savings Account
  • Flexible Spending Accounts
  • Retirement savings plan
  • Sickness and accident benefits
  • Life insurance
  • Paid vacation & holidays
  • Tuition assistance programs
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Ready to lead data engineering that powers critical financial decisions at scale...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
edfenergy.com Logo
EDF UK
Expiration Date
July 12, 2026
Flip Icon
Requirements
Requirements
  • Experience leading small to medium sized engineering teams within agile delivery environments
  • Strong expertise in at least one server-side language such as Python, Java, Kotlin or NodeJS
  • Knowledge of serverless, event-driven, and loosely coupled architectures
  • Experience designing and integrating REST APIs and third-party services
  • Commercial experience working with React or React Native and state management libraries
  • Strong experience with CI/CD tooling such as Jenkins, GitHub or Terraform
  • Experience applying test-driven development or behaviour-driven development practices
  • Proven experience working within the energy industry
  • Ability to communicate complex technical concepts to non-technical stakeholders
Job Responsibility
Job Responsibility
  • Leading the day-to-day engineering capability within the Finance Data Squad
  • Delivering scalable data products and software components aligned to business priorities
  • Driving quality through code reviews, testing practices, and engineering standards
  • Mentoring and developing engineers to build capability and performance
  • Collaborating with product owners, architects, and stakeholders to deliver value-focused solutions
What we offer
What we offer
  • Competitive salary
  • Potential for an annual bonus
  • Market-leading pension scheme
  • Customisable benefits including electric vehicle leasing
  • Discounted gym membership
  • Life assurance
  • Tech vouchers
  • Experience days
  • Fulltime
!
Read More
Arrow Right
New

Senior Data Engineer

Well-known technology platform company is looking for a Senior Data Engineer to ...
Location
Location
United States , San Francisco
Salary
Salary:
155000.00 - 195000.00 USD / Year
strategicemployment.com Logo
Strategic Employment Partners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience
  • Strong Python development skills
  • Production experience with Airflow or other workflow orchestration tools
  • Experience building data pipelines in the public cloud (AWS, GCP, or Azure)
  • Strong communication (ex: push back, clarify, and manage expectations proactively)
Job Responsibility
Job Responsibility
  • Work directly with stakeholders to understand their data needs
  • Build and maintain production pipelines
  • Deliver high-quality data sets that drive business decisions
  • Be embedded within the business unit attending stakeholder meetings
  • Translate ambiguous requirements into technical specs
  • Manage your domain end to end
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

I'm working with a leading global hedge fund that is looking to hire a Data Deve...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of software and/or data engineering experience
  • Strong development experience in Python or C#, ideally both
  • Expert-level SQL skills
  • Strong experience with relational databases, data modelling and schema design
  • Experience building ETL pipelines and data-driven applications
  • Strong problem-solving ability and a genuine interest in understanding systems end-to-end
  • Excellent communication skills and the ability to work directly with business users
Job Responsibility
Job Responsibility
  • Design and develop data models, reporting solutions and analytics platforms
  • Build and enhance ETL pipelines and data processing workflows
  • Develop applications and tooling using Python
  • Design and optimise database schemas and reporting architectures
  • Create and tune complex SQL queries for reporting, reconciliation and analytics
  • Work directly with business stakeholders to gather requirements and deliver solutions
  • Support and modernise existing reporting and analytics platforms
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Randstad has partnered with a software solutions company, building innovative an...
Location
Location
Malaysia , Kuala Lumpur
Salary
Salary:
15000.00 - 20000.00 MYR / Month
https://www.randstad.com Logo
Randstad
Expiration Date
August 17, 2026
Flip Icon
Requirements
Requirements
  • 7+ years of dedicated data engineering or distributed systems experience
  • Proven production experience with Apache Kafka (including ecosystem tools) and Apache Flink for real-time processing
  • Expert-level proficiency in Python for data processing and automation
  • Hands-on experience scaling modern cloud data warehouses (e.g., Snowflake, BigQuery, Redshift)
  • Strong grasp of distributed systems architecture, microservices, and modern data lakehouse patterns (e.g., Iceberg, Delta)
  • Familiarity with orchestration (e.g., Airflow), containerization (Docker, Kubernetes), and CI/CD pipelines
Job Responsibility
Job Responsibility
  • Architecture: Design fault-tolerant, petabyte-scale distributed data architectures and define company-wide data governance standards
  • Streaming: Build high-throughput, low-latency streaming pipelines using Apache Kafka and stateful Apache Flink applications
  • Data Warehousing: Integrate diverse data streams into a centralized Cloud Data Warehouse while optimizing query performance and storage costs
  • Development: Write clean, production-grade pipeline code using Python and manage end-to-end data lifecycle orchestration
  • Optimization: Troubleshoot bottlenecks in distributed systems, ensuring high availability, system uptime, and cost efficiency
  • Leadership: Provide technical mentorship to junior engineers and collaborate with cross-functional product and data science teams
What we offer
What we offer
  • Career Growth Opportunities
  • Open Communication Culture
  • Good Incentives
Read More
Arrow Right