CrawlJobs Logo

Senior Data Engineer

United States, Redmond, WA 119800.00 - 234700.00 USD / Year · Job Posted January 29, 2026
Apply Position
Job Link Share

Job Description

Microsoft is on a mission to empower every person and every organization on the planet to achieve more. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world. You can help us achieve our mission. Cloud Operations + Innovation (CO+I) is the engine that powers Microsoft’s core cloud platforms and services that millions of people use every day. With more than 95% of Fortune 500 business on Azure, 180 million using Office 365, and millions using other services – all running on Microsoft's cloud infrastructure – CO+I builds and operates the foundation upon which Microsoft’s mission to empower every person and organization comes to life. Are you passionate about cloud computing? Do you get excited about taking a hands-on approach to transforming Microsoft’s most critical business through investigation, data analysis, and automation? If so, come and help us build the most reliable & efficient datacenter infrastructure on the planet. The CO+I Critical Environment Systems Intelligence (CESI) team is responsible for designing and delivering solutions to support global datacenter operations and to improve availability. CESI is helping to drive CO+I’s transition to a customer centric, data driven, live service culture. As a Senior Data Engineer, you will be a key player in this transition. As a Senior Data Engineer on the CO+I Critical Environment Service Intelligence (CESI) team, you will design and deliver the data platforms and tooling required to programmatically understand which customers are impacted by changes occurring within our data centers. This work enables clear, datadriven visibility into customer impact resulting from both planned and unplanned infrastructure events. You will partner closely with multiple CO+I teams, as well as Azure, Exchange, Bing, and other firstparty services, to model, integrate, and deliver this capability at scale. A successful candidate will apply strong data engineering fundamentals—data modeling, pipeline design, automation, and lowlatency processing—while leveraging domain knowledge across data center infrastructure capacity, service management, customer experience (CXP), containers, cloud services, shared responsibility models, and geo and zoneredundant architectures. Through this work, you will help establish a clear source of truth for ownership of data center assets and their relationships to customerfacing services, enabling accurate, timely assessment of customer impact during outages and other operational events. The solutions you build will operate over large, complex datasets and directly inform operational decisionmaking across the fleet. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Job Responsibility

  • Deliver a data-driven solution to map from servers (and clusters) to their responsible First Party owners and services by exposing leaps of logic that don't explicitly exist between systems
  • Develop automations to appropriately calculate risk of impact to customers during an outage in collaboration with responsible parties and Azure Customer Experience
  • Perform thorough data analysis and testing to identify data gaps and ensure data quality
  • Work closely with application, data platform, and data engineering teams to reconfigure data ingestion pipelines to be more reliable and continuously monitored
  • Partner with engineering teams to publish easy-to-consume, production-quality data assets

Requirements

  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have

  • 6+ years of strong hands-on experience with Data Analytics applications. (SQL, Kusto, Hadoop, or equivalent large data system)
  • 2+ years of hands-on experience creating and leveraging data visualization platforms (Power BI, Tableau, etc)
  • Experience working with large data sets using SQL/Azure Data Lake/Spark, etc., to derive actionable insights is highly desirable
  • Familiarity with one or more general purpose programming languages including but not limited to: Java, C/C++, C#, Python, JavaScript, PowerShell
  • Experience with reporting and data analysis systems & platforms (e.g., Power BI, SAP, CRM, Dynamics 365, etc.)
  • Demonstrated experience producing executable and measurable results
  • focused on delivering impact and identifying, managing, and mitigating risks
  • Demonstrated technical problem solving and excellent analytical, verbal, written, interpersonal communication skills with attention to detail
  • Ability to communicate with a broad range of audiences with varying technical abilities and to use data as a story-telling device
  • Ability to effectively deal with ambiguity and work independently to derive actionable solutions
  • Ability to successfully influence without authority and manage efforts through relationships
  • Ability to promote a collaborative environment and bring a positive attitude to difficult situations

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Data Engineer

8 matching positions

New

Senior Data Engineer

In this role, you will work closely with the Digital Innovation team to design, ...
Location
Location
Canada , Vancouver
Salary
Salary:
140000.00 - 175000.00 USD / Year
klohn.com Logo
Klohn Crippen Berger
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field (or equivalent practical experience)
  • 7+ years in data engineering and enterprise data platforms, including hands-on Microsoft Fabric experience
  • Hands-on experience with Microsoft Fabric, OneLake, and Power BI
  • Experience designing and implementing enterprise data pipelines and architectures
  • Strong understanding of Medallion Architecture and modern data platform concepts
  • Experience with Azure data services and cloud-based data platforms
  • Knowledge of RBAC, and compliance best practices
  • Strong analytical and troubleshooting skills
  • Experience working with large-scale enterprise datasets
  • Strong oral and written communication skills
Job Responsibility
Job Responsibility
  • Support the implementation, optimization and governance of Microsoft Fabric and OneLake environments
  • Develop and maintain scalable data ingestion pipelines, workflows and enterprise data models
  • Design and implement Medallion Architecture (Bronze, Silver, Gold) solutions
  • Support Power BI semantic modeling, reporting, and analytics initiatives
  • Integrate and support Microsoft Purview governance capabilities
  • Assist with data quality, RBAC, security, compliance, and governance requirements
  • Collaborate with technical stakeholders to support enterprise reporting and AI initiatives
  • Troubleshoot and optimize Fabric workloads, pipelines, and data models for scalability and performance
  • Document technical solutions, processes, and standards
What we offer
What we offer
  • Hybrid work opportunities
  • Annual performance and salary review
  • Vacation policy that aligns to your experience
  • Flexible benefits, including RSP, social, and mental well-being initiatives
  • Paid OT, and sick days
  • Commitment to global ESG standards
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Location
Location
United Kingdom , London
Salary
Salary:
Not provided
barclays.co.uk Logo
Barclays
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data Engineering & Pipeline Architecture: End-to-end data engineering covering real-time and batch ingestion, ETL pipelines, and full lifecycle (ingestion → processing → consumption) using AWS, SQL, Java, and Python
  • Cloud Data Platforms & Distributed Systems: Hands-on experience with AWS data platforms, Data Lakes, Databricks, and federated architectures, including integration across multiple enterprise data sources
  • Data Governance, Modelling & Metadata Management: Strong expertise in large-scale SQL data modelling, enterprise data cataloguing (Alation), data governance, metadata management, and regulatory-aligned data frameworks
Job Responsibility
Job Responsibility
  • Provision of guidance and expertise to engineering teams to ensure alignment with best practices and foster a culture of technical excellence
  • Contribution to strategic planning by aligning technical decisions with business goals, anticipating future technology trends, and providing insights to optimize product roadmaps
  • Design and implementation of complex, scalable, and maintainable software solutions, considering long-term viability and business objectives
  • Mentoring and coaching to junior and mid-level engineers to foster professional growth and knowledge sharing, elevating the overall skillset and capabilities of the organization
  • Collaboration with business partners, product managers, designers, and other stakeholders to translate business requirements into technical solutions and ensure a cohesive approach to product development
  • Innovation within the organization by identifying and incorporating new technologies, methodologies, and industry practices into the engineering process
What we offer
What we offer
  • Competitive holiday allowance
  • Life assurance
  • Private medical care
  • Pension contribution
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Senior Data Engineer - UKRAINE - REMOTE. We are looking for an experienced Senio...
Location
Location
Ukraine
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake
  • strong programming skills in Python and SQL
  • proven experience building batch and streaming data pipelines and production-grade data platforms
  • solid understanding of data modeling, data quality, and governance principles
  • experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP
  • familiarity with modern data platforms such as Databricks and Snowflake
  • experience with lakehouse architectures and distributed data systems
  • strong understanding of scalability, reliability, and performance considerations in data pipelines
  • strong problem-solving skills focused on scalability and reliability
  • collaborative approach to working in cross-functional teams
Job Responsibility
Job Responsibility
  • Build & Data Platform Engineering: design and implement scalable data platforms and pipelines across cloud environments
  • develop reliable batch, streaming, and near-real-time pipelines using technologies such as Spark and Delta Lake
  • build ingestion, transformation, and curation workflows for both structured and unstructured data
  • implement modern data architectures including lakehouse patterns and medallion layering (bronze, silver, gold)
  • Enable AI, GenAI & Data Products: deliver high-quality datasets that support analytics, machine learning, causal modeling, and optimization systems
  • enable data pipelines for GenAI use cases (including LLMs, RAG pipelines, and vector-based data flows) and agent-based architectures and intelligent workflows
  • Data Modeling, Orchestration & Automation: design scalable logical and physical data models for analytical and operational use cases
  • orchestrate workflows using tools such as Airflow, dbt, Lakeflow, or equivalents
  • Architecture, Governance & Observability: apply modern architecture patterns including event-driven and streaming architectures
  • ensure adherence to best practices in data governance, lineage, quality, and access control (RBAC/ABAC)
What we offer
What we offer
  • Mental and physical health: Medical insurance
  • Sports reimbursement budget
  • Home office support
  • A number of free psychological and legal consultations
  • Maternity and paternity leave support
  • Personal and professional development: Internal workshops and learning initiatives
  • English language classes compensation
  • Professional certifications reimbursement
  • Participation in professional local and global communities
  • Growth Framework to manage expectations and define the steps to move towards the selected career
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are looking for an experienced Senior Data Engineer to design, build, and opt...
Location
Location
Poland
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on experience with Apache Spark and Delta Lake, and strong programming skills in Python and SQL. Proven experience building batch and streaming data pipelines and production-grade data platforms, with solid understanding of data modeling, data quality, and governance principles. Experience with one or more major cloud platforms, with preference for Microsoft Azure / Fabric, as well as AWS or GCP. Familiarity with modern data platforms such as Databricks and Snowflake is expected. Experience with lakehouse architectures and distributed data systems, and strong understanding of scalability, reliability, and performance considerations in data pipelines. Strong problem-solving skills focused on scalability and reliability, with a collaborative approach to working in cross-functional teams.
Job Responsibility
Job Responsibility
  • Design and implement scalable data platforms and pipelines across cloud environments
  • develop reliable batch, streaming, and near-real-time pipelines
  • implement modern data architectures including lakehouse patterns and medallion layering
  • deliver high-quality datasets supporting analytics, machine learning, causal modeling, and optimization systems
  • enable data pipelines for GenAI use cases
  • design scalable logical and physical data models
  • orchestrate workflows using tools such as Airflow, dbt, Lakeflow
  • apply modern architecture patterns including event-driven and streaming architectures
  • ensure adherence to best practices in data governance, lineage, quality, and access control
  • establish strong data observability
What we offer
What we offer
  • 24 working days of paid vacation
  • National holidays covered
  • Sick leave (up to 20/year)
  • Unpaid leave (up to 20/year)
  • Medical insurance
  • Multisport card OR Multikafeteria
  • Maternity & paternity leave support
  • Internal workshops & learning initiatives
  • Professional certifications reimbursement
  • Participation in professional local & global communities
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

The Opportunity: We are currently partnering with several leading technology con...
Location
Location
United Kingdom , United Kingdom
Salary
Salary:
100.00 GBP / Day
myn.co.uk Logo
Myn
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience in designing, building, and maintaining production-grade data pipelines
  • Proficiency in Python and SQL for data manipulation and transformation
  • Strong understanding of cloud architecture and services
  • Experience with DevOps practices, including CI/CD and infrastructure as code
  • Proven ability to design and optimise data models and architectures
  • Experience implementing data quality, governance, and compliance standards
  • Excellent documentation and technical communication skills
  • Demonstrable ability to collaborate effectively with cross-functional teams
Job Responsibility
Job Responsibility
  • End-to-end lifecycle of robust, scalable data pipelines
  • Ensure data systems are efficient, reliable, and capable of supporting complex analytical and operational requirements
  • Work closely with cross-functional teams to translate business needs into technical solutions
  • Drive the evolution of cloud-based systems while maintaining rigorous standards for data quality, governance, and infrastructure automation
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are seeking an experienced Data Engineer to help build and scale our modern d...
Location
Location
India , Pune
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of data engineering experience in a cloud environment
  • Strong proficiency with Microsoft Fabric (Lakehouses, Spark, Data Factory, Pipelines)
  • Hands-on experience with Apache Airflow for workflow orchestration
  • Experience with DBT (Data Build Tool) for transformations, testing, and documentation
  • Proficiency in SQL and at least one scripting language (Python preferred)
  • Familiarity with cloud infrastructure concepts and CI/CD practices
  • Understanding of data modelling concepts (dimensional, medallion architecture)
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ELT/ETL pipelines using Microsoft Fabric and DBT
  • Orchestrate data workflows using Apache Airflow (scheduling, monitoring, alerting)
  • Implement data quality checks, testing frameworks, and data contract standards
  • Collaborate with analytics engineers and BI developers to deliver trusted data products
  • Contribute to data governance, cataloguing, and documentation practices
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

*** Senior Data Engineer - 10 Months+ Contract - Hybrid -Vilnius, Lithuania*** R...
Location
Location
Lithuania , Vilnius
Salary
Salary:
Not provided
redglobal.com Logo
RED Commerce - The Global SAP Solutions Provider
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience as a Data Engineer
  • 7+ years of experience in the overall IT area
  • Strong experience with PySpark and Databricks (AWS environment)
  • Proven experience building data pipelines and implementing Medallion architecture from scratch
  • Excellent communication skills with fluent English (spoken and written)
  • Strong stakeholder management skills with the ability to gather business requirements and translate into technical solutions
  • Able to join within 2-4 weeks of offer
Read More
Arrow Right
New

Senior Data Engineer

We’re looking for a Senior Data Engineer to help scale and evolve our data platf...
Location
Location
United States
Salary
Salary:
150000.00 - 180000.00 USD / Year
helpcare.ai Logo
Helpcare AI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A min of 5+ years of software engineering experience with the last 2-3 years in data engineering, ideally including early-stage or 0→1 environments
  • Strong Python programming experience
  • Advanced proficiency in SQL
  • Proven experience building ETL/ELT pipelines end-to-end
  • Experience with orchestration tools like Airflow
  • Deep understanding of the data lifecycle: ingestion → storage → processing → transformation → serving
  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Experience supporting BI tools (Looker, Tableau, etc.)
  • Familiarity with modern data warehouses (Snowflake, BigQuery, Redshift)
Job Responsibility
Job Responsibility
  • Design and scale our data platform including pipelines, models, and orchestration frameworks
  • Develop scalable ETL/ELT pipelines for ingesting data from APIs, databases, and event streams
  • Define and implement systems for data ingestion, storage, processing, and transformation
  • Build and manage workflow orchestration using tools like Airflow
  • Build semantic layer as well as dashboards
  • Establish best practices for data modeling, testing, and quality
  • Partner with stakeholders to shape data requirements and enable BI and analytics use cases
  • Optimize systems for performance, scalability, and cost from day one
  • Apply software engineering principles (testing, CI/CD, modular design) to data infrastructure
  • Fulltime
Read More
Arrow Right