Senior Data Engineer Job at Microsoft Corporation (Redmond)

Job Description

The M365 Copilot App Platform team delivers the foundational platform that powers the Microsoft 365 Copilot app. We provide the core platform APIs, deployment pipelines, telemetry instrumentation, and infrastructure that enable Copilot experiences across web, Windows, and Mac. Our responsibilities span: - Application and Platform Ownership: From the app code to backend web servers and middle-tier services. - Partner Enablement: All AI-enabled experiences from partner teams are built on our platform, making us critical to their success. - Data and Insights: We manage the data pipeline that supports business insights and operational excellence. - End-to-End Delivery: From platform APIs and infrastructure to deployment and monitoring, ensuring reliability and scalability. Our mission is to empower every Copilot experience by providing a robust, secure, and scalable platform that accelerates innovation across Microsoft 365. As a Senior Data Engineer in the M365 Copilot App Platform team, you will design, build, and optimize scalable data pipelines and platforms that power advanced analytics and AI solutions. You will work closely with software engineers, data scientists, and product teams to ensure reliable, secure, and high-performance data systems that enable innovation across Microsoft’s Copilot ecosystem.

Job Responsibility

Design and implement robust ETL/ELT workflows for structured and unstructured data using modern data engineering frameworks
Build distributed data processing systems leveraging technologies such as Spark, Azure Data Lake, and Synapse
Establish standards for data integrity, lineage, and compliance with enterprise security and privacy policies
Monitor and tune data pipelines for efficiency, scalability, and cost optimization
Develop and maintain low/no-code dashboards and data-driven apps (e.g., Power BI, Vibe-coded apps) to enable self-service analytics for stakeholders
Help maintain and enhance experiment platforms, including Cosmos streams and VC(s), ensuring reliability and scalability for A/B testing and feature experimentation
Partner with cross-functional teams to integrate data solutions into AI products and mentor team members/engineers on best practices
Evaluate emerging technologies and contribute to architectural decisions for next-generation data platforms

Requirements

Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering
OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
OR equivalent experience
3+ years experience in building distributed data processing systems leveraging technologies including, but not limited to, Spark, Azure Data Lake, or Synapse
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have

5+ years of experience in data engineering or software development with a focus on large-scale data systems
2+ years experience developing and maintaining low/no-code dashboards and data-driven apps (e.g., Power BI, Vibe-coded apps) to enable self-service analytics for stakeholders
Proficiency in managing machine learning data pipelines and feature engineering processes
Proficiency in data security, privacy compliance, and governance frameworks
Demonstrate effective communication and collaboration skills in a dynamic, fast-paced environment
Creativity, insightfulness, and sensitivity for a dynamic approach to problem-solving, combined with being motivated and self-driven, are essential

Microsoft Corporation - All Job Offers

Select Country

Senior Data Engineer

Job Description

Job Responsibility

Requirements

Nice to have

Looking for more opportunities?