This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are the Microsoft Data Privacy Platform Team, a part of the Cloud Ecosystem Security (CES) Organization. If you are looking for an opportunity to move the needle on data privacy, then we may be the right team for you. The Data Privacy Platform (DPP) team has been providing internal data privacy products for all Microsoft since 2018, operating these products at high scale and availability. We build reliable, highly scalable, highly performing, and distributed systems for scanning, cataloging, classification, and DSR processing. Our job is to provide privacy infrastructure, to produce meaningful insights about compliance, and to create understandable actions that can be taken to improve. We are leveraging this experience to create new data privacy products to benefit Microsoft and later all our customers. There is a steady stream of new requirements for both our internal and external partners that create exciting opportunities to work on a high scale, impact, and visibility. We're looking for an enthusiastic Data Engineer to help us build and deliver business Intelligence through data for billions of DSRs that are processed for customer’s delete and export requests. Your responsibilities will include working closely with a variety of teams such as Engineering, Program Management, Design and application partners to understand the key business questions for customer-facing scenarios, to set up the key performance indicators, and setup data pipelines to identify insights and experiment ideas that moves our business metrics. We will be looking to you to help evaluate the return of investments on new ideas, to assess if investments are meeting customer and business promises, to design and assess experiments, to measure growth and to derive insights that help identify next wave of opportunities and problems to be solved.
Job Responsibility:
Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios
Collaborate with partner teams and customers to scope and deliver projects
Authoring and designing Big Data ETL pipelines in Python, Spark, Synapse, Kusto, etc
Developing and managing Power BI reports
Data extraction across a wide variety of data sources
Data cleaning, preprocessing, and transformation for further analysis by data analysts
Data Validation framework from source to endpoints ensuring data quality and integrity
Requirements:
Bachelor’s degree in computer science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, Python, Spark, C, C++, C#
Proven design, coding and debugging skills in Python, Spark, C# and PowerBI
Ability to work and communicate effectively across disciplines and teams
Expertise in distributed data processing and analysis using technologies such as Apache Spark
4+ years of expertise in software development with a focus on designing and developing data engineering pipelines
Proven design and problem-solving skills, with an emphasis on quality and engineering excellence
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
4+ years of experience in data engineering
Hands-on experience in architecting and implementing data engineering pipelines with cloud-based tools like Azure Synapse, Azure Data Factory, SQL, Azure Data Explorer, Power BI, and Apache Spark
Skilled in designing and developing Power BI reports
Good analytical skills with a systematic and structured approach to software design
Great curiosity and willingness to question
Strong desire to innovate, ideate and implement the products and processes
High enthusiasm, integrity, ingenuity, results-orientation, self-motivation, and resourcefulness in a fast-paced competitive environment
Nice to have:
Love the next problem, the next experiment, the next partner
Have a deep desire to work collaboratively, solve problems with groups, find win/win solutions, and celebrate successes
Get excited by the challenge of hard technical problems
Solve problems by always leading with deep passion and empathy for customers
Deliver the projects on time with great collaboration with stake holders
Should be great team player, willing to help others and take help from others
Exhibit a growth mindset by continuously developing skills, remaining flexible in the face of change, and actively seeking feedback to improve individual performance and strengthen the team's overall effectiveness