Job Description:
Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture. Within Azure Data, the Microsoft Fabric platform team builds and maintains the operating system and provides customers a unified data stack to run an entire data estate. The platform provides a unified experience, unified governance, enables a unified business model and a unified architecture. The Fabric Data & Telemetry team is part of the Fabric Platform. It is responsible for all platform capabilities in support of “observability” – From telemetry creation (APIs, event repositories, etc.), through routing and storage, to eventual consumption tools and data models. This observability is critical for the service and business and supports pillars such as live-site monitoring, diagnostics, analytics for operations and product development, and ensuring Fabric customers have high quality data for their own observability needs. The charter of the team is to provide Fabric stakeholders, partners and clients with world-class data for running the Service and Business. The team and its members work across different codebases, disciplines, platform components and observability pillars. In particular, the team is required to function within the service core, applying classic cloud and software engineering practices and tools, as well as a core-data team, applying (big) data-engineering and analytical practices and tools. As a software Engineer on the team, you will play a key role in shaping the future of our platform. Using the latest Azure technologies, you will design and build scalable telemetry infrastructure and instrumentation services, create data pipelines and facilitate the access of the telemetry data to our users, create tools that help team self-serve their data needs, and act as an advisor for partner team to guide them on how to instrument their internal and external telemetry events , you will create job monitoring and notification services for data pipelines, and streamline daily operations through automation. As a Principal Software Engineer on the team, you will serve as the technical lead for our data platform, driving architectural direction and long term strategy while solving complex scalability challenges across distributed processing systems. You will act as the connective layer between infrastructure and data engineering teams, ensuring our telemetry platform, pipelines, and services operate reliably and efficiently at massive scale. You will design and guide the implementation of high performance, cost efficient big data solutions, advise partner teams on optimal data models and architectural patterns, and influence engineering decisions across the organization through deep technical expertise and strong cross team collaboration.
