CrawlJobs Logo

Senior Software Engineer - Distributed Systems

Canada, Vancouver 114400.00 - 203900.00 CAD / Year · Job Posted March 19, 2026
Apply Position
Job Link Share

Job Description

Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture. Within Azure Data, the messaging and real-time intelligence team provides comprehensive solutions and a robust platform that enables users to ingest high granularity signals (real-time & observability) and complex data, converting those into a competitive advantage in real-time for both end users and modern applications. The Azure Messaging team is hiring a Senior Software Engineer to help shape the next generation of our platform and control plane infrastructure. Our services handle tens of thousands of requests every second with low latencies, acting as the reliable backbone for customers across the globe. We're looking for dedicated, creative distributed systems engineers who are passionate about solving complex problems at scale. In this role, you’ll work on high-impact components that serve as the entry point for Azure Messaging services. Your work will be central to how customers configure and interact with our platform. As a Senior Software Engineer, you will lead the design and implementation of critical distributed systems that operate at massive scale within Azure messaging services. You will own complex technical problems, influence system architecture, and raise the engineering bar for quality, reliability, and operational excellence across the team. Beyond the core platform, the team applies its deep messaging expertise to power strategic scenarios in Microsoft Fabric — a completely managed SaaS offering. We enable the seamless ingestion, transformation, and cataloging of streaming data, helping customers unlock real-time insights with minimal operational overhead. This is a unique opportunity to be part of a team that operates at the heart of Azure’s messaging stack, where your contributions will directly influence the growth and reliability of the platform while enabling new experiences across Microsoft’s data ecosystem.

Job Responsibility

  • Drive the design and implementation of complex, large-scale distributed systems by producing technical designs, proof-of-concepts, and prototype solutions from ambiguous or high-level requirements
  • Own end-to-end delivery of key system components, including design tradeoffs, implementation, testing strategy, deployment, and long-term operability
  • Continuously improve system performance, scalability, and resilience by identifying architectural gaps, leading refactoring efforts, and addressing systemic technical debt
  • Define and apply metrics, best practices, and quality bars to ensure long-term service stability, operational excellence, and strong return on engineering investment
  • Lead code reviews and design discussions, setting technical direction and mentoring engineers to improve overall code quality and system design maturity
  • Collaborate across teams and organizations to align designs, influence dependencies, and deliver solutions that scale across Azure
  • Build and evolve the core messaging infrastructure that underpins hundreds of thousands of Azure applications, supporting critical platform capabilities such as eventing, asynchronous workflows, telemetry, and diagnostics.

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • 3+ years experience with distributed messaging systems such as Azure Service Bus, Apache Kafka, RabbitMQ, Google Pub/Sub, or SQS/Kinesis or experience with stream processing or real-time data platforms such as Apache Spark, Flink, Storm, or similar frameworks
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice to have

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience designing and owning components of distributed systems, including handling scalability, reliability, and operational concerns
  • Experience driving technical design discussions, authoring design documents, and making sound architectural tradeoffs
  • Proficient collaboration skills with the ability to work effectively across teams and disciplines
  • Experience participating in on-call rotations and owning live-site health and operational excellence for services
  • Experience leading the design, implementation, and operation of critical, large-scale cloud service components, preferably on Azure or a comparable cloud platform
  • Deep understanding of distributed systems concepts such as replication, partitioning, consistency models, and failure recovery
  • Experience with messaging platforms, eventing systems, or high-throughput data pipelines
  • Demonstrated ability to mentor engineers and raise the technical bar through code reviews, design feedback, and knowledge sharing
  • Experience driving reliability, performance, or security improvements across multiple components or services.

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer - Distributed Systems

8 matching positions

Senior Software Engineer - Distributed Systems

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
Canada , Vancouver
Salary
Salary:
114400.00 - 203900.00 CAD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • 2+ years experience with enterprise level batch or streaming systems, SQL query writing, or optimizing large-scale distributed systems
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design, implement, test, deploy, and operate features for a high-throughput, multi-tenant, real-time streaming service, with a focus on reliability, performance, and scalability
  • Serve as a technical leader, guiding the team through complex design and engineering challenges while helping raise the overall quality and effectiveness of the system
  • Continuously evaluate and adopt new technologies, patterns, and best practices to improve availability, reliability, efficiency, observability, and performance, including driving improvements in monitoring and large-scale operations
  • Partner across teams to improve monitoring, diagnostics, and operational readiness for large‑scale deployments, ensuring faster detection, diagnosis, and resolution of production issues
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Distributed Systems

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
Canada , Vancouver
Salary
Salary:
114400.00 - 203900.00 CAD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 2+ years professional experience building large scale enterprise level distributed systems
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Leads by example within the team by producing extensible and maintainable. Optimizes, debugs, refactors, and reuses code to improve performance and maintainability, effectiveness, and return on investment (ROI). Applies metrics to drive the quality and stability of code, as well as appropriate coding patterns and best practices
  • Applies debugging tools and examines logs, telemetry, and other methods to verify assumptions through writing and developing code proactively before issues occur and reactively as issues occur for products. Conducts retrospective debugging of solutions to identify root causes of problems
  • Reviews the code of a product to assure it meets the team's and Microsoft’s quality standards, is reliable and accurate, and is appropriate for the scale of the product/solution area. Applies feedback to current and future iterations. Participates in code reviews to ensure coding standards are followed. Considers diagnosability, reliability, and maintainability when reviewing code, and understands when code is ready to be shared or delivered. Applies and screens for coding patterns and best practices in reviews, and provides feedback on code to drive adherence to best practices
  • Leads discussions for the architecture of products/solutions and creates proposals for architecture by testing design hypotheses and helping to refine code plans. Provides reactions, proposed solutions, and inputs to architects. Partially owns solutions for architecting of solutions, with minimal technical oversight. Develops design documents for designs or User Stories, and determines the technology that will be leveraged and how it will interact. Shares learnings and identified solutions from investigations with the team and owns for some design decisions. Assures system architecture meets security and compliance requirements and expectations
  • Independently creates a clear and articulated plan for testing and assuring quality of solutions, and defines success for outcomes of tests (e.g., unit tests). Identifies needs for a broad versus selected approach in testing mechanisms and makes informed decisions to implement the most effective tests. Drives efforts to add new tests, remove antiquated tests, and aggregate tests to improve the test suite. Improves recommendations to the team and augments test cases to ensure that solutions have good test coverage. Drives efforts to continually integrate automation features when planning for testing
  • Drives identification of dependencies and the development of design documents for a product, application, service or platform. Identifies other teams and technologies that will be leveraged, how they will interact, and when one's own system may provide support to others. Determines back-end dependencies associated with product, application, service, or platform functionality for the solution/product area. Understands up and downstream effects of solutions and work provided to ensure appropriate security and performance, drives reliability in the solutions, and optimizes dependency chains and retrieves across teams
  • Collaborates with appropriate stakeholders (e.g., project manager, technical lead) to align on user requirements for a scenario. Leverages a variety of feedback channels to incorporate insights into future designs or solution fixes. Ensures appropriate continuous feedback loops measuring customer value, usage patterns, and other actionable metrics of value are incorporated
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes)

We are seeking Full Stack/Back End Software Engineers who are passionate about m...
Location
Location
United States , San Francisco, California
Salary
Salary:
229900.00 - 286200.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree
  • At least 6 years of experience in software engineering
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Lead a portfolio of diverse technology projects and a team of developers with deep experience in distributed microservices, and full stack systems to create solutions that help meet regulatory needs for the company
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, mentoring other members of the engineering community, and from time to time, be asked to code or evaluate code
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Utilize programming languages like JavaScript, Java, HTML/CSS, TypeScript, SQL, Python, and Go, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • Comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes)

Do you love building and pioneering in the technology space? Do you enjoy solvin...
Location
Location
United States , San Francisco; McLean; New York; San Jose; Cambridge
Salary
Salary:
229900.00 - 286200.00 USD / Year
capitalone.com Logo
Capital One
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree
  • At least 6 years of experience in software engineering
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Job Responsibility
Job Responsibility
  • Lead a portfolio of diverse technology projects and a team of developers with deep experience in distributed microservices, and full stack systems to create solutions that help meet regulatory needs for the company
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, mentoring other members of the engineering community, and from time to time, be asked to code or evaluate code
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Utilize programming languages like JavaScript, Java, HTML/CSS, TypeScript, SQL, Python, and Go, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services
What we offer
What we offer
  • Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits
  • Fulltime
Read More
Arrow Right

Senior Staff Software Engineer - Distributed Systems

Fivetran is building data pipelines to power the modern data stack for thousands...
Location
Location
Germany
Salary
Salary:
Not provided
fivetran.com Logo
Fivetran
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of hands-on or research experience maintaining and operating high-performance containerized applications that span multiple services
  • Deep understanding of cloud infrastructure, deployment, service orchestration, software optimizations and performance engineering of highly distributed services
  • Proven track record of leading and delivering large and complicated projects
  • Strong development skills in Java
  • Experience running and debugging Kubernetes containerized services
  • Solid experience with public clouds (AWS, Azure, GCP)
  • Growth mindset and excitement about breaking the status quo by seeking innovative solutions
  • Excellent team player who is consistent in making everyone around you better
Job Responsibility
Job Responsibility
  • Partner closely with product teams to understand requirements and design cutting-edge new capabilities that go directly into customer’s hands
  • Design, develop, implement, and operate highly reliable large-scale data lake systems in cooperation with a dedicated data lake engineering team and our SRE teams
  • Drive significant performance, latency, and availability improvements for our data lake services
  • Ensure operational excellence of the services and meet the commitments to our customers regarding security, reliability, availability, and performance
  • Investigate and resolve fault-tolerance and high availability issues as well as performance and scale challenges both inside and across service boundaries
  • Contribute to open-source projects such as DuckDB and Apache Polaris
  • Embrace Fivetran innovations with open-source standards and toolsets
  • Set technical directions and influence cross-functional teams
What we offer
What we offer
  • 100% employer-paid medical insurance*
  • Generous paid time-off policy (PTO), plus paid sick time, inclusive parental leave policy, holidays, and volunteer days off
  • RSU stock grants*
  • Professional development and training opportunities
  • Company virtual happy hours, free food, and fun team-building activities
  • Monthly cell phone stipend
  • Access to an innovative mental health support platform that offers personalized care and resources in areas such as: therapy, coaching, and self-guided mindfulness exercises for all covered employees and their covered dependents
  • Fulltime
Read More
Arrow Right

Backend Software Engineer / Senior Software Engineer- Kusto

Are you excited by the challenge of redefining how people explore and analyze ma...
Location
Location
Israel , Tel Aviv, Herzliya
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of technical engineering experience with coding in languages including, but not limited to, C#, Python or Java
  • 2+ years building and running services in a cloud environment (Azure, AWS, or GCP)
  • Experience in designing and operating large-scale distributed systems with high availability and reliability
Job Responsibility
Job Responsibility
  • Design, develop, and improve cloud-native services that are scalable, secure, and easy to operate
  • Drive architectural decisions and lead the development of major components in a distributed, high-SLA system
  • Collaborate with cross-functional teams in ILDC and abroad to deliver end-to-end solutions
  • Conduct code and design reviews and mentor junior engineers to grow technical excellence across the team
  • Help shape the future of real-time analytics in Microsoft Fabric RTI, with customer impact as your north star
  • Fulltime
Read More
Arrow Right

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Software Engineer II & Senior Software Engineer

Security represents the most critical priorities for our customers in a world aw...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, C, C++, C#, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Experience with Troubleshoot and optimize automation, reliability, and monitoring for Live Site running as part of an on-call rotation owned by engineering team
  • Experience with distributed systems, messaging systems like Kafka etc - Large scale system design
Job Responsibility
Job Responsibility
  • Lead the architecture, design and implementation of services for extremely high scale, throughput, durability, and low latency
  • Innovate and make service deployment and maintenance an efficient well-oiled machine that provides excellent reliability with minimal manual engineer intervention
  • Ability to conduct in-depth triage, troubleshooting, and forensics across all facets of the cloud stack while executing processes corrective action and continual service improvement
  • Drive Infrastructure security improvements for mission critical high scale workloads
  • Lead the definition of requirements, KPIs, priorities and planning of engineering deliverables
  • Mentor and grow the energetic, diverse, and driven team with a good mix of senior and mid-level
  • Fulltime
Read More
Arrow Right