CrawlJobs Logo

Senior Software Engineer - Azure Data Engineering Team

Canada, Vancouver 114400.00 - 203900.00 CAD / Year · Job Posted June 10, 2026
Apply Position
Job Link Share

Job Description

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world. Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture. Within Azure Data, the messaging and real-time analytics team provides comprehensive solutions and a robust platform that enables users to ingest high granularity signals (real-time & observability) and complex data, converting those into a competitive advantage in real-time for both end users and modern applications. The Azure Messaging team is hiring a Senior Software Engineer to help shape the next generation of our platform and control plane infrastructure. Our services handle tens of thousands of requests every second with low latencies, acting as the reliable backbone for customers across the globe. We're looking for dedicated, creative distributed systems engineers who are passionate about solving complex problems at scale. In this role, you’ll work on high-impact components that serve as the entry point for Azure Messaging services. Your work will be central to how customers configure and interact with our platform. As a Senior Software Engineer, you will lead the design and implementation of critical distributed systems that operate at massive scale within Azure messaging services. You will own complex technical problems, influence system architecture, and raise the engineering bar for quality, reliability, and operational excellence across the team. Beyond the core platform, the team applies its deep messaging expertise to power strategic scenarios in Microsoft Fabric — a completely managed SaaS offering. We enable the seamless ingestion, transformation, and cataloging of streaming data, helping customers unlock real-time insights with minimal operational overhead. This is a unique opportunity to be part of a team that operates at the heart of Azure’s messaging stack, where your contributions will directly influence the growth and reliability of the platform while enabling new experiences across Microsoft’s data ecosystem. We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.

Job Responsibility

  • Drive the design and implementation of complex, large-scale distributed systems by producing technical designs, proof-of-concepts, and prototype solutions from ambiguous or high-level requirements
  • Own end-to-end delivery of key system components, including design tradeoffs, implementation, testing strategy, deployment, and long-term operability
  • Continuously improve system performance, scalability, and resilience by identifying architectural gaps, leading refactoring efforts, and addressing systemic technical debt
  • Define and apply metrics, best practices, and quality bars to ensure long-term service stability, operational excellence, and strong return on engineering investment
  • Lead code reviews and design discussions, setting technical direction and mentoring engineers to improve overall code quality and system design maturity
  • Collaborate across teams and organizations to align designs, influence dependencies, and deliver solutions that scale across Azure
  • Build and evolve the core messaging infrastructure that underpins hundreds of thousands of Azure applications, supporting critical platform capabilities such as eventing, asynchronous workflows, telemetry, and diagnostics
  • Embody our culture and values

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice to have

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience designing and owning components of distributed systems, including handling scalability, reliability, and operational concerns
  • Experience driving technical design discussions, authoring design documents, and making sound architectural tradeoffs
  • Proficient collaboration skills with the ability to work effectively across teams and disciplines
  • Experience participating in on-call rotations and owning live-site health and operational excellence for services
  • Experience leading the design, implementation, and operation of critical, large-scale cloud service components, preferably on Azure or a comparable cloud platform
  • Deep understanding of distributed systems concepts such as replication, partitioning, consistency models, and failure recovery
  • Experience with messaging platforms, eventing systems, or high-throughput data pipelines
  • Demonstrated ability to mentor engineers and raise the technical bar through code reviews, design feedback, and knowledge sharing
  • Experience driving reliability, performance, or security improvements across multiple components or services
  • 3+ years experience with distributed messaging systems such as Azure Service Bus, Apache Kafka, RabbitMQ, Google Pub/Sub, or SQS/Kinesis or experience with stream processing or real-time data platforms such as Apache Spark, Flink, Storm, or similar frameworks

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer - Azure Data Engineering Team

8 matching positions

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Software Engineer 2 / Senior Software Engineer

We are looking for an experienced Software Engineers for our Bangalore location ...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
komprise.com Logo
Komprise, Inc.
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Solid grasp of computer science fundamentals and especially data structures, algorithms, multi-threading
  • Ability to solve difficult problems with a simple elegant solution
  • Should have solid object-oriented programming background with impeccable design skills
  • Experience in developing management applications and performance management applications is ideal
  • Experience with object-based file systems and REST interfaces is a plus (e.g. Amazon S3, Azure, Google Cloud Service)
  • Should have a BE or higher in CS, EE, Math or related engineering or science field
  • At least 5+ years of experience in software deployment
  • Tech Stack: Java, Maven Virtualisation, SaaS, Github, Jira, Slack, Cloud Solutions and Hypervisors
Job Responsibility
Job Responsibility
  • Responsible for designing and developing features that powers Komprise data management platform to manage billions of files and petabytes of data
  • Responsible for designing of major components and systems of our product architecture, ensuring that Komprise data management platform is highly available and scalable
  • Responsible for writing performance code, evaluate feasibility, develop for quality and optimize for maintainability
  • Work in agile, customer focused and fast paced team with direct interaction with the customers
  • Responsible for analysing customer escalated issues and provide resolutions in a timely manner
  • Should be able to design and implement highly performant, scalable distributed systems
Read More
Arrow Right

Senior Data Software Engineer (Python & PySpark) - Vice President

The Senior Data Software Engineer is a senior level position responsible for est...
Location
Location
Singapore , Singapore
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field
  • 7+ years of experience in data engineering, with a strong focus on Python and big data technologies
  • Proven expertise in designing and implementing large-scale data processing solutions using PySpark
  • Extensive experience with distributed computing frameworks like Apache Spark
  • Strong understanding of data warehousing concepts, dimensional modeling, and ETL/ELT principles
  • Proficiency in SQL and experience with various relational and NoSQL databases
  • Experience with cloud platforms (AWS, Azure, GCP) and their data services (e.g., S3, ADLS, Google Cloud Storage, Redshift, Snowflake, BigQuery, Databricks)
  • Familiarity with workflow orchestration tools (e.g., Apache Airflow, Azure Data Factory, AWS Step Functions)
  • Experience with version control systems (e.g., Git)
  • Excellent problem-solving, analytical, and communication skills.
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Data Platform, AI Infrastructure

We are building a large-scale, productized data platform that powers critical in...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
  • Strong programming experience in Python
  • Experience building and operating large-scale distributed systems
  • Hands-on experience with: Backend services or APIs (e.g., FastAPI, Flask, or similar)
  • Cloud-based infrastructure (Azure, AWS, or GCP)
  • Monitoring and observability systems (metrics, logging, alerting)
  • Experience designing systems with reliability, scalability, and operational clarity in mind
  • Proven ability to own and deliver production systems end-to-end
  • Ability to break down ambiguous problems, ask the right questions, and execute effectively
Job Responsibility
Job Responsibility
  • Design, build, and operate core components of a distributed data platform, including: Orchestration systems (e.g., Airflow or equivalent)
  • Backend services and APIs (Python/FastAPI or similar)
  • Monitoring, alerting, and reliability systems
  • Own the end-to-end lifecycle of platform components - from design through deployment, scaling, and maintenance
  • Ensure systems meet requirements for availability, performance, and data reliability at large scale
  • Define and enforce standardized patterns for infrastructure, deployment, and observability across the platform
  • Partner with data engineering teams to enable efficient, reliable data processing workflows
  • Diagnose and resolve complex issues in distributed systems, including performance bottlenecks and failure modes
  • Contribute to infrastructure-as-code and deployment systems to support reproducibility and operational excellence
  • Drive continuous improvements in system robustness, cost efficiency, and operational clarity
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Azure Database

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
United States , Multiple Locations
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Work on a team of world-class engineers, constantly learning, teaching, and collaborating to achieve excellence
  • Develop, test, and check-in code to deliver the best possible product to our customers
  • Makes decisions driven by data and customer feedback, allowing us to solve issues and make improvements in a timely and efficient manner
  • Invests time in building robust engineering systems that reduce overhead and enable us to focus on new challenges
  • Embraces open-source technologies and are always on the lookout for opportunities to use existing solutions
  • Solves problems by always leading with empathy for our customers
  • Looks forward to the next problem, the next experiment, the next partner
  • Work collaboratively, solve problems with groups, find win/win solutions and celebrate successes
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Data Science

Microsoft’s Azure Data engineering team is leading the transformation of analyti...
Location
Location
Spain , Multiple Locations
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, or related technical discipline AND proven experience in industry software engineering experience
  • Substantial experience in programming experience as data scientist
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Design and develop world-class experience for new big data cloud offering
  • Plan, schedule and deliver quality software incrementally
  • Review changes to product codebase and provide constructive feedback that align with industry best practices
  • Maintain and operate cloud online services
  • Passion and experience for building great developer experience and user experience of modern analytics systems
  • Have a deep desire to work collaboratively, solve problems with teams across the world and celebrate successes
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Engineer – Software Engineering

GEICO is seeking an experienced Engineer with a passion for building high-perfor...
Location
Location
United States , Chevy Chase; Palo Alto; Seattle
Salary
Salary:
105000.00 - 215000.00 USD / Year
geico.com Logo
Geico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Fluency and specialization in Go
  • Experience with designing, developing, implementing, and maintaining solutions for microservices
  • Hands on experience working with Kubernetes
  • Hands on experience developing Infrastructure within AWS OR GCP OR AZURE
  • Ability to excel in a fast-paced, startup-like environment
  • Experience building the architecture and design (architecture, design patterns, reliability, and scaling) of new and current systems
  • Strong problem-solving abilities and a proactive approach to identifying and mitigating security risks and vulnerabilities
  • Excellent communication skills, able to communicate complete technical concepts to technical and non-technical stakeholders
  • 4+ years of professional experience in software engineering
  • 2+ years of experience with security, identity, architecture, and design
Job Responsibility
Job Responsibility
  • Team up with architects, scrum masters, leads, managers, and directors, you will work in an Agile environment for Identity & Access Management organization's needs
  • You will be working in a team to build our next generation of Identity platform in Azure
  • You will be trailblazing to apply Software Development techniques such as Automated Testing and CI/CD to building software products
  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
  • You should be intellectually curious, have a solutions-oriented attitude, and enjoy learning new tools and techniques
  • Stay at the forefront of emerging identity trends, technologies, and best practices, and apply this knowledge to enhance GEICO’s data protection strategies
What we offer
What we offer
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
  • Financial benefits including market-competitive compensation
  • a 401K savings plan vested from day one that offers a 6% match
  • performance and recognition-based incentives
  • and tuition assistance
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Platform

We are seeking a senior software engineer to help grow our data platform as Stra...
Location
Location
United States , San Francisco
Salary
Salary:
180000.00 - 200000.00 USD / Year
strava.com Logo
Strava
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience developing data-intensive software using languages like Python, Scala, Java, Go, or Ruby
  • Ability to evaluate and adopt new technologies as business needs evolve
  • Comfortable reading and reasoning about SQL queries in data pipeline contexts (e.g., dbt models)
  • Understanding how transformations impact downstream systems
  • Hands-on experience working with distributed data processing tools (e.g., Spark, Flink, Kafka) on production datasets
  • Understanding of tradeoffs and appropriate use cases for data processing tools
  • Experience building or maintaining data pipelines using cloud data warehouses (e.g., Snowflake, BigQuery, Redshift), Data lakes (e.g., Iceberg, Hudi) or similar solutions
  • Understanding of performance optimization and cost considerations
  • Understand the underlying infrastructure needed to serve production data platforms (e.g., Kubernetes, AWS, GCP, Azure)
  • Experience deploying and managing data infrastructure components like clusters, storage systems, and compute resources
Job Responsibility
Job Responsibility
  • Collaborate with people across teams and functions that hold deep curiosity for data
  • Work with hefty data systems at the global scale of Strava, supporting functions including analytics, AI/ML, engineering, and finance
  • Help strengthen our infrastructure as we grow
  • Deliver value more through software, leaning into tooling and automation rather than repetitive toil
  • Grow your expertise in the steadily evolving technologies and ecosystem of data
  • Building scalable software solutions to existing data problems utilizing modern data technologies
  • Writing high quality and reliable code that supports our end user experience
  • Understanding that data security and privacy is of utmost importance
  • Holding empathy for the users of our platform to truly understand the challenges we address for them
  • Fostering an inclusive and motivating team culture to help everyone achieve their best
  • Fulltime
Read More
Arrow Right