CrawlJobs Logo

Software Engineer II - Azure Data Analytics

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
Canada , Vancouver

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

85000.00 - 166800.00 CAD / Year

Job Description:

Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture. Within Azure Data, the big data analytics team provides a range of products that enable data engineers and data scientists to extract intelligence from all data – structured, semi-structured, and unstructured. We build the Data Engineering, Data Science, and Data Integration pillars of Microsoft Fabric. The Fabric Data Engineering Experience & Infrastructure team is looking for a passionate engineer to help build the next generation of infrastructure services for Microsoft Fabric Data Engineering, powered by Apache Spark. If you enjoy working on high-scale distributed systems, developer experiences, and platform infrastructure that makes engineers more productive, this is a great place to do it.

Job Responsibility:

  • Design and develop world-class experiences for a new big data cloud offering, with an emphasis on scale, reliability, and performance.
  • Build and evolve core infrastructure services that power data engineering and analytics workloads (compute, runtime services, job/session management, configuration, and platform integrations).
  • Drive technical design and implementation end-to-end: translate requirements and documentation into robust production code.
  • Troubleshoot and improve systems using source code analysis and production instrumentation (logs, metrics, traces), and turn operational learnings into engineering improvements.
  • Improve platform scalability, resiliency, and observability, including automation to reduce operational toil.
  • Partner closely with product and engineering teams to deliver end-to-end features and continuously raise the quality bar.
  • Embody our culture and values.

Requirements:

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice to have:

  • Experience designing and operating large-scale infrastructure for data platforms or compute services (e.g., job orchestration, runtime services, cluster/resource management, multi-tenant systems).
  • Experience with observability and operational excellence (SLOs/SLIs, alerting, incident response, postmortems).
  • Performance and reliability engineering experience (profiling, optimization, capacity planning, cost/performance tradeoffs).
  • Familiarity with modern cloud-native patterns (service ownership, CI/CD, safe deployments, automation).
  • Software engineering fundamentals (data structures, algorithms, testing, debugging, performance).
  • Experience building and shipping production infrastructure (backend services, distributed systems, or platform components) in a cloud environment.
  • Solid understanding of distributed systems concepts: fault tolerance, scaling, scheduling, and resource management.
  • Proficiency in one or more backend/system languages (e.g., Java, Scala, C#, C++, or Python).
  • Quick learner with a growth mindset—able to ramp up rapidly in new domains, tools, and codebases.
  • Ability to thrive in an AI-powered engineering environment: comfortable adopting AI-assisted workflows (e.g., copilots/agents), iterating quickly, and continuously improving productivity and quality.

Additional Information:

Job Posted:
March 03, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Software Engineer II - Azure Data Analytics

Data Engineer II

As a Data Engineer II on our Core Engineering Data Team, you will focus on build...
Location
Location
United States , Boston
Salary
Salary:
93200.00 - 136600.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field or equivalent practical experience
  • 2+ years of experience in software engineering, data engineering, or a related field
  • Foundational knowledge of AWS or other public cloud platforms (e.g., Azure, GCP)
  • Strong SQL knowledge and experience optimizing for data warehousing technologies like AWS Athena
  • Strong knowledge of Python for use in data transformation
  • Experience with ETL/ELT, schema design, and datalake technologies
  • Familiarity with various data and table formats (JSON, Avro, Parquet, Iceberg)
  • Love of data and a passion for building reliable data products
Job Responsibility
Job Responsibility
  • Develop and maintain efficient and reliable ETL/ELT data pipelines from product and service data sources to our centralized analytical platforms
  • Implement and monitor data pipeline orchestration using tools like Airflow or Dagster to ensure timely and accurate data delivery
  • Collaborate with senior engineers and analysts to understand requirements and implement technical solutions for data workflows
  • Perform routine monitoring of pipeline performance and reliability, assisting with troubleshooting and optimizing for efficiency
  • Contribute to the optimization of table structures and data storage to support various query and usage patterns
  • Support and maintain data discovery, catalog, and analytics tooling for internal teams
  • Assist in implementing data security measures and ensuring compliance with data governance policies
  • Write and maintain data quality validation checks and unit tests to ensure the integrity and reliability of data pipelines
  • Participate in team-wide discussions to help develop and refine team norms and engineering best practices
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits
  • Fulltime
Read More
Arrow Right

Software Development Engineer II

A leader in vision AI solutions for the world’s leading retailers. Transforming ...
Location
Location
Serbia , Belgrade
Salary
Salary:
Not provided
everseen.ai Logo
Everseen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2-3 years of work experience in a relevant role
  • Bachelors degree or equivalent focusing on the computer science field is preferred
  • In-depth knowledge of Python
  • Comfortable working with UNIX like environments
  • In-depth knowledge of advanced concepts like microservices and distributed systems
  • Hands-on experience with cloud platforms such as Microsoft Azure, Amazon Web Services (AWS), or other equivalent cloud environments
  • Understanding of basic monitoring services (e.g., CloudWatch, Azure Monitor, Prometheus, Grafana)
  • Proven ability to deploy, package, manage, and monitor applications in a cloud environment (e.g., Docker, CI/CD pipelines)
  • Strong interest in machine learning, data science, or related fields
  • Broad understanding of the software engineering and architecture space, including knowledge of various programming languages, frameworks, techniques, and industry trends in AI
Job Responsibility
Job Responsibility
  • Design and develop new features and functionalities
  • Design and implement reusable, testable, efficient, and elegant code based on requirements
  • Create, maintain, and run unit tests for both new and existing applications and services
  • Analyze and collect data from various sources such as log files, application stack traces, and thread dumps
  • Create and maintain CI/CD integration using various tools
  • Evaluate and integrate third-party software solutions to optimize system performance
  • Update and track third-party solutions' compatibility with Everseen stack according to internal development guidelines
  • Monitor production logs to identify and troubleshoot issues promptly
  • Responsible for creating, maintaining, and updating technical documentation
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Copilot and Platform Ecosystem (CAPE) team at Microsoft is responsible for e...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Partner with stakeholders to define and document data requirements (access, cadence, ownership) and assess feasibility and total cost of ownership (TCO).
  • Define data contracts and ownership boundaries with upstream system owners.
  • Design and maintain scalable data pipelines that ingest and load data into analytical platforms (e.g., Azure Data Explorer/Kusto).
  • Implement data validation and quality checks to meet SLAs for accuracy, completeness, freshness, and reliability.
  • Build orchestration and automation for dependable, repeatable data movement.
  • Transform and model data (joins, aggregations, enrichment) to power downstream datasets, dashboards, alerts, and agent experiences
  • contribute through code reviews and shared tooling.
  • Operationalize pipelines with monitoring, troubleshooting/runbooks, root-cause analysis, performance/cost optimization, and compliance/governance (classification, tagging, lineage, and access control).
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Windows and Devices mission is to build innovative, trusted, and open produc...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience
  • Proficiency in programming languages such as Python, Scala and strong experience with SQL and big data technologies (Hadoop, Spark)
  • Knowledge of Microsoft Fabric components and ecosystem (e.g., OneLake, Data Factory, Synapse)
Job Responsibility
Job Responsibility
  • Drive critical initiatives to help our data platform scale to meet business priorities and advances in technology
  • Build scalable data models and pipelines to extract, load, and transform data, ensuring secure storage with a focus on data quality and compliance on Azure using services such as ADF, HDInsight, Fabric, and Synapse
  • Develop and build datasets, and collaborate with data scientists, analysts, and architects to understand requirements and deliver solutions that support AI/ML pipelines, feature engineering, and Co-Pilot applications
  • Implement and manage CI/CD pipelines (YAML and Classic) for data engineering projects using Azure DevOps
  • Anticipate data governance needs, design modeling and handling procedures, and ensure compliance with laws and policies governing data accessibility
  • Contribute in design and maintain enterprise ontologies and semantic models to support AI and knowledge graph initiatives
  • Fulltime
Read More
Arrow Right

Data Engineer II

Do you have a relentless passion for data engineering and building platforms tha...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering. OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering. OR equivalent experience.
  • Ability to work and communicate effectively across disciplines and teams.
  • Familiarity with distributed data processing and analysis, such as Map-Reduce or Apache Spark.
Job Responsibility
Job Responsibility
  • Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C#.
  • Data extraction across a wide variety of data sources.
  • Data cleaning, preprocessing, and transformation for further analysis by data analysts.
  • Data Validation framework from source to endpoints ensuring data quality and integrity.
  • Enable the Data Scientists and Analysts to do more with data across all aspects of the development lifecycle.
  • Contribute to a data-driven culture as well as a culture of experimentation across the organization.
  • Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios.
  • Enable Data Scientists and other partners to do more with data across all aspects of the development lifecycle by helping democratize data.
  • Fulltime
Read More
Arrow Right

Data Engineer II

At Retail Insight, we turn data into action. Our products are trusted by some of...
Location
Location
United States , Chicago
Salary
Salary:
85000.00 - 110000.00 USD / Year
retailinsight.io Logo
Retail Insight
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in data or analytics engineering, with strong foundations in data warehousing, ETL/ELT, and large‑scale analytics environments
  • Hands‑on expertise with SQL‑based databases (MS SQL Server, Azure SQL, Postgres) and cloud platforms such as Azure and Snowflake
  • Strong SQL skills plus working knowledge of Python, PowerShell, and integrating data via APIs
  • Familiarity with agile delivery, GitHub, Atlassian tooling, and production troubleshooting/incident resolution
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data pipelines across ingestion, transformation, orchestration, monitoring, and quality assurance
  • Develop and optimise data solutions, including database schemas and SQL performance tuning to ensure reliable, accessible data for analytics and downstream systems
  • Integrate data solutions into production environments, collaborating with software engineers and supporting delivery for new and existing clients
  • Write clean, maintainable code and documentation, covering SQL, Python, PowerShell, models, pipelines, and platform architecture
  • Support production operations, providing 3rd‑line incident investigation/resolution and contributing to code reviews and engineering best practices
What we offer
What we offer
  • Hybrid & Flexible Working: Work from anywhere benefits, plus summer hours and extra days off for life’s big moments (including your birthday and wedding)
  • Generous Time Off: 26 days PTO (increasing with service), paid volunteer days, and full support for your wellbeing, including mental health resources
  • Career & Learning: Access to a top-tier learning platform, career progression plans, and support to create your ideal home workspace
  • Health & Financial Benefits: Comprehensive medical, dental, and vision coverage, plus a 6% matched retirement plan
  • Personal Perks: Annual phone reimbursement, onsite gym access, and customizable benefits via our online platform
  • Fulltime
Read More
Arrow Right

Software Engineer II

Does pioneering new and innovative ways to collect and showcase key customer dat...
Location
Location
India , Noida
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • At least 4 years' experience in software engineering, programming or development
  • Software programming experience in C#, Java, or C++
  • Experience with at least one of the following scripting languages: PowerShell, Python, Perl, JavaScript or Ruby (for data manipulation and automation tasks)
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
Job Responsibility
Job Responsibility
  • Responsible for the technical leadership and end-to-end development of the data solutions that will help E+D and SCI gain the strategic insights we need to deliver the most optimal user experience and to quickly adapt to market conditions that are constantly evolving
  • Apply your engineering and analytical skills to petabyte scale data problems using the latest and most modern data analytics technologies on an ever-increasing number of data signals produced by the different products part of the M365 suite and our partners across the company
  • Face tough engineering challenges every day as we deal with very large, disparate and usually complex data sets as we aim to provide an efficient and reliable platform for data wrangling and curation
  • The integration of different data democratization and visualization techniques will also enable us to extract even the most deeply embedded insights from this data to then make those insights readily available to everyone in our organization, affording them the flexibility of analyzing said data in a self-service manner
  • Fulltime
Read More
Arrow Right

Software Engineer II

We are the Microsoft Data Privacy Platform Team, a part of the Cloud Ecosystem S...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, Python, Spark, C, C++, C#
  • Proven design, coding and debugging skills in Python, Spark, C# and PowerBI
  • Ability to work and communicate effectively across disciplines and teams
  • Expertise in distributed data processing and analysis using technologies such as Apache Spark
  • 4+ years of expertise in software development with a focus on designing and developing data engineering pipelines
  • Proven design and problem-solving skills, with an emphasis on quality and engineering excellence
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • 4+ years of experience in data engineering
  • Hands-on experience in architecting and implementing data engineering pipelines with cloud-based tools like Azure Synapse, Azure Data Factory, SQL, Azure Data Explorer, Power BI, and Apache Spark
  • Skilled in designing and developing Power BI reports
Job Responsibility
Job Responsibility
  • Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios
  • Collaborate with partner teams and customers to scope and deliver projects
  • Authoring and designing Big Data ETL pipelines in Python, Spark, Synapse, Kusto, etc
  • Developing and managing Power BI reports
  • Data extraction across a wide variety of data sources
  • Data cleaning, preprocessing, and transformation for further analysis by data analysts
  • Data Validation framework from source to endpoints ensuring data quality and integrity
  • Fulltime
Read More
Arrow Right