CrawlJobs Logo

Software Engineer II - Azure Data Analytics

Canada, Vancouver 85000.00 - 166800.00 CAD / Year · Job Posted March 03, 2026
Apply Position
Job Link Share

Job Description

Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture. Within Azure Data, the big data analytics team provides a range of products that enable data engineers and data scientists to extract intelligence from all data – structured, semi-structured, and unstructured. We build the Data Engineering, Data Science, and Data Integration pillars of Microsoft Fabric. The Fabric Data Engineering Experience & Infrastructure team is looking for a passionate engineer to help build the next generation of infrastructure services for Microsoft Fabric Data Engineering, powered by Apache Spark. If you enjoy working on high-scale distributed systems, developer experiences, and platform infrastructure that makes engineers more productive, this is a great place to do it.

Job Responsibility

  • Design and develop world-class experiences for a new big data cloud offering, with an emphasis on scale, reliability, and performance.
  • Build and evolve core infrastructure services that power data engineering and analytics workloads (compute, runtime services, job/session management, configuration, and platform integrations).
  • Drive technical design and implementation end-to-end: translate requirements and documentation into robust production code.
  • Troubleshoot and improve systems using source code analysis and production instrumentation (logs, metrics, traces), and turn operational learnings into engineering improvements.
  • Improve platform scalability, resiliency, and observability, including automation to reduce operational toil.
  • Partner closely with product and engineering teams to deliver end-to-end features and continuously raise the quality bar.
  • Embody our culture and values.

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice to have

  • Experience designing and operating large-scale infrastructure for data platforms or compute services (e.g., job orchestration, runtime services, cluster/resource management, multi-tenant systems).
  • Experience with observability and operational excellence (SLOs/SLIs, alerting, incident response, postmortems).
  • Performance and reliability engineering experience (profiling, optimization, capacity planning, cost/performance tradeoffs).
  • Familiarity with modern cloud-native patterns (service ownership, CI/CD, safe deployments, automation).
  • Software engineering fundamentals (data structures, algorithms, testing, debugging, performance).
  • Experience building and shipping production infrastructure (backend services, distributed systems, or platform components) in a cloud environment.
  • Solid understanding of distributed systems concepts: fault tolerance, scaling, scheduling, and resource management.
  • Proficiency in one or more backend/system languages (e.g., Java, Scala, C#, C++, or Python).
  • Quick learner with a growth mindset—able to ramp up rapidly in new domains, tools, and codebases.
  • Ability to thrive in an AI-powered engineering environment: comfortable adopting AI-assisted workflows (e.g., copilots/agents), iterating quickly, and continuously improving productivity and quality.

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Software Engineer II - Azure Data Analytics

8 matching positions

Software Engineer II - Azure Storage

We are looking for a Software Engineer II - Azure Storage who is passionate abou...
Location
Location
United States , Multiple Locations
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Java OR equivalent experience
  • 1+ year(s) of experience in software engineering practices, coding and solid foundation in data structures and algorithms, with problem solving, debugging and analytical skills
  • 1+ year(s) of proficiency in Storage, File-Systems, Distributed Systems, Operating Systems, Networking, or Applications at scale
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Works with appropriate stakeholders to determine user requirements for a set of features
  • Contributes to the identification of dependencies, and the development of design documents for a product area with little oversight
  • Creates and implements code for a product, service, or feature, reusing code as applicable
  • Contributes to efforts to break down larger work items into smaller work items and provides estimation
  • Acts as a Designated Responsible Individual (DRI) working on-call to monitor system/product feature/service for degradation, downtime, or interruptions and gains approval to restore system/product/service for simple problems
  • Remains current in skills by investing time and effort into staying abreast of current developments that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale
  • Fulltime
Read More
Arrow Right

Software Engineer II - Finance Data & Experiences

Are you passionate about AI, data, and transformative user experiences? Do you b...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Experience delivering large-scale, production-quality software systems
  • Solid software engineering fundamentals, including system design, algorithms, testing, debugging, and code review
  • Ability to lead technical direction and mentor engineers in a collaborative team environment
  • Comfort operating in ambiguous, fast-paced environments where best practices are evolving
  • Hands-on experience with AI-powered developer tools and coding assistants, such as GitHub Copilot (and Copilot Workspace), OpenAI Codex/ChatGPT, Claude Code, or Cursor
  • Familiarity with agentic AI development patterns, including multi-step reasoning, tool/function calling, retrieval-augmented generation (RAG), and human-in-the-loop workflows
  • Experience building with large language models (LLMs), prompt engineering, agent frameworks, or orchestration tools (e.g., LangChain, Semantic Kernel, AutoGen, or similar)
  • Experience working with agentic systems, including plugins, agents, skills, or hooks
Job Responsibility
Job Responsibility
  • Assess, recommend, and adopt relevant new technologies, tools, and processes from Microsoft and industry
  • Support and influence the team culture customer-centricity and continuous improvement
  • Implement practices that ensure accurate, safe, and efficient releases for our services
  • Implement and maintain excellent design and development processes
  • Use AI in your daily coding and advocate to the team and customers an evolving state-of-the-art of how best to do this
  • Collaborate with others to solve complex problems keeping pace with our global business
  • Leverage sound engineering practices and principles
  • Flight code changes, use telemetry and analytics to take a understand customer impact
  • Provide technical feedback to our product engineering partners to evolve and mature our Azure services and Power Platform
  • Work with multiple client partner teams to implement cohesive end-to-end experiences
  • Fulltime
Read More
Arrow Right

Software Engineer II - Finance Data & Experiences

Are you passionate about AI, data, and transformative user experiences? Do you b...
Location
Location
Mexico , Mexico City
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Job Responsibility
Job Responsibility
  • Assess, recommend, and adopt relevant new technologies, tools, and processes from Microsoft and industry
  • Support and influence the team culture customer-centricity and continuous improvement
  • Implement practices that ensure accurate, safe, and efficient releases for our services
  • Implement and maintain excellent design and development processes
  • Use AI in your daily coding and advocate to the team and customers an evolving state-of-the-art of how best to do this
  • Collaborate with others to solve complex problems keeping pace with our global business
  • Leverage sound engineering practices and principles
  • Flight code changes, use telemetry and analytics to take a understand customer impact
  • Provide technical feedback to our product engineering partners to evolve and mature our Azure services and Power Platform
  • Work with multiple client partner teams to implement cohesive end-to-end experiences.
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Cloud & AI organization accelerates Microsoft's mission and bold ambitions t...
Location
Location
United States , Multiple Locations
Salary
Salary:
102100.00 - 202200.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience
  • Candidates must be able to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Citizenship & Citizenship Verification
Job Responsibility
Job Responsibility
  • Design, build, and optimize data pipelines to ingest, process, and prepare data for use in insider risk detection models
  • Join, filter, and integrate diverse data sources to create comprehensive datasets that enable effective and accurate insider risk detections
  • Work with large datasets, applying advanced data transformation techniques to ensure data quality and accessibility for risk detection
  • Develop, test, and deploy insider risk detection models based on data-driven insights to proactively identify anomalous or risky behavior patterns
  • Collaborate with insider risk team members to define and refine detection use cases, ensuring they are accurate, scalable, and aligned with business needs
  • Share knowledge and actively contribute ideas in team technical discussions
  • Maintain and monitor insider risk engineering systems to ensure reliable operation, security, and compliance with internal engineering standards and policies
  • Join on-call rotations, lead incident response, and drive thorough root-cause analysis
  • Document data processes, detection workflows, and system configurations to support future development and maintenance
  • Use development and coding best practices (e.g., reusable, modular)
What we offer
What we offer
  • Benefits and other compensation
  • Fulltime
Read More
Arrow Right

Data Engineer II

Do you have a relentless passion for data engineering and building platforms tha...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering. OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering. OR equivalent experience.
  • Ability to work and communicate effectively across disciplines and teams.
  • Familiarity with distributed data processing and analysis, such as Map-Reduce or Apache Spark.
Job Responsibility
Job Responsibility
  • Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C#.
  • Data extraction across a wide variety of data sources.
  • Data cleaning, preprocessing, and transformation for further analysis by data analysts.
  • Data Validation framework from source to endpoints ensuring data quality and integrity.
  • Enable the Data Scientists and Analysts to do more with data across all aspects of the development lifecycle.
  • Contribute to a data-driven culture as well as a culture of experimentation across the organization.
  • Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios.
  • Enable Data Scientists and other partners to do more with data across all aspects of the development lifecycle by helping democratize data.
  • Fulltime
Read More
Arrow Right

Software Engineer II

We are seeking a passionate and technically skilled Software Engineer II to join...
Location
Location
United States , Redmond
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Preferred Qualifications: Bachelor’s or Master’s degree in Computer Science, Statistics, Mathematics, or related field
  • 2+ years of experience in data science, analytics, or applied machine learning
  • Proficiency in Python, SQL, and ML frameworks (e.g., Scikit-learn, TensorFlow, PyTorch)
  • Experience with cloud platforms (Azure preferred) and big data technologies
  • Understanding of statistical modeling, predictive analytics, and experimentation design
  • Excellent communication and stakeholder management skills
  • Demonstrated experience leveraging AI tools and technologies to enhance engineering effectiveness, coupled with a strong curiosity and commitment to continuous learning in the field of Artificial Intelligence
Job Responsibility
Job Responsibility
  • Design and implement advanced analytics solutions to support commerce data platform initiatives including analytics based on Machine Learning Models
  • Design skill should include scale, extensibility, performance, re-training for the ML models
  • Partner with engineering and product teams to define data requirements and ensure high-quality data pipelines
  • Conduct exploratory data analysis, feature engineering, and model evaluation using structured and unstructured datasets
  • Ensure the models built are operable, scalable, extensible and performant
  • Develop dashboards, visualizations, and storytelling artifacts to communicate insights to stakeholders
  • Lead experimentation efforts to evaluate new features, forecasting, data quality and anomaly detection systems
  • Build extensible solutions on LLM models to improve productivity of engineers across the commerce organization
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation
  • Fulltime
Read More
Arrow Right

Data Engineer II

The Copilot and Platform Ecosystem (CAPE) team at Microsoft is responsible for e...
Location
Location
United States , Redmond
Salary
Salary:
100600.00 - 199000.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Partner with stakeholders to define and document data requirements (access, cadence, ownership) and assess feasibility and total cost of ownership (TCO).
  • Define data contracts and ownership boundaries with upstream system owners.
  • Design and maintain scalable data pipelines that ingest and load data into analytical platforms (e.g., Azure Data Explorer/Kusto).
  • Implement data validation and quality checks to meet SLAs for accuracy, completeness, freshness, and reliability.
  • Build orchestration and automation for dependable, repeatable data movement.
  • Transform and model data (joins, aggregations, enrichment) to power downstream datasets, dashboards, alerts, and agent experiences
  • contribute through code reviews and shared tooling.
  • Operationalize pipelines with monitoring, troubleshooting/runbooks, root-cause analysis, performance/cost optimization, and compliance/governance (classification, tagging, lineage, and access control).
  • Fulltime
Read More
Arrow Right

Staff II Software Engineer AI/ML Ops

We're looking for a Lead Data Engineer to design, build, and optimize data pipel...
Location
Location
United States , Pleasanton
Salary
Salary:
245000.00 - 307000.00 USD / Year
blackline.com Logo
BlackLine
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong programming skills in languages such as Python, Java, or Scala
  • Expertise in ML frameworks (TensorFlow, PyTorch, scikit-learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow)
  • Proven experience operating production pipelines for ML and LLM-based systems across cloud ecosystems (GCP, AWS, Azure)
  • Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management
  • Strong competencies in CI/CD, IaC, and DevSecOps pipelines integrating testing, compliance, and deployment automation
  • Hands-on with observability stacks (Prometheus, Grafana, Newrelic) for model and agent performance tracking
  • Understanding of governance frameworks for Responsible AI, auditability, and cost metering across training and inference workloads
  • Proficiency in containerization technologies (e.g., Docker, Kubernetes)
  • Proficient in scripting languages (e.g., Bash, python) for automation
  • Experience with workflow orchestration tools (e.g., Apache Airflow)
Job Responsibility
Job Responsibility
  • Lead data pipeline development: Build and maintain PySpark ETL pipelines with high data quality and performance
  • Manage integrations: Establish robust connections to client data sources via APIs and tools like FiveTran, Plaid, and BlackLine's own internal connector ecosystem
  • Ensure reliability: Monitor pipeline performance, automate testing, and validate data accuracy
  • Optimize for scale: Implement performance improvements (e.g., CDC mechanisms, indexing strategies) for large-scale datasets
  • Collaborate & innovate: Work with business stakeholders to refine data requirements and integrate cutting-edge AI and big data technologies
  • Partner with data science, security, and product teams to set evaluation and governance standards (Guardrails, Bias, Drift, Latency SLAs)
  • Mentor senior engineers and drive design reviews for ML pipelines, model registries, and agentic runtime environments
  • Lead incident response and reliability strategies for ML/AI systems
  • Collaborate with development teams to integrate AI solutions into existing workflows and applications
  • Ensure seamless integration with different platforms and technologies
What we offer
What we offer
  • Short-term and long-term incentive programs
  • Robust offering of benefit and wellness plans
  • Fulltime
Read More
Arrow Right