CrawlJobs Logo

Senior Software Engineer | Data Integration Platform

Canada, Vancouver 114400.00 - 203900.00 CAD / Year · Job Posted February 13, 2026
Apply Position
Job Link Share

Job Description

Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The Data Integration team is hiring a Senior Software Engineer to work on Power Query and Dataflows. Our team focuses on: End-to-End Data Integration: Designing and implementing solutions that enable customers to connect, transform, and integrate data seamlessly; High-Scale Engineering: Building and maintaining high-throughput, multi-tenant services with strong reliability, scalability, and maintainability; Customer-Centric Innovation: Driving improvements in product functionality, performance, and usability to deliver frictionless experiences across Microsoft surfaces like Fabric, Excel, and Power Platform.

Job Responsibility

  • Leads by example within the team to produce extensible, maintainable, well-tested, secure, and performant code that adheres to design specifications
  • Applies metrics to drive code quality and stability
  • Leads discussions for, owns the architecture of a products/solutions, and creates proposals for architecture by testing design hypotheses and develop complex design specifications
  • Owns or collaborates with other engineers on the architecture of solutions, with minimal technical oversight
  • Upholds Microsoft standards of security, privacy, and other compliance requirements and expectations
  • Drives the refinement of products through data analytics and makes informed decisions in engineering products through data integration
  • Applies best practices to build code based on well-established methods and secure design principles
  • Leveraging internal experimentation infrastructures, drives experiments that determine the impact of changes
  • Acts as a designated responsible individual (DRI) and guides other engineers by developing and following the playbook, working on-call to monitor a system/product/service for degradation, downtime, or interruptions

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 3+ years of professional experience delivering customer facing, globally available, online services with 24/7 support and meeting defined SLAs
  • The ability to meet Microsoft, customer, and/or government security screening requirements is required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 3+ years of experience delivering customer facing, globally available, online services with 24/7 support and defined SLAs

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Software Engineer | Data Integration Platform

8 matching positions

Software engineer 2 / Senior Software engineer - Azure Data

Microsoft's Azure Data engineering team is leading the transformation of analyti...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI
  • Experience with big data technologies such as Spark, Kafka, Hadoop, or HBase
  • Experience building data lake or data engineering products, tools, or pipelines
  • Familiarity with container-based architectures (Docker, Kubernetes)
  • Ability to debug complex distributed systems on Linux and/or Windows platforms
Job Responsibility
Job Responsibility
  • Write extensible, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components
  • Use AI tools and coding best practices across the development lifecycle
  • Design data refresh, scheduling, and query optimisation features with minimal supervision
  • Review code from teammates for correctness, test coverage, security risks, and adherence to team standards
  • Coach junior engineers through code reviews
  • Debug complex issues in distributed systems running on Azure, Linux, and Windows
  • Run live site operations on a rotational, on-call basis
  • Integrate logging and instrumentation to gather telemetry on system health, performance, reliability, and security
  • Work with product managers, technical leads, and partners across geographies to define customer requirements for Materialized Lake View features
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, Data Platform

We are looking for an experienced software engineer to own, maintain, and evolve...
Location
Location
United States
Salary
Salary:
107000.00 - 120000.00 USD / Year
missionwired.com Logo
MissionWired
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive hands-on software engineering experience, with a strong track record of delivering production data pipelines or platforms in a mission critical environment
  • Strong experience with Python in production systems
  • Experience building and operating Databricks (or Spark) based pipelines
  • Experience with SQL
  • Experience with at least one major cloud infrastructure provider (GCP, AWS, Azure)
  • Experience with supporting business-critical systems with on-call ownership
  • Passion, energy, and excitement for progressive and philanthropic causes and all things digital
Job Responsibility
Job Responsibility
  • Joining each and every one of your colleagues in creating an inclusive workspace
  • Owning, maintaining, and supporting the reliability, architecture, and evolution of our production machine learning and delivery platform
  • Designing, operating, and improving large scale Databricks/Spark pipelines and workflows
  • Partner with our data scientists to productionize new data and ML-powered products
  • Leading improvements on the software integration layers between data pipelines and product workflows
  • Growing the team via mentorship and leadership, reviewing technical documents, improving code quality, and improving team performance and processes
  • Acting as a senior technical owner in debugging complex production issues and improving system observability
  • Collaborating with cross-functional teams to support their data infrastructure needs
What we offer
What we offer
  • 100% employer-paid premiums for platinum-level medical plan on a national health care network
  • 100% employer-paid life insurance and short term disability
  • 50% employer-paid vision and dental insurance
  • 401(k) with 3% employer contribution
  • 17 vacation days in addition to 12 paid holidays, sick days, bereavement leave, and a volunteer day off
  • Paid parental leave at 100% of your salary
  • Financial support for reproductive and transgender care
  • Flexible telecommute and remote work policies
  • Company issued Mac products for home offices
  • Cell phone service reimbursement, meal and ride-share reimbursement, and other perks available
  • Fulltime
Read More
Arrow Right

Senior Software Engineer, AI Data Platform (CoreAI)

Join Microsoft’s CoreAI – AI Platform team in Bay Area/Redmond to build the AI D...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years
Job Responsibility
Job Responsibility
  • Design and build scalable data pipelines and services to automate the dataset lifecycle (ingestion, registration, validation, PII handling, discovery, sharing, lineage), including intelligent agent-driven automation for key stages
  • Develop secure and reliable infrastructure for data access, entitlement management, and operational support across global time zones
  • Implement governance and compliance tooling to ensure data integrity, auditability, and adherence to regulatory standards
  • Create user-facing tools and APIs that make datasets easily discoverable and reusable
  • Contribute to strategic extensions such as continuous feedback loops, human-in-the-loop workflows, and data intelligence services for internal and external stakeholders
  • Collaborate with cross-org partners to align priorities and deliver company-wide impact
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Web Data Platform

We are looking for a highly motivated and experienced platform engineer to join ...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Solid foundation in distributed systems, concurrency, networking, and system design
  • Excellent communication, collaboration, and problem‑solving skills
  • Fluency in English (spoken and written)
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design and architect large‑scale distributed pipelines to ensure scalability, robustness, performance, and cost efficiency
  • Implement new features and system improvements in highly distributed, parallelized environments, using data to measure and validate impact
  • Develop and maintain comprehensive test coverage, including unit, integration, and performance tests, ensuring production-grade reliability
  • Debug, triage, and mitigate issues in live production environments handling massive data flows
  • Continuously improve the system architecture, proposing and driving enhancements based on industry best practices and emerging technologies
  • Collaborate cross‑functionally with engineers, PMs, and partner teams to align technical execution with business and product objectives
  • Contribute to engineering excellence, operational rigor, and incident‑free execution for mission‑critical pipelines that support Bing’s web data ecosystem
  • Fulltime
Read More
Arrow Right

Senior Software Engineer - Banking Integration Platform

Mercury is building a bank. The Banking Integration Platform as a Service team i...
Location
Location
United States; Canada , San Francisco; New York; Portland
Salary
Salary:
166600.00 - 250900.00 USD / Year
mercury.com Logo
Mercury
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Direct experience with either a bank core that has achieved FFIEC-compliance (such as FIS) or that of a US-based Global Systemically Important Bank (G-SIB)
  • Understand how core banking systems work: accounts, transactions, ledgers, and the data models underneath
  • Be a product-minded engineer who thinks about the developers consuming your APIs, not just the systems you’re connecting to
  • Thrive in environments where you're building something new rather than maintaining something established
  • Be comfortable with our tech stack (Haskell and TypeScript) or ready to learn
  • Have strong opinions about building reliable, maintainable systems
Job Responsibility
Job Responsibility
  • Build Mercury’s integration with an FFIEC-approved bank core and the connections to payment networks
  • Design internal APIs that give product teams simple, consistent interfaces to complex external systems
  • Handle the messy realities of enterprise integrations such as retries, failures, format mismatches, and downtime
  • Build data pipelines that keep Mercury's systems in sync with our bank core
  • Own monitoring, alerting, and recovery for our most critical external connections
  • Partner with many other teams at Mercury to define clean boundaries and reliable contracts
  • Help shape the technical architecture of Mercury Bank
What we offer
What we offer
  • equity
  • benefits
  • Fulltime
Read More
Arrow Right

Senior Staff Software Engineer: Data & Storage Platform

Uber’s Data Platform is the heart of the company’s critical decision-making and ...
Location
Location
United States , Seattle; San Francisco; Sunnyvale
Salary
Salary:
267000.00 - 297000.00 USD / Year
uber.com Logo
Uber
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 14+ Years of Engineering Excellence: Proven experience designing and operating world-class distributed data and storage systems
  • Mastery of Storage Internals: Extensive storage experience is a must
  • Deep expertise in: Batch & Object Storage: HDFS, Cloud Object Storage (S3/GCS/OCI), and Blobstore metadata management
  • Storage Optimization: Practical experience with Apache Hudi or Apache Iceberg for lakehouse architectures
  • Transactional Systems: Experience with distributed transactional storage (e.g., Docstore, Google Spanner, TiDB)
  • NoSQL & Cache: Cassandra, Redis, and high-throughput Key-Value stores
  • Data + AI Convergence: Deep understanding of how compute fabrics (Spark, Flink, Ray) integrate with vector databases and model-serving platforms
  • Query Engine Proficiency: Architect-level knowledge of Presto, Trino, or Hive for large-scale analytical processing
  • Systems Programming: Expert-level command of Java, Go, Scala, or C++ with a focus on performance tuning and distributed consensus
Job Responsibility
Job Responsibility
  • Architect the Multi-Modal Fabric: Unify batch, streaming, and AI compute into one intelligent fabric, enabling real-time insights and trustworthy AI agents at a global scale
  • Revolutionize Storage & Catalog: Drive the architecture for a unified catalog and metadata management service for unstructured data, leveraging native cloud object store capabilities
  • Operationalize AI Intelligence: Partner with teams like QueryCopilot and DataIQ to bridge human validation with autonomous reasoning through agentic workflows
  • Lead Storage Modernization: Evolve our massive-scale persistence layers—including Docstore (Transactional Distributed Storage) and Distributed MySQL—to increase resiliency and reduce operational overhead
  • Open Source & Act as a force multiplier by contributing to the community (Hudi, Iceberg, Presto)
What we offer
What we offer
  • Eligible to participate in Uber's bonus program
  • May be offered an equity award & other types of comp
  • All full-time employees are eligible to participate in a 401(k) plan
  • Eligible for various benefits
  • Fulltime
Read More
Arrow Right

Senior Staff Data Engineer- Data Platform

At Marktplaats, data is at the heart of everything we do, but Intelligence is wh...
Location
Location
Netherlands , Amsterdam
Salary
Salary:
Not provided
adevinta.com Logo
Adevinta
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of hands-on experience in Software Development or Data Engineering
  • at least 5+ years specifically focused on building Data Platforms
  • deep understanding of how Platform infra supports Analytics workloads
  • proven experience evolving complex platforms from legacy patterns to modern, cloud-native solutions
  • deep knowledge of Spark internals, JVM tuning, and performance optimization for high-scale batch and streaming datasets
  • deep expertise in Unity Catalog, Delta Lake internals, and optimizing high-volume workloads
  • strict software engineering discipline (CI/CD, Testing, OOP) applied to data pipelines
  • understanding of microservices architecture
  • understanding the needs of Analytics/DWH teams (Data Modeling, dbt)
  • strong background in building automated pipelines using Terraform/Terragrunt and ensuring system observability
Job Responsibility
Job Responsibility
  • Lead the evolution of our Data Platform and architect the "Data Exchange" strategy
  • define robust patterns for API-based ingestion, Event-Driven Architectures (Kafka), and Reverse ETL
  • ensure architectures are optimized for cost and performance on AWS
  • act as a catalyst for technical evolution
  • constantly scan the horizon for next-generation technologies
  • lead the implementation of new paradigms
  • design the strategy for Unity Catalog implementation and Data Contracts
  • champion FinOps, automating cost controls for our highest-volume workloads
  • build the underlying infrastructure that allows Analytics/DWH teams to run efficient transformations
  • elevate the technical bar of the team, mentoring Staff and Senior engineers
What we offer
What we offer
  • An attractive Base Salary
  • Participation in our Short Term Incentive plan (annual bonus)
  • Work From Anywhere: Enjoy up to 20 days a year of working from anywhere
  • A 24/7 Employee Assistance Program for you and your family
  • a collaborative environment with an opportunity to explore your potential and grow
  • a range of locally relevant benefits
  • Fulltime
Read More
Arrow Right

Senior Product Designer, Data Platform - Online Data Stores and Movement Platform

We're seeking a Senior Product Designer to shape the next generation of data mov...
Location
Location
United States
Salary
Salary:
350000.00 - 520000.00 USD / Year
designx.community Logo
DesignX Community
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years as a Product Designer (or equivalent experience)
  • Experience designing orchestration and/or data movement tools, databases, developer/data platform tools, or analogous complex technical products
  • Strong portfolio showing system‑level product work and the impact of your design leadership, including initiatives that span multiple teams
  • Proven track record of leading design initiatives from concept to launch
  • Proficient in design tools (Figma, etc.) and prototyping technologies
  • Strong systems thinking and ability to design scalable solutions for complex data/analytics challenges
  • Successfully led design strategy for complex technical products
  • Proven track record of influencing and aligning cross-functional partners without direct authority
  • Ability to navigate ambiguity, create clarity, and move complex initiatives forward with partners
  • Excellence in communicating design decisions to technical audiences
Job Responsibility
Job Responsibility
  • Shape and own design for ODS and movement platform
  • creating intuitive workflows that enhance data practitioner and software engineer productivity and delight
  • Contribute to and help drive adoption of patterns and components for operational, data‑dense UIs (runs, pipelines, lineage, diffs) that scale across the platform
  • Identify opportunities for innovation through research, incident analysis, and technical insight
  • sequence delivery for measurable impact
  • Create cohesive, end‑to‑end experiences with guardrails over gates (paved paths, templates, defaults) to reduce errors
  • Partner with product and engineering to define and improve how we measure experiences
  • Anticipate emerging needs and help frame design problems early
  • Drive end‑to‑end design for interdependent workflows
  • Craft and validate prototypes that effectively communicate solutions
What we offer
What we offer
  • Health Plans
  • Mental Health support
  • 401(k) Retirement Plan with employer match
  • Stock Option Program
  • Disability Programs
  • Health Savings and Flexible Spending Accounts
  • Family-forming benefits
  • Life and Serious Injury Benefits
  • Paid leave of absence programs
  • Flexible time off
  • Fulltime
Read More
Arrow Right