CrawlJobs Logo
Microsoft Corporation Logo Microsoft Corporation · IT - Software Development

Principal Data Infrastructure Engineer

United States, Redmond 139900.00 - 274800.00 USD / Year · Job Posted February 13, 2026
Apply Position
Job Link Share

Job Description

As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits. We’re looking for a Member of Technical Staff - Principal Data Infrastructure Engineer. This role is a dynamic blend of Platform Engineering, DevOps/SRE, and Big Data Infrastructure Engineering, focused on enabling large-scale data and ML pipelines and intelligent systems. If you’ve architected big data platforms from the ground up and are eager to apply that expertise to consumer AI, we want to hear from you. You’ll bring: Deep technical expertise; A passion for automation and observability; Fluency in distributed systems; Creativity to design scalable solutions; And just as importantly: empathy, collaboration, and a growth mindset

Job Responsibility

  • Architect and maintain scalable, reliable, and observable Big Data Infrastructure for mission-critical AI applications
  • Champion DevOps and SRE best practices—automated deployments, service monitoring, and incident response
  • Build a self-service big data platform that empowers data and platform engineers and researchers
  • Develop robust CI/CD pipelines and automate infrastructure provisioning using Infrastructure as Code tools (Bicep, Terraform, ARM)
  • Collaborate with Data Engineers, Data Scientists, AI Researchers, and Developers to deliver secure, seamless big data workflows
  • Lead technical design reviews and uphold a clean, secure, and well-documented codebase
  • Proactively identify and resolve bottlenecks in data pipelines and infrastructure
  • Optimize system performance across storage, compute, and analytics layers
  • Partner with Security teams to enhance system security (IAM, OAuth, Kerberos)
  • Embody and promote Microsoft’s values: Respect, Integrity, Accountability, and Inclusion

Requirements

  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience
  • 4+ years in Big Data Infrastructure, DevOps, SRE, or Platform Engineering
  • 3+ years of hands-on experience managing and scaling distributed systems—from bare-metal to cloud-native environments
  • 2+ years deploying containerized applications using Kubernetes and Helm/Kustomize
  • Solid scripting and automation skills using Python, Bash, or PowerShell
  • Proven success in CI/CD pipeline management, release automation, and production troubleshooting
  • Experience working with Databricks for scalable data processing and analytics
  • Familiarity with security practices in infrastructure environments, including IAM, OAuth, and Kerberos administration
  • Proven experience with cloud-native infrastructure across Azure, AWS, or GCP
  • Hands-on expertise with modern data platforms like Databricks
  • Deep understanding of data storage and processing technologies: Relational & NoSQL databases
  • Key-value stores
  • Spark compute engines
  • Distributed file systems (e.g., HDFS, ADLS Gen2)
  • Messaging systems (e.g., Event Hub, Kafka, RabbitMQ)
  • Capacity planning and incident management for large-scale big data systems
  • Solid collaboration history with Data Engineers, Data Scientists, ML Engineers, Networking, and Security teams
  • Familiarity with modern web stacks: TypeScript, Node.js, React, and optionally PHP
  • Exposure to agentic workflows, deep learning, or AI frameworks
  • Practical experience integrating LLMs (e.g., GPT-based models) into daily workflows—automating documentation, code generation, reviews, and operational intelligence
  • Solid grasp of prompt engineering techniques to design, optimize, and evaluate interactions with LLMs
  • Demonstrated ability to troubleshoot and resolve complex performance and scalability issues across infrastructure layers
  • Excellent interpersonal and communication skills, with a solid passion for mentorship and continuous learning
  • Experience applying LLMs to DevOps workflows, enhancing incident response, and streamlining cross-functional collaboration is a solid advantage
Microsoft Corporation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal Data Infrastructure Engineer

8 matching positions

Principal Engineer I – Master Data Management Engineer

Software Resources has an immediate, direct hire job opportunity for a Principal...
Location
Location
United States , Phoenix
Salary
Salary:
Not provided
softwareresources.com Logo
Software Resources
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years’ experience with MDM solutions using Profisee or any other MDM tools
  • 3+ years’ experience designing, implementing, and supporting cloud data solutions
  • Azure Data Lake Storage, Azure Data Factory, Azure Data Services, Azure Logic Apps etc.
  • Bachelor’s degree in related field required
  • Masters or MBA in related field preferred
  • Previous leadership experience preferred
  • Expert level experience with at least one RDBMS and query language such as T-SQL, PL/SQL, Spark SQL
  • Expert level experience in conceptual, logical, and physical data design
  • Certifications within Azure such as Azure Fundamentals, Azure Data Engineer, Azure Data Scientist, and/or Azure DevOps Engineer preferred
  • Familiarity with multi-cloud data management and transformation platforms or tools such as Databricks, Snowflake etc.
Job Responsibility
Job Responsibility
  • Act as a Subject Matter Expert within the Enterprise Data & Analytics domain and related fields, ensuring that Master Data Management (MDM) and data engineering solutions adhere to standards of safety, security, compliance, and reliability
  • Design, develop, and implement key components of the enterprise data platform in alignment with Western Alliance Bank’s strategic data and analytics goals
  • Assess development and support needs, assume accountability for extensive design initiatives, and play an essential role in delivering successful project outcomes
  • Collaborate directly with business data stewards, analysts, engineers, enterprise architects, and business stakeholders to refine requirements and shape the objectives of enterprise data solutions
  • Lead a high-performing, centralized team of engineers, analysts, and QA engineers, developing solutions that address the complete data lifecycle management needs of our enterprise data platforms
  • Mentor and guide team members, fostering a culture of excellence and continuous learning
  • Lead the design, development, and maintenance of MDM solutions using Profisee, including data models, workflows, business rules, and user interfaces
  • Develop and implement data quality rules and processes within Profisee to ensure data accuracy and consistency
  • Design, develop, and implement match and merge functionalities, as well as hierarchical structures, utilizing Profisee
  • Establish and implement survivorship rules, business rules, and workflow automations
What we offer
What we offer
  • medical, dental, and vision coverage
  • a 401(k) with company match
  • short-term disability
  • life insurance with AD&D
Read More
Arrow Right

Principal Engineer I – Master Data Management Engineer

Software Resources has an immediate, direct hire job opportunity for a Principal...
Location
Location
United States , Irving
Salary
Salary:
Not provided
softwareresources.com Logo
Software Resources
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years' experience with MDM solutions using Profisee or any other MDM tools
  • 3+ years' experience designing, implementing, and supporting cloud data solutions
  • Azure Data Lake Storage, Azure Data Factory, Azure Data Services, Azure Logic Apps etc.
  • Bachelor's degree in related field required
  • Masters or MBA in related field preferred
  • Previous leadership experience preferred
  • Expert level experience with at least one RDBMS and query language such as T-SQL, PL/SQL, Spark SQL
  • Expert level experience in conceptual, logical, and physical data design
  • Certifications within Azure such as Azure Fundamentals, Azure Data Engineer, Azure Data Scientist, and/or Azure DevOps Engineer preferred
  • Familiarity with multi-cloud data management and transformation platforms or tools such as Databricks, Snowflake etc.
Job Responsibility
Job Responsibility
  • Act as a Subject Matter Expert within the Enterprise Data & Analytics domain and related fields, ensuring that Master Data Management (MDM) and data engineering solutions adhere to standards of safety, security, compliance, and reliability
  • Design, develop, and implement key components of the enterprise data platform in alignment with strategic data and analytics goals
  • Assess development and support needs, assume accountability for extensive design initiatives, and play an essential role in delivering successful project outcomes
  • Collaborate directly with business data stewards, analysts, engineers, enterprise architects, and business stakeholders to refine requirements and shape the objectives of enterprise data solutions
  • Lead a high-performing, centralized team of engineers, analysts, and QA engineers, developing solutions that address the complete data lifecycle management needs of our enterprise data platforms
  • Mentor and guide team members, fostering a culture of excellence and continuous learning
  • Lead the design, development, and maintenance of MDM solutions using Profisee, including data models, workflows, business rules, and user interfaces
  • Develop and implement data quality rules and processes within Profisee to ensure data accuracy and consistency
  • Design, develop, and implement match and merge functionalities, as well as hierarchical structures, utilizing Profisee
  • Establish and implement survivorship rules, business rules, and workflow automations
What we offer
What we offer
  • medical, dental, and vision coverage
  • a 401(k) with company match
  • short-term disability
  • life insurance with AD&D
Read More
Arrow Right

Principal Engineer I – Master Data Management Engineer

Software Resources has an immediate, direct hire job opportunity for a Principal...
Location
Location
United States , Irving, TX
Salary
Salary:
Not provided
softwareresources.com Logo
Software Resources
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years’ experience with MDM solutions using Profisee or any other MDM tools
  • 3+ years’ experience designing, implementing, and supporting cloud data solutions
  • Azure Data Lake Storage, Azure Data Factory, Azure Data Services, Azure Logic Apps etc.
  • Bachelor’s degree in related field required
  • Masters or MBA in related field preferred
  • Previous leadership experience preferred
  • Expert level experience with at least one RDBMS and query language such as T-SQL, PL/SQL, Spark SQL
  • Expert level experience in conceptual, logical, and physical data design
  • Certifications within Azure such as Azure Fundamentals, Azure Data Engineer, Azure Data Scientist, and/or Azure DevOps Engineer preferred
  • Familiarity with multi-cloud data management and transformation platforms or tools such as Databricks, Snowflake etc.
Job Responsibility
Job Responsibility
  • Act as a Subject Matter Expert within the Enterprise Data & Analytics domain and related fields, ensuring that Master Data Management (MDM) and data engineering solutions adhere to standards of safety, security, compliance, and reliability
  • Design, develop, and implement key components of the enterprise data platform in alignment with Western Alliance Bank’s strategic data and analytics goals
  • Assess development and support needs, assume accountability for extensive design initiatives, and play an essential role in delivering successful project outcomes
  • Collaborate directly with business data stewards, analysts, engineers, enterprise architects, and business stakeholders to refine requirements and shape the objectives of enterprise data solutions
  • Lead a high-performing, centralized team of engineers, analysts, and QA engineers, developing solutions that address the complete data lifecycle management needs of our enterprise data platforms
  • Mentor and guide team members, fostering a culture of excellence and continuous learning
  • Lead the design, development, and maintenance of MDM solutions using Profisee, including data models, workflows, business rules, and user interfaces
  • Develop and implement data quality rules and processes within Profisee to ensure data accuracy and consistency
  • Design, develop, and implement match and merge functionalities, as well as hierarchical structures, utilizing Profisee
  • Establish and implement survivorship rules, business rules, and workflow automations
What we offer
What we offer
  • medical, dental, and vision coverage
  • a 401(k) with company match
  • short-term disability
  • life insurance with AD&D
Read More
Arrow Right

Principal Engineer I – Master Data Management Engineer

Software Resources has an immediate, direct hire job opportunity for a Principal...
Location
Location
United States , Irving
Salary
Salary:
Not provided
softwareresources.com Logo
Software Resources
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years' experience with MDM solutions using Profisee or any other MDM tools
  • 3+ years' experience designing, implementing, and supporting cloud data solutions
  • Azure Data Lake Storage, Azure Data Factory, Azure Data Services, Azure Logic Apps etc.
  • Bachelor's degree in related field required
  • Masters or MBA in related field preferred
  • Previous leadership experience preferred
  • Expert level experience with at least one RDBMS and query language such as T-SQL, PL/SQL, Spark SQL
  • Expert level experience in conceptual, logical, and physical data design
  • Certifications within Azure such as Azure Fundamentals, Azure Data Engineer, Azure Data Scientist, and/or Azure DevOps Engineer preferred
  • Familiarity with multi-cloud data management and transformation platforms or tools such as Databricks, Snowflake etc.
Job Responsibility
Job Responsibility
  • Act as a Subject Matter Expert within the Enterprise Data & Analytics domain and related fields, ensuring that Master Data Management (MDM) and data engineering solutions adhere to standards of safety, security, compliance, and reliability
  • Design, develop, and implement key components of the enterprise data platform in alignment with strategic data and analytics goals
  • Assess development and support needs, assume accountability for extensive design initiatives, and play an essential role in delivering successful project outcomes
  • Collaborate directly with business data stewards, analysts, engineers, enterprise architects, and business stakeholders to refine requirements and shape the objectives of enterprise data solutions
  • Lead a high-performing, centralized team of engineers, analysts, and QA engineers, developing solutions that address the complete data lifecycle management needs of our enterprise data platforms
  • Mentor and guide team members, fostering a culture of excellence and continuous learning
  • Lead the design, development, and maintenance of MDM solutions using Profisee, including data models, workflows, business rules, and user interfaces
  • Develop and implement data quality rules and processes within Profisee to ensure data accuracy and consistency
  • Design, develop, and implement match and merge functionalities, as well as hierarchical structures, utilizing Profisee
  • Establish and implement survivorship rules, business rules, and workflow automations
What we offer
What we offer
  • medical, dental, and vision coverage
  • a 401(k) with company match
  • short-term disability
  • life insurance with AD&D
  • Fulltime
Read More
Arrow Right
New

Principal Data Engineer

Do you want to lead the development and transformation of the data platform that...
Location
Location
Denmark , Copenhagen
Salary
Salary:
Not provided
3shape.com Logo
3Shape
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Several years of experience designing, building, and operating modern cloud-based data platforms, ideally in a large organization, technology company, or consulting environment, supported by a degree in Computer Science, Data Engineering, Software Engineering, or a related field
  • Strong experience with modern cloud-based data platforms and technologies (preferably Azure Databricks, Apache Spark, Delta Lake), combined with solid software engineering skills in Python, SQL, CI/CD, and Infrastructure as Code
  • Experience establishing scalable platform architectures, governance frameworks, and operating models that enable teams to build trusted, secure, and high-quality data products
  • Strong communication and stakeholder management skills, with the ability to engage and influence both technical and non-technical stakeholders. You enjoy enabling data domain teams, collaborating with business teams, and translating complex technical concepts into practical solutions and business value
  • A collaborative leadership style and experience driving alignment, standards, and best practices across teams in a federated environment
  • Curiosity, ambition, and a genuine passion for data, AI, and digital transformation, combined with a hands-on mindset and a drive to continuously improve platform capabilities and data excellence
Job Responsibility
Job Responsibility
  • Lead the transformation of the Databricks platform into an AI-ready foundation, strengthening platform ownership, governance, and scalability across the organization
  • Define and evolve enterprise-wide standards for data platform architecture, governance, security, and access management in close collaboration with Group IT and other key stakeholders
  • Enable and guide domain data teams through technical leadership, architectural best practices, platform capabilities, and data product standards, incl. design and establish scalable frameworks for ingesting and managing data
  • Contribute hands-on to development, working closely with engineers to design, build, and deliver robust, scalable data platform capabilities, and foster alignment and collaboration by driving platform consistency, reusable patterns, and knowledge sharing
  • Drive planning and prioritization across the end-to-end data lifecycle, aligning platform evolution with data products, analytics, and AI initiatives
  • Drive operational excellence and cost optimization of the platform, including governance of Databricks usage and consumption models
  • Identify, evaluate, and drive adoption of new platform capabilities, AI technologies, and emerging data platform opportunities
  • Drive a culture of data excellence by improving data literacy, promoting best practices, and helping teams across the organization maximize the value of data, analytics, and AI
What we offer
What we offer
  • Vibrant and international environment with social, diverse, and highly skilled and cooperative colleagues - we are more than 40 nationalities in our DK based office
  • Attractive healthcare package to keep you fit and well
  • Breakfast every day, and delicious and healthy lunch cooked by our private chefs
  • Great social work environment with many optional activities and social clubs, ranging from wine & beer, board games, running to bicycle clubs
  • Attractive offices and R&D lab spaces in downtown Copenhagen close to Kgs. Nytorv, Nyhavn, and the Copenhagen Canals
  • Purpose: Help improve dental patients on a global scale
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Our Client is seeking a Principal Data Engineer to roll up their sleeves and bui...
Location
Location
United States , New York
Salary
Salary:
175000.00 - 220000.00 USD / Year
solomonpage.com Logo
Solomon Page
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong foundation in software engineering principles, including SOLID design, modularity, and scalability.
  • Expert proficiency in Databricks, including Delta Lake, Unity Catalog, Delta Live Tables, MLflow, and Databricks Workflows.
  • Deep experience with Snowflake, including data modeling, performance optimization, and integration with upstream/downstream pipeline tooling.
  • Expert proficiency in Python for data pipeline and automation development.
  • Advanced SQL skills with experience optimizing complex queries and data models at scale.
  • Proven experience designing and maintaining cloud-native data pipelines on AWS (e.g., MWAA/Airflow, Lambda, ECS, SQS, Glue, S3, Redshift, etc.).
  • Experience implementing and managing Terraform or similar IaC frameworks.
  • Strong understanding of lakehouse architecture patterns, data ingestion, transformation, and orchestration, including familiarity with ML/AI pipeline integration patterns.
  • Familiarity with CI/CD pipelines, automated testing, and modern DevOps practices.
  • 8+ years of experience in data engineering or backend development, with a focus on scalable data solutions.
Job Responsibility
Job Responsibility
  • Build and maintain end-to-end data pipelines — from raw ingestion through transformation and delivery — across diverse data sources (APIs, web data, internal feeds, etc.).
  • Hands-on development of scalable, production-grade pipelines within Databricks, including Delta Lake table management, Workflows, and cluster optimization.
  • Build and maintain data models, schemas, and transformation logic in Snowflake, optimizing for performance and reliability.
  • Develop and manage Databricks environments including Unity Catalog, Delta Live Tables, and integration patterns that support both internal data consumers and external sharing use cases.
  • Build and manage orchestration workflows using AWS services (MWAA/Airflow, Lambda, ECS, SQS, MSK) and Databricks-native orchestration where appropriate.
  • Implement and maintain infrastructure as code (IaC) using Terraform, ensuring reproducibility and compliance with cloud standards.
  • Establish and enforce best practices in data modeling, schema design, and ETL/ELT processes for high-volume structured and semi-structured data across Snowflake and Databricks.
  • Ensure data quality, lineage, and observability through automated testing, monitoring, and alerting across all pipeline layers.
  • Collaborate closely with technology leadership to align data platform development with business strategy and product goals.
  • Stay at the forefront of industry trends in data engineering, lakehouse architecture, and cloud-native data platforms.
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Principal Data Engineer. This role has been designed as 'Onsite' with an expecta...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Data Engineering, with demonstrated architectural ownership
  • Expert-level experience with Snowflake (mandatory), including performance optimization, data modeling, security, and ecosystem components
  • Expert proficiency in SQL and strong Python skills for pipeline development and automation
  • Experience with modern orchestration tools (Airflow, Dagster, Prefect, or equivalent)
  • Strong understanding of ELT/ETL patterns, distributed processing, and data lifecycle management
  • Familiarity with streaming/event technologies (Kafka, Kinesis, Pub/Sub, etc.)
  • Experience implementing data quality, observability, and lineage solutions
  • Solid understanding of cloud infrastructure (AWS, GCP, or Azure)
  • Strong background in DataOps practices: CI/CD, testing, version control, automation
  • Proven leadership in driving architectural direction and mentoring engineering teams
Job Responsibility
Job Responsibility
  • Architecture & Strategy: Own a significant portion of the architecture of our data platform, ensuring scalability, performance, reliability, and security
  • Define standards and best practices for data modeling, transformation, orchestration, governance, and lifecycle management
  • Evaluate and integrate modern data technologies and frameworks that align with our long-term platform strategy
  • Collaborate with engineering and product leadership to shape the technical roadmap
  • Engineering & Delivery: Design, build, and manage scalable, resilient data pipelines for batch, streaming, and event-driven workloads
  • Develop clean, high-quality data models and schemas to support analytics, BI, operational systems, and ML workflows
  • Implement data quality, lineage, observability, and automated testing frameworks
  • Build ingestion patterns for APIs, event streams, files, and third-party data sources
  • Optimize compute, storage, and transformation layers for performance and cost efficiency
  • Leadership & Collaboration: Serve as a senior technical leader and mentor within the data engineering team
What we offer
What we offer
  • Health & Wellbeing: comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Personal & Professional Development: programs to help reach career goals
  • Unconditional Inclusion: inclusive work environment
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

We are on the lookout for a Principal Data Engineer to help define and lead the ...
Location
Location
South Africa; United Kingdom; Poland
Salary
Salary:
Not provided
dotdigital.com Logo
Dotdigital
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Extensive experience delivering python-based projects in the data engineering space
  • Extensive experience working with SQL and NoSQL database technologies
  • Proven experience with modern data warehousing and large-scale data processing tools
  • Hands on experience with data orchestration tools
  • Experience using cloud environments (e.g. Azure, AWS, GCP) to process, store and surface large scale data
  • Experience using Kafka or similar event-based architectures
  • Strong grasp of data architecture and data modelling principles for both OLAP and OLTP workloads
  • Capable in the wider software development lifecycle in terms of agile ways of working and continuous integration/deployment of data solutions
  • Experience as a lead or Principal Engineer on large-scale data initiative or product builds
  • Demonstrated ability to architect data systems and data structures for high volume, high throughput systems
Job Responsibility
Job Responsibility
  • Lead the design and implementation of scalable, secure and resilient data systems across streaming, batch and real-time use cases
  • Architect data pipelines, model and storage solutions that power analytical and product use cases
  • using primarily Python and SQL via orchestration tooling that run workloads in the cloud
  • Leverage AI to automate both data processing and engineering processes
  • Assure and drive best practices relating to data infrastructure, governance, security and observability
  • Work with technologists across multiple teams to deliver coherent features and data outcomes
  • Support the data team to help adopt data engineering principles
  • Identify, validate and promote new tools and technologies that improve the performance and stability of data services
What we offer
What we offer
  • Parental leave
  • Medical benefits
  • Paid sick leave
  • Dotdigital day
  • Share reward
  • Wellbeing reward
  • Wellbeing Days
  • Loyalty reward
  • Fulltime
Read More
Arrow Right