CrawlJobs Logo
Microsoft Corporation Logo Microsoft Corporation · IT - Software Development

Principle Data Platform Engineer

United States, Redmond 139900.00 - 274800.00 USD / Year · Job Posted February 13, 2026
Apply Position
Job Link Share

Job Description

Imagine being at the forefront of a revolution powered by Data and AI (Artificial intelligence), transforming Marketing at Microsoft into a true “Frontier Organization” that drives impact at an unprecedented scale. As a Principle Data Platform Engineer on the Global Marketing Data Engineering team, you will have the opportunity to build cutting-edge data platforms that process and synthesize billions of demand signals, enabling personalized customer journeys, media innovation, and high impact campaigns that redefine customer engagement. By crafting data products that integrate, enrich, and serve deep insights across an infinite number of scenarios, you are not only shaping the future but experiencing it firsthand as we directly contribute to the evolution of our most advanced technologies like Purview and Fabric. Join us to unleash your potential and play a pivotal role as a data innovator with world-changing impact - your journey starts here!

Job Responsibility

  • Develop and implement a federated infrastructure strategy for marketing data focused on cost optimization and scalability
  • Develop monitoring systems and processes for Data Platform infrastructure, pipelines, usage, and access patterns
  • Build capabilities for data discovery, access management, policy enforcement, and lineage tracking, aligned with the DE data platform vision
  • Create and deploy frameworks and tools for data quality measurement and monitoring to deliver secure, sustainable, high-performing, and reliable marketing data for consumer needs
  • Design and roll out data storage framework and solution in line with medallion architecture and automated role-based access controls across all access layers
  • Establish engineering excellence through best practices, coding standards, and robust code management tooling
  • Collaborate with Data Product Engineering, Data Ops, and Partner Engineering teams to deliver end-to-end platform solutions
  • Partner with Fabric, Purview, Azure ML teams to influence product roadmaps and address feature gaps
  • Implement shared tools for cross-tenant Azure data intake and publishing
  • Deploy capabilities for data classification, tagging, retention, archival, and deletion to meet privacy policy requirements
  • Identify and prioritize platform improvements using incident and feedback data
  • Embody our culture and values

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 6+ years of software development lifecycle experience, including 2+ years in a lead role managing big data platforms
  • 2+ years of Infrastructure-as-Code (Terraform, Bicep, ARM)
  • 2+ years of CI/CD pipelines and DevOps automationIdentity & access management (RBAC, PIM, conditional access)
  • 2+ years of Governance frameworks (data classification, policy enforcement, compliance controls)
  • Observability (OpenTelemetry, monitoring, logging, SLOs)
  • Incident management and reliability engineering practices
Microsoft Corporation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principle Data Platform Engineer

8 matching positions

Aws Data Engineer (Cloud Data Platform & Pipeline Specialist)

Design, develop, and maintain scalable cloud-based data pipelines using AWS serv...
Location
Location
United States , Atlanta
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering, with strong hands-on expertise in AWS data services (Glue, EMR, S3, RDS, DataSync, DMS)
  • 5+ years of Proven experience building and managing data pipelines (batch and streaming) in cloud environments
  • 5+ years of Strong experience in data migration, transformation frameworks, and large-scale data replication
  • 5+ years of Deep understanding of data modeling, data transformation, and reconciliation techniques
  • 5+ years of Experience designing and implementing secure data access and governance (least privilege principles)
  • 5+ years of Hands-on experience with data validation, auditing, and reconciliation processes
  • Familiarity with regulatory or finance data environments and reporting workloads
  • 5+ years of Strong problem-solving skills and ability to work in a collaborative, fast-paced environment
  • AWS data services
  • data pipelines
Job Responsibility
Job Responsibility
  • Design, develop, and maintain scalable cloud-based data pipelines using AWS services such as Glue, EMR, S3, RDS, DataSync, and DMS
  • Build and optimize batch and streaming data orchestration workflows to support enterprise data platforms
  • Lead large-scale data migration efforts, including legacy-to-cloud transformations and replication strategies
  • Perform data modeling, transformation, and reconciliation to ensure high-quality, consistent datasets across systems
  • Implement secure data access patterns following least-privilege principles for pipelines and datasets
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver solutions
  • Establish robust data validation, reconciliation, and audit mechanisms to meet regulatory and reporting requirements
  • Troubleshoot and optimize performance of ETL/ELT pipelines and data workflows in AWS environments
  • Support governance, compliance, and audit readiness for data platforms in regulated environments (finance/reporting)
  • Fulltime
Read More
Arrow Right

Data Governance & Data Quality Platform Engineer

We are seeking a Data Governance & Data Quality Platform Engineer to own the tec...
Location
Location
United States , Houston
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Data Engineering, or a related field
  • Hands‑on experience administering data governance and data quality platforms (e.g., Atlan, Monte Carlo, DQ tools), including API‑based integrations
  • Strong understanding of data catalogs, data lineage, and metadata management
  • Solid knowledge of data governance principles and data quality frameworks
  • Familiarity with Data Mesh concepts and decentralized data ownership models
  • Experience building data products and supporting orchestration workflows
Job Responsibility
Job Responsibility
  • Configure and maintain data governance platforms for metadata management, data lineage, and governance workflows
  • Configure data quality tools for profiling, rule creation, and monitoring dashboards
  • Manage platform security, including user roles, authentication, SSO, RBAC, and access controls
  • Develop and maintain integrations across data sources, databases, data lakes, and BI tools
  • Automate metadata ingestion and data quality checks using APIs, Python scripts, or ETL frameworks
  • Configure and maintain connectors for analytics and reporting platforms
  • Monitor platform health and optimize performance and scalability
  • Apply upgrades, patches, and troubleshoot technical issues
  • Implement logging, alerting, and proactive monitoring for governance and data quality environments
  • Provide Tier 3 support for platform‑related incidents and escalations
What we offer
What we offer
  • medical
  • vision
  • dental
  • life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Senior Data Platform Engineer

Location
Location
Australia , Sydney
Salary
Salary:
Not provided
hso.com Logo
HSO
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years’ experience building and delivering production grade data platform solutions
  • Strong experience designing and deploying solutions on Microsoft Azure
  • Hands on experience with modern data platforms (experience with Microsoft Fabric and/or Databricks will set you apart from other candidates)
  • Proven ability to lead technical delivery from design through to production
  • Strong understanding of source control, testing frameworks and modern development practices
  • Practical experience applying DevOps principles across complex solution lifecycles
  • Solid understanding of data security, privacy, governance and risk management in cloud environments
  • Demonstrate ability to accurately scope and quote work and be involved in pre-sales
  • A genuine thirst for learning, experimentation and staying current with evolving Microsoft technologies
  • Comfortable working in a highly varied role, switching between tools, technologies and problem domains
Job Responsibility
Job Responsibility
  • Lead the design, implementation, testing, deployment and ongoing support of our modern Azure based solutions
  • Apply proven architectural patterns and best practices to deliver secure, scalable and maintainable solutions
  • Play a senior role in the delivery of software solutions, and contribute to our data platform engagements
  • Manage and oversee less experienced staff, reviewing code, overseeing the development and ensuring best-practice standards are applied to all solutions
  • Build and deploy solutions using DevOps and Infrastructure as Code practices
  • Deploy solutions using a variety of Azure services, adapting approaches based on customer context and maturity
  • Work directly with customers to understand requirements, shape solution direction and identify opportunities for innovation
  • Translate complex technical concepts into clear, business focused outcomes for non technical stakeholders
  • Facilitate customer workshops, proof of concepts and technical deep dives to support adoption and capability uplift
  • Act as a trusted technical advisor throughout the delivery lifecycle
  • Fulltime
Read More
Arrow Right

Data Platform Engineer (Ai-Enabled)

Global Controllers Technology is looking for a hands-on data engineer who is pas...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years overall experience in Big Data or Enterprise large-scale application development using scalable tools like Databricks, Scala, Java, and the Python ecosystem.
  • Deep understanding of data modeling, data warehousing concepts, methodologies, and best practices.
  • Strong experience with data processing (e.g., Spark, Starburst, Snowflake, Redshift), storage (e.g., Hadoop, MongoDB, Oracle), and ETL (e.g., Airflow, Ab Initio, Talend) solutions.
  • Experience with data engineering techniques such as building data lakes and data warehouses, data mesh architectures, data pipelines, and ETL vs. ELT patterns.
  • Strong expertise in Starburst/Trino with deep understanding of data federation and data virtualization architectures.
  • Experience with real-time data processing and data virtualization technologies such as Starburst, Snowflake, and Flink (preferred).
  • Experience with designing and developing distributed systems, handling structured and unstructured data to store, analyze, and report.
  • Experience with developing and maintaining large and complex database systems using relational databases like Oracle, and other big data technologies like Hadoop, Spark, etc.
  • Proficient in PL/SQL and Unix Shell scripts. Strong SQL, PL/SQL development, and database tuning experience.
  • Experience in designing Online Transaction Processing (OLTP), Operational Data Store (ODS), and Data Warehouse applications.
Job Responsibility
Job Responsibility
  • Drive the creation of a scalable and high-quality data intensive platform leveraging some of the latest methodologies such as Data Virtualization and Data Domains
  • Fulltime
Read More
Arrow Right

Principal Data Platform Engineer Vice President

We are seeking an exceptionally skilled and motivated Principal Data Platform En...
Location
Location
United States , Irving; Jacksonville
Salary
Salary:
125760.00 - 188640.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of relevant experience in Apps Development or systems analysis role with extensive Python and/or big data expertise
  • Python/Pyspark Mastery
  • Big Data Technologies & Platforms: Extensive experience (8+ years) architecting, designing, implementing, and managing solutions within distributed data processing platforms, specifically with the Hadoop ecosystem (preferably Cloudera distributions). Proficient in leveraging key big data components such as distributed file systems (e.g., HDFS), data warehousing solutions (e.g., Hive), data transformation frameworks (e.g., Pig), and data ingestion tools (e.g., Sqoop), alongside hands-on experience with NoSQL databases (preferably MongoDB)
  • ETL Architecture & Development: Proven ability to architect, design, and implement highly scalable data pipelines. Extensive experience leveraging industry-standard ETL tools and frameworks for efficient data extraction, transformation, and loading into various relational databases and data warehouses, coupled with a strategic vision and planning experience for migrating to cloud-native, serverless ETL solutions
  • Data Architecture & Strategic Modeling: Understanding of advanced data modeling principles and practical experience in data warehouse design and development, ensuring data integrity, scalability, security, and optimal performance
  • AI-Powered Development: Ability to leverage advanced AI tools, such as Devin, for efficient code refactoring, optimization, and identifying potential code improvements, thereby enhancing code quality and developer productivity
  • DevOps, Version Control & Containerization: CI/CD pipelines, Git, Docker and Kubernetes
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
What we offer
What we offer
  • medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
  • Fulltime
Read More
Arrow Right

Data Platform Engineer (Python / Golang)

You will work on a live, high-load fleet management platform that connects tens ...
Location
Location
Poland; Ukraine
Salary
Salary:
Not provided
Intellias
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years Python backend in production
  • 2+ years as a lead or principal on a data-heavy platform
  • Typed Python at depth: Pydantic, mypy/pyright, clean code and OOP principles
  • sets standards the team follows
  • AWS data services in production (must-have): Lambda, Kinesis, DynamoDB, S3, Athena/Presto or Redshift, SQS/SNS — owned and operated end-to-end, not just used
  • Event-driven architecture ownership — designs streaming pipelines, DLQ strategies, retry/idempotency patterns
  • makes the calls others follow
  • Data engineering at principal depth: ETL/ELT, schema validation, data contracts, data lake/warehouse architecture
  • defines patterns the team reuses
  • SQL at depth — PostgreSQL and analytical engines (Athena, Redshift)
Job Responsibility
Job Responsibility
  • Own data platform architecture across platform — streaming pipelines, partner integrations, and core backend services
  • Define and enforce backend and data engineering standards: service contracts, error handling, logging, secrets management
  • Own code quality and architectural consistency
  • Own event-driven integrations with 20+ external data partners — data contracts, ingestion, transformation, failure handling
  • Design and govern data models across PostgreSQL, DynamoDB, S3, and analytical systems
  • Define and maintain IaC architecture for owned services using Terraform
  • Collaborate with DevOps on deployment patterns, observability, and incident runbooks
  • Monitor production systems, drive alerting standards, and lead resolution of critical data incidents
  • Represent backend and data constraints in planning and API contract discussions — raises risks before implementation starts
  • Produce and maintain architecture documentation, ADRs, and onboarding materials
What we offer
What we offer
  • Comfortable atmosphere
  • support for well-being
  • charge professional growth
  • equity, diversity, and inclusion
  • Fulltime
Read More
Arrow Right

Lead Data Engineer (Platform)

As a Lead Data Engineer (Platform), you are passionate about engineering excelle...
Location
Location
North Macedonia
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong proficiency in Python for building frameworks, automation tooling and reusable components
  • Hands-on experience with Databricks (including notebooks, workflows, jobs and Unity Catalog)
  • Strong SQL skills and experience with distributed processing frameworks such as Apache Spark
  • Deep experience with dbt Core, including project structure, models, tests, macros and deployment at scale
  • Proven experience designing and maintaining CI/CD pipelines (e.g. GitHub Actions, Azure DevOps or GitLab CI)
  • Experience with data engineering platform design, including scalable pipeline and workflow architectures
  • Strong understanding of software engineering principles (DRY, SOLID, modular design)
  • Experience working with version control systems and modern Git workflows
  • Experience with cloud platforms (preferably AWS) and infrastructure-as-code concepts (e.g. Terraform)
  • Experience implementing automated testing strategies (unit, integration, data quality)
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data engineering frameworks and platform utilities used across engineering teams
  • Develop reusable patterns, templates, and abstractions to standardise and accelerate delivery
  • Define and evolve platform architecture decisions, ensuring scalability, maintainability and consistency
  • Design and implement CI/CD pipelines and automation frameworks to improve engineering velocity
  • Define and enforce engineering standards for testing, code quality, deployment and documentation
  • Identify and eliminate manual or repetitive processes through automation and tooling improvements
  • Integrate AI-assisted development tools into engineering workflows to improve productivity
  • Develop and maintain AI engineering assets such as coding guidelines, prompt frameworks and reusable agent configurations
  • Lead the development and operational support of core data transformation frameworks (including dbt Core at enterprise scale)
  • Investigate and resolve framework-level issues, including deployment failures, dependency conflicts and production incidents
What we offer
What we offer
  • Private health insurance
  • Education program
  • Wellbeing program
  • Free beverages
  • Events
  • Competitive conditions
  • Challenging projects
  • Cool colleagues
  • Honest feedback
  • Fulltime
Read More
Arrow Right

Lead Data Engineer (Platform)

As a Lead Data Engineer (Platform), you are passionate about engineering excelle...
Location
Location
Poland
Salary
Salary:
Not provided
valtech.com Logo
Valtech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong proficiency in Python for building frameworks, automation tooling and reusable components
  • Hands-on experience with Databricks (including notebooks, workflows, jobs and Unity Catalog)
  • Strong SQL skills and experience with distributed processing frameworks such as Apache Spark
  • Deep experience with dbt Core, including project structure, models, tests, macros and deployment at scale
  • Proven experience designing and maintaining CI/CD pipelines (e.g. GitHub Actions, Azure DevOps or GitLab CI)
  • Experience with data engineering platform design, including scalable pipeline and workflow architectures
  • Strong understanding of software engineering principles (DRY, SOLID, modular design)
  • Experience working with version control systems and modern Git workflows
  • Experience with cloud platforms (preferably AWS) and infrastructure-as-code concepts (e.g. Terraform)
  • Experience implementing automated testing strategies (unit, integration, data quality)
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable data engineering frameworks and platform utilities used across engineering teams
  • Develop reusable patterns, templates, and abstractions to standardise and accelerate delivery
  • Define and evolve platform architecture decisions, ensuring scalability, maintainability and consistency
  • Design and implement CI/CD pipelines and automation frameworks to improve engineering velocity
  • Define and enforce engineering standards for testing, code quality, deployment and documentation
  • Identify and eliminate manual or repetitive processes through automation and tooling improvements
  • Integrate AI-assisted development tools into engineering workflows to improve productivity
  • Develop and maintain AI engineering assets such as coding guidelines, prompt frameworks and reusable agent configurations
  • Lead the development and operational support of core data transformation frameworks (including dbt Core at enterprise scale)
  • Investigate and resolve framework-level issues, including deployment failures, dependency conflicts and production incidents
What we offer
What we offer
  • 24 working days of paid vacation
  • National holidays covered
  • Sick leave (up to 20/year)
  • Unpaid leave (up to 20/year)
  • Medical insurance
  • Multisport card OR Multikafeteria
  • Maternity & paternity leave support
  • Internal workshops & learning initiatives
  • Professional certifications reimbursement
  • Participation in professional local & global communities
Read More
Arrow Right