CrawlJobs Logo
Microsoft Corporation Logo Microsoft Corporation · IT - Software Development

Principal Software Engineer--Web data platform

China, Beijing · Job Posted February 21, 2026
Apply Position
Job Link Share

Job Description

We are looking for a talented and experienced Principal Software Engineer to join Bing Crawler team in MAI Web Data Platform org. The Microsoft AI (MAI) builds comprehensive and engaging content, services, and platforms for consumers to access the information they need anywhere on any device and for enterprises to enhance their employee and customer experiences. At Web Data Platform Team, we build the global web scale Index and the platform that supports it. You will be responsible for designing, developing and improving the architecture and codebase of our large-scale web crawler platform system, which fetch, render, process, and store billions of web pages every day. You will also have the opportunity to mentor a team of software engineers, drive technical innovation and decisions, and collaborate with other teams across Bing and Microsoft.

Job Responsibility

  • Design the architecture of Crawler system, ensuring scalability, efficiency, performance and quality
  • Implement features in a distributed and scalable environment using data to guide and measure success
  • Develop and execute unit, integration, and performance tests to ensure the system is reliable, robust, and meets quality standards
  • Debug and mitigate incidents in live production environments
  • Stay up to date with the latest industry trends and technologies and proactively suggest improvements to the existing system
  • Collaborate closely with cross-functional teams, including product managers and other engineers, to align development goals with business objectives

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 7+ years of professional software development experience
  • Proficiency in at least one high-level programming language including but not limited to: C++, C#, Java, Golang or Rust
  • Good communication, collaboration and problem-solving skills
  • Fluent English speaking and writing
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have

  • Experience of large-scale distributed system
  • Familiarity with online service high performance tuning
  • Familiarity with large-scale data processing and storage
  • Nice to have crawling system experience
  • Nice to have search engine platform development experience
  • Nice to have machine learning project experience
Microsoft Corporation - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Principal Software Engineer--Web data platform

8 matching positions

Principal Software Engineer--Web data platform

We are looking for a highly motivated and experienced platform engineer to join ...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Solid foundation in distributed systems, concurrency, networking, and system design
  • Excellent communication, collaboration, and problem‑solving skills
  • Fluency in English (spoken and written)
Job Responsibility
Job Responsibility
  • Design and architect large‑scale distributed pipelines to ensure scalability, robustness, performance, and cost efficiency
  • Implement new features and system improvements in highly distributed, parallelized environments, using data to measure and validate impact
  • Develop and maintain comprehensive test coverage, including unit, integration, and performance tests, ensuring production-grade reliability
  • Debug, triage, and mitigate issues in live production environments handling massive data flows
  • Continuously improve the system architecture, proposing and driving enhancements based on industry best practices and emerging technologies
  • Collaborate cross‑functionally with engineers, PMs, and partner teams to align technical execution with business and product objectives
  • Contribute to engineering excellence, operational rigor, and incident‑free execution for mission‑critical pipelines that support Bing’s web data ecosystem
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, Financial Data Platform & GenSearch Agent

At AlphaSense, GenSearch is a production, customer-facing generative AI system d...
Location
Location
United States
Salary
Salary:
246000.00 - 339000.00 USD / Year
alpha-sense.com Logo
AlphaSense
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years building and operating production systems
  • Experience operating at a Staff or Principal level
  • Proven ability to simplify complex systems and reduce architectural entropy
  • Strong background in distributed systems and performance optimization
  • Experience building AI-integrated systems (LLM orchestration, tool usage, retrieval, evaluation)
  • Comfortable working across backend systems and modern frontend frameworks (e.g., React)
  • Experienced designing APIs and durable service contracts
  • Effective at driving cross-team technical initiatives
Job Responsibility
Job Responsibility
  • Improve AI & Performance
  • Optimize orchestration between LLM workflows, structured datasets, and services
  • Introduce performance benchmarks, observability standards, and SLO discipline
  • Improve reliability and correctness of AI-backed financial responses
  • Simplify Architecture
  • Reduce fragmentation across datasets and services
  • Partner with data platform teams to define scalable dataset integration patterns
  • Remove legacy complexity while continuing to ship
  • Build & Evolve Web Products
  • Contribute directly to backend and frontend systems powering financial data experiences
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, Web

The Walmart Emerging-Tech group is a group charted to drive the creation of the ...
Location
Location
United States of America , Bentonville
Salary
Salary:
110000.00 - 220000.00 USD / Year
walmart.com Logo
Walmart
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years’ experience in software engineering or related area.
  • Option 2: 7 years’ experience in software engineering or related area.
  • Ideally 12+ experience in software development, focusing on building Frontend Websites/Sharable Widgets.
  • Expertise in Javascript/TypeScript, frameworks such as React, Vue, Angular, and working with React Router and Redux.
  • Proficiency in API integration and development, Node.js, GQL
  • Advanced knowledge of complex software design, distributed system design, design patterns, data structures, and algorithms.
  • Excellent technical debugging and production support skills.
  • Familiarity with public cloud technologies such as Azure or Google Cloud Platform.
  • Extensive experience in the design, development, and delivery of software products with a large user base.
  • Excellent decision-making skills with the ability to balance conflicting interests in a complex and fast-paced environment.
Job Responsibility
Job Responsibility
  • Guide and mentor a team of engineers, conducting code reviews and leading design discussions to ensure engineering best practices.
  • Act as a technical authority, providing direction and expertise to the team.
  • Drive the adoption of coding standards, design patterns, and development best practices.
  • Lead the creation and maintenance of our technical architecture, aligning it with business goals and scalability requirements.
  • Architect complex software systems, ensuring performance, security, and scalability needs are met.
  • Consistently produce high-quality software with a focus on unit testing, functional testing, regular code reviews, and continuous integration.
  • Uphold high standards in quality and operational excellence.
  • Develop comprehensive technical documentation and presentations to clearly communicate architectural decisions and design options.
  • Ensure documentation aligns with project scopes, milestones, and deliverables.
  • Promote and enforce technical standards across the organization to achieve concrete outcomes and drive engineering excellence.
What we offer
What we offer
  • Incentive awards for your performance
  • 401(k) match
  • stock purchase plan
  • paid maternity and parental leave
  • PTO
  • multiple health plans
  • medical coverage
  • vision coverage
  • dental coverage
  • company-paid life insurance
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Data, Personalization - Microsoft AI

As Microsoft continues to redefine the future of AI, we are seeking passionate e...
Location
Location
United States , Redmond
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 4+ years' experience building scalable services, including securing applications and infrastructure on top of cloud infrastructure like Azure, AWS, or GCP
  • 3+ years' experience in OSS data technology, such as Kafka, Spark, Flink
  • Experience with large scale data systems
  • Experience working with AI platforms, frameworks, and APIs
  • Experience using Machine Learning frameworks, including experience using, deploying, and scaling language learning models, either personally or professionally
  • Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience
  • Demonstrated interpersonal skills and ability to work closely with cross-functional teams, including product managers, designers, and other engineers
  • Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in web, data systems and AI
  • Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines
Job Responsibility
Job Responsibility
  • Architect scalable, low-latency systems for ingesting, processing, and serving personalized signals
  • Design data models and APIs that enable Copilot to reason about user context, preferences, and history
  • Build real-time and batch personalization engines that adapt Copilot’s behavior
  • Collaborate with privacy, security, and responsible AI teams to ensure personalization is safe, transparent, and user-controlled
  • Optimize for performance, reliability, and cost across diverse workloads and geographies
  • Ship high-quality, well-tested, secure, and maintainable code
  • Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively
  • Enjoy working in a fast-paced, design-driven, product development cycle
  • Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Our Client is seeking a Principal Data Engineer to roll up their sleeves and bui...
Location
Location
United States , New York
Salary
Salary:
175000.00 - 220000.00 USD / Year
solomonpage.com Logo
Solomon Page
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong foundation in software engineering principles, including SOLID design, modularity, and scalability.
  • Expert proficiency in Databricks, including Delta Lake, Unity Catalog, Delta Live Tables, MLflow, and Databricks Workflows.
  • Deep experience with Snowflake, including data modeling, performance optimization, and integration with upstream/downstream pipeline tooling.
  • Expert proficiency in Python for data pipeline and automation development.
  • Advanced SQL skills with experience optimizing complex queries and data models at scale.
  • Proven experience designing and maintaining cloud-native data pipelines on AWS (e.g., MWAA/Airflow, Lambda, ECS, SQS, Glue, S3, Redshift, etc.).
  • Experience implementing and managing Terraform or similar IaC frameworks.
  • Strong understanding of lakehouse architecture patterns, data ingestion, transformation, and orchestration, including familiarity with ML/AI pipeline integration patterns.
  • Familiarity with CI/CD pipelines, automated testing, and modern DevOps practices.
  • 8+ years of experience in data engineering or backend development, with a focus on scalable data solutions.
Job Responsibility
Job Responsibility
  • Build and maintain end-to-end data pipelines — from raw ingestion through transformation and delivery — across diverse data sources (APIs, web data, internal feeds, etc.).
  • Hands-on development of scalable, production-grade pipelines within Databricks, including Delta Lake table management, Workflows, and cluster optimization.
  • Build and maintain data models, schemas, and transformation logic in Snowflake, optimizing for performance and reliability.
  • Develop and manage Databricks environments including Unity Catalog, Delta Live Tables, and integration patterns that support both internal data consumers and external sharing use cases.
  • Build and manage orchestration workflows using AWS services (MWAA/Airflow, Lambda, ECS, SQS, MSK) and Databricks-native orchestration where appropriate.
  • Implement and maintain infrastructure as code (IaC) using Terraform, ensuring reproducibility and compliance with cloud standards.
  • Establish and enforce best practices in data modeling, schema design, and ETL/ELT processes for high-volume structured and semi-structured data across Snowflake and Databricks.
  • Ensure data quality, lineage, and observability through automated testing, monitoring, and alerting across all pipeline layers.
  • Collaborate closely with technology leadership to align data platform development with business strategy and product goals.
  • Stay at the forefront of industry trends in data engineering, lakehouse architecture, and cloud-native data platforms.
  • Fulltime
Read More
Arrow Right

Executive Manager - Principal Software Engineer

The Senior Software Engineer will play a pivotal role in software development ac...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
pepsico.com Logo
Pepsico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A Bachelor's Degree in Computer Science, Engineering or a related field
  • Minimum of 6 years of relevant software development and engineering management experience
  • 3+ years of experience on architecting fault tolerant, high scale distributed systems
  • Commanding knowledge of data structures, algorithms, and object-oriented design
  • Expertise in Java and Spring / SpringBoot ecosystem, JUnit , BackEnd MicroServices, Serverless Computing, Creating REST API'S
  • Experience with Azure Google Cloud, Amazon Web Services and cloud specific PaaS and SaaS solutions
  • Experience with mission critical, 24x7 systems
  • Experience with high throughput cloud native distributed systems
  • Experience implementing and consuming large-scale web services
  • Deep knowledge of design patterns
Job Responsibility
Job Responsibility
  • Support the vision and guide a team of engineers to build and support digital products and services (DPS) across S&T core priorities
  • Partner with User Experience, Product Management, IT, Data & Analytics, Emerging Tech, Innovation, and Process Engineering teams to deliver the Digital Products portfolio
  • Support software development strategy utilizing industry standards. Create roadmap and timing of implementation of the roadmap based on business requirements and strategy
  • Support expanding DPS capabilities through a customer obsessed, services-driven digital solutions platform that leverages data and AI to deliver automated and personalized experiences
  • Help problem solve delivery impediments, risks, issues, and changes tied to the engineering initiatives to the stakeholders
  • Interact with key business partners to recommend solutions that best meet the strategic needs of the business
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Evisort AI

Location
Location
Canada , Vancouver; Toronto
Salary
Salary:
168000.00 - 252000.00 CAD / Year
Workday
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in software engineering
  • 8+ years experience with a web development framework (Flask, Django, FastAPI, NestJS, Sprint Boot, Ruby on Rails, ASP.NET, etc.)
  • 8+ years with PostgreSQL DB and SQL
  • Experience building and operating SaaS products in major cloud environments (AWS preferred)
  • Deep understanding of the tradeoffs and architecture of modern, highly-available, distributed systems
  • Exceptional influence and communication skills to translate architecture to business value for all stakeholders
  • Expert knowledge of software development best practices (DevOps, CI/CD, automated testing, observability)
  • Hands-on experience with containerization technologies (Docker, Kubernetes)
  • Familiarity with Elasticsearch
  • Exposure to additional programming languages like Java (backend) and TypeScript (frontend/fullstack) is a plus
Job Responsibility
Job Responsibility
  • Collaborate with engineering, data science, product, and develop teams to build and evolve our vision, strategy, and roadmap
  • Participate in an encouraging, iterative team culture that values curiosity, learning, and strong engineering practices
  • Contribute to the growth and success of your teammates through knowledge sharing and mentorship
  • Take ownership of multiple functional areas in our platform — from development to production (“you build it, you run it”)
What we offer
What we offer
  • Workday Bonus Plan or a role-specific commission/bonus
  • annual refresh stock grants
  • comprehensive benefits
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

As a Principal Software Engineer, you will provide technical leadership across t...
Location
Location
Japan , Tokyo
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in computer science or a related technical discipline, along with at least 8 years of engineering experience, including proficiency in programming languages such as C++, C#, Java, JavaScript, or Python
  • Extensive expertise in iOS and/or Android development
  • strong full-stack engineering capabilities with comprehensive knowledge of consumer product development
  • Demonstrated ability to lead through influence, establishing technical direction for teams of 3–10 engineers across US, Japan, and China time zones. Experienced in conducting architecture reviews, design sprints, and technical alignment sessions
  • Solid background in AI, including hands-on experience developing AI products or integrating AI into daily development processes
  • Speaking English is required for daily work.
Job Responsibility
Job Responsibility
  • Own the end-to-end system architecture for the Mico experience, spanning 3D rendering (Picasso stack / Babylon Native), real-time character animation, lip-sync, locomotion, and expression systems
  • Design and evolve the LLM orchestration layer that powers Mico's conversational intelligence, including prompt management, skill routing, and context window optimization
  • Architect the long-term memory system (Cosmos DB) — defining schemas, event handling, message partitioning, and retrieval strategies that enable Mico to remember and adapt to each user
  • Drive the adaptive personalization framework that governs how Mico adjusts behavior, tone, and interaction patterns based on user history and preferences
  • Architect solutions that work consistently across CMC (web), iOS, Android, and Windows surfaces, defining shared rendering abstractions and platform-specific optimizations
  • Coordinate Unified UI integration — ensuring Mico's visual presence (header, footer, composer, snap-to positioning) works seamlessly with the Copilot shell across all form factors
  • Own the asset pipeline: CDN-delivered 3D models, video backgrounds, animation configs, and per-surface configuration files
  • Design systems for millions of daily active users — low-latency rendering, efficient asset delivery via CDN, graceful degradation on low-end devices, and robust error recovery
  • Build and maintain observability dashboards using Azure Data Explorer (Kusto) to monitor Mico engagement, conversation duration, animation frame rates, and error rates across surfaces
  • Partner with data science to design controlled flights and ablation experiments, interpret telemetry, and use data to guide decisions
  • Fulltime
Read More
Arrow Right