CrawlJobs Logo

Principal Software Engineer--Web data platform

China, Beijing · Job Posted January 29, 2026
Apply Position
Job Link Share

Job Description

We are looking for a highly motivated and experienced platform engineer to join the Web Data Platform Engineering Team, responsible for some of Bing’s most critical data processing systems and pipelines. These systems and pipelines form the backbone of Bing’s web understanding stack, powering content extraction, enrichment, and understanding at massive Internet scale. In this role, you will design, build, and evolve large-scale distributed systems that process billions of documents per day with low latency and high reliability. You will work with both in‑house frameworks and open-source technologies to build next‑generation data processing platforms that enable downstream services—such as indexing, ranking, and AI-driven experiences—to deeply understand the web.

Job Responsibility

  • Design and architect large‑scale distributed pipelines to ensure scalability, robustness, performance, and cost efficiency
  • Implement new features and system improvements in highly distributed, parallelized environments, using data to measure and validate impact
  • Develop and maintain comprehensive test coverage, including unit, integration, and performance tests, ensuring production-grade reliability
  • Debug, triage, and mitigate issues in live production environments handling massive data flows
  • Continuously improve the system architecture, proposing and driving enhancements based on industry best practices and emerging technologies
  • Collaborate cross‑functionally with engineers, PMs, and partner teams to align technical execution with business and product objectives
  • Contribute to engineering excellence, operational rigor, and incident‑free execution for mission‑critical pipelines that support Bing’s web data ecosystem

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Solid foundation in distributed systems, concurrency, networking, and system design
  • Excellent communication, collaboration, and problem‑solving skills
  • Fluency in English (spoken and written)

Nice to have

Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal Software Engineer--Web data platform

8 matching positions

Principal Software Engineer--Web data platform

We are looking for a talented and experienced Principal Software Engineer to joi...
Location
Location
China , Beijing
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 7+ years of professional software development experience
  • Proficiency in at least one high-level programming language including but not limited to: C++, C#, Java, Golang or Rust
  • Good communication, collaboration and problem-solving skills
  • Fluent English speaking and writing
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Job Responsibility
Job Responsibility
  • Design the architecture of Crawler system, ensuring scalability, efficiency, performance and quality
  • Implement features in a distributed and scalable environment using data to guide and measure success
  • Develop and execute unit, integration, and performance tests to ensure the system is reliable, robust, and meets quality standards
  • Debug and mitigate incidents in live production environments
  • Stay up to date with the latest industry trends and technologies and proactively suggest improvements to the existing system
  • Collaborate closely with cross-functional teams, including product managers and other engineers, to align development goals with business objectives
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, Financial Data Platform & GenSearch Agent

At AlphaSense, GenSearch is a production, customer-facing generative AI system d...
Location
Location
United States
Salary
Salary:
246000.00 - 339000.00 USD / Year
alpha-sense.com Logo
AlphaSense
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years building and operating production systems
  • Experience operating at a Staff or Principal level
  • Proven ability to simplify complex systems and reduce architectural entropy
  • Strong background in distributed systems and performance optimization
  • Experience building AI-integrated systems (LLM orchestration, tool usage, retrieval, evaluation)
  • Comfortable working across backend systems and modern frontend frameworks (e.g., React)
  • Experienced designing APIs and durable service contracts
  • Effective at driving cross-team technical initiatives
Job Responsibility
Job Responsibility
  • Improve AI & Performance
  • Optimize orchestration between LLM workflows, structured datasets, and services
  • Introduce performance benchmarks, observability standards, and SLO discipline
  • Improve reliability and correctness of AI-backed financial responses
  • Simplify Architecture
  • Reduce fragmentation across datasets and services
  • Partner with data platform teams to define scalable dataset integration patterns
  • Remove legacy complexity while continuing to ship
  • Build & Evolve Web Products
  • Contribute directly to backend and frontend systems powering financial data experiences
  • Fulltime
Read More
Arrow Right

Principal Software Engineer, Web

The Walmart Emerging-Tech group is a group charted to drive the creation of the ...
Location
Location
United States of America , Bentonville
Salary
Salary:
110000.00 - 220000.00 USD / Year
walmart.com Logo
Walmart
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years’ experience in software engineering or related area.
  • Option 2: 7 years’ experience in software engineering or related area.
  • Ideally 12+ experience in software development, focusing on building Frontend Websites/Sharable Widgets.
  • Expertise in Javascript/TypeScript, frameworks such as React, Vue, Angular, and working with React Router and Redux.
  • Proficiency in API integration and development, Node.js, GQL
  • Advanced knowledge of complex software design, distributed system design, design patterns, data structures, and algorithms.
  • Excellent technical debugging and production support skills.
  • Familiarity with public cloud technologies such as Azure or Google Cloud Platform.
  • Extensive experience in the design, development, and delivery of software products with a large user base.
  • Excellent decision-making skills with the ability to balance conflicting interests in a complex and fast-paced environment.
Job Responsibility
Job Responsibility
  • Guide and mentor a team of engineers, conducting code reviews and leading design discussions to ensure engineering best practices.
  • Act as a technical authority, providing direction and expertise to the team.
  • Drive the adoption of coding standards, design patterns, and development best practices.
  • Lead the creation and maintenance of our technical architecture, aligning it with business goals and scalability requirements.
  • Architect complex software systems, ensuring performance, security, and scalability needs are met.
  • Consistently produce high-quality software with a focus on unit testing, functional testing, regular code reviews, and continuous integration.
  • Uphold high standards in quality and operational excellence.
  • Develop comprehensive technical documentation and presentations to clearly communicate architectural decisions and design options.
  • Ensure documentation aligns with project scopes, milestones, and deliverables.
  • Promote and enforce technical standards across the organization to achieve concrete outcomes and drive engineering excellence.
What we offer
What we offer
  • Incentive awards for your performance
  • 401(k) match
  • stock purchase plan
  • paid maternity and parental leave
  • PTO
  • multiple health plans
  • medical coverage
  • vision coverage
  • dental coverage
  • company-paid life insurance
  • Fulltime
Read More
Arrow Right

Principal Software Engineer - Data, Personalization - Microsoft AI

As Microsoft continues to redefine the future of AI, we are seeking passionate e...
Location
Location
United States , Redmond
Salary
Salary:
163000.00 - 296400.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 4+ years' experience building scalable services, including securing applications and infrastructure on top of cloud infrastructure like Azure, AWS, or GCP
  • 3+ years' experience in OSS data technology, such as Kafka, Spark, Flink
  • Experience with large scale data systems
  • Experience working with AI platforms, frameworks, and APIs
  • Experience using Machine Learning frameworks, including experience using, deploying, and scaling language learning models, either personally or professionally
  • Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience
  • Demonstrated interpersonal skills and ability to work closely with cross-functional teams, including product managers, designers, and other engineers
  • Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in web, data systems and AI
  • Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines
Job Responsibility
Job Responsibility
  • Architect scalable, low-latency systems for ingesting, processing, and serving personalized signals
  • Design data models and APIs that enable Copilot to reason about user context, preferences, and history
  • Build real-time and batch personalization engines that adapt Copilot’s behavior
  • Collaborate with privacy, security, and responsible AI teams to ensure personalization is safe, transparent, and user-controlled
  • Optimize for performance, reliability, and cost across diverse workloads and geographies
  • Ship high-quality, well-tested, secure, and maintainable code
  • Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively
  • Enjoy working in a fast-paced, design-driven, product development cycle
  • Embody our Culture and Values
  • Fulltime
Read More
Arrow Right

Principal Engineer, Web Platform

Intercom’s websites, including intercom.com and fin.ai, are strategic growth lev...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
intercom.com Logo
Intercom
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of software engineering experience
  • Experience in a high-scale growth-focused web environment
  • A track record of technical leadership and influencing technical direction across multiple teams or departments
  • Deep familiarity with modern web stacks and infrastructure
  • Strong understanding of data infrastructure, including event instrumentation, and analytics tooling
  • Comfortable working in and supporting full-stack codebases
  • Experience operating in continuous delivery environments with an emphasis on incremental, high-quality shipping
  • Exceptional communication skills and a history of collaborating with cross-functional teams (product, marketing, analytics, design, etc.)
  • A mentorship mindset — proven ability to raise the bar for engineering excellence across a team or organization
Job Responsibility
Job Responsibility
  • Own and evolve the architecture of Intercom’s web stack
  • Define the long-term technical strategy for the web team, focusing on scalability, performance, developer productivity, observability, and system reliability
  • Collaborate closely with marketing, design, analytics, and data science stakeholders to ensure the platform supports their goals with accuracy, performance, and agility
  • Lead and influence the design and implementation of MarTech systems for event tracking, attribution, funnel reporting, A/B testing infrastructure, and more
  • Partner with engineers across web, infrastructure, and data to create a high-quality, cohesive technical ecosystem
  • Mentor and elevate engineers across the team and organisation — providing guidance on architecture, data modeling, system design, and engineering best practices
  • Set the standard for technical excellence in reliability, maintainability, code quality, and operational readiness
  • Provide technical leadership and insight to Engineering Managers, Product Managers, and executive stakeholders — communicating risks, trade-offs, and opportunities clearly
  • Contribute hands-on to the codebase — leading by example and helping unblock and accelerate key projects
What we offer
What we offer
  • Competitive salary and equity in a fast-growing start-up
  • We serve lunch every weekday, plus a variety of snack foods and a fully stocked kitchen
  • Regular compensation reviews - we reward great work
  • Pension scheme & match up to 4%
  • Peace of mind with life assurance, as well as comprehensive health and dental insurance for you and your dependents
  • Flexible paid time off policy
  • Paid maternity leave, as well as 6 weeks paternity leave for fathers
  • Cycle-to-Work Scheme
  • MacBooks are our standard, but we also offer Windows for certain roles when needed
  • Fulltime
Read More
Arrow Right

Principal Engineer, Web Platform

Intercom’s websites, including intercom.com and fin.ai, are strategic growth lev...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
intercom.com Logo
Intercom
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of software engineering experience
  • Experience in a high-scale growth-focused web environment
  • A track record of technical leadership and influencing technical direction across multiple teams or departments
  • Deep familiarity with modern web stacks and infrastructure
  • Strong understanding of data infrastructure, including event instrumentation, and analytics tooling
  • Comfortable working in and supporting full-stack codebases
  • Experience operating in continuous delivery environments with an emphasis on incremental, high-quality shipping
  • Exceptional communication skills and a history of collaborating with cross-functional teams (product, marketing, analytics, design, etc.)
  • A mentorship mindset — proven ability to raise the bar for engineering excellence across a team or organization
Job Responsibility
Job Responsibility
  • Own and evolve the architecture of Intercom’s web stack
  • Define the long-term technical strategy for the web team, focusing on scalability, performance, developer productivity, observability, and system reliability
  • Collaborate closely with marketing, design, analytics, and data science stakeholders to ensure the platform supports their goals with accuracy, performance, and agility
  • Lead and influence the design and implementation of MarTech systems for event tracking, attribution, funnel reporting, A/B testing infrastructure, and more
  • Partner with engineers across web, infrastructure, and data to create a high-quality, cohesive technical ecosystem
  • Mentor and elevate engineers across the team and organisation — providing guidance on architecture, data modeling, system design, and engineering best practices
  • Set the standard for technical excellence in reliability, maintainability, code quality, and operational readiness
  • Provide technical leadership and insight to Engineering Managers, Product Managers, and executive stakeholders — communicating risks, trade-offs, and opportunities clearly
  • Contribute hands-on to the codebase — leading by example and helping unblock and accelerate key projects
What we offer
What we offer
  • Competitive salary and equity in a fast-growing start-up
  • We serve lunch every weekday, plus a variety of snack foods and a fully stocked kitchen
  • Regular compensation reviews - we reward great work
  • Pension scheme & match up to 4%
  • Peace of mind with life assurance, as well as comprehensive health and dental insurance for you and your dependents
  • Flexible paid time off policy
  • Paid maternity leave, as well as 6 weeks paternity leave for fathers
  • Cycle-to-Work Scheme
  • MacBooks are our standard
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Our Client is seeking a Principal Data Engineer to roll up their sleeves and bui...
Location
Location
United States , New York
Salary
Salary:
175000.00 - 220000.00 USD / Year
solomonpage.com Logo
Solomon Page
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong foundation in software engineering principles, including SOLID design, modularity, and scalability.
  • Expert proficiency in Databricks, including Delta Lake, Unity Catalog, Delta Live Tables, MLflow, and Databricks Workflows.
  • Deep experience with Snowflake, including data modeling, performance optimization, and integration with upstream/downstream pipeline tooling.
  • Expert proficiency in Python for data pipeline and automation development.
  • Advanced SQL skills with experience optimizing complex queries and data models at scale.
  • Proven experience designing and maintaining cloud-native data pipelines on AWS (e.g., MWAA/Airflow, Lambda, ECS, SQS, Glue, S3, Redshift, etc.).
  • Experience implementing and managing Terraform or similar IaC frameworks.
  • Strong understanding of lakehouse architecture patterns, data ingestion, transformation, and orchestration, including familiarity with ML/AI pipeline integration patterns.
  • Familiarity with CI/CD pipelines, automated testing, and modern DevOps practices.
  • 8+ years of experience in data engineering or backend development, with a focus on scalable data solutions.
Job Responsibility
Job Responsibility
  • Build and maintain end-to-end data pipelines — from raw ingestion through transformation and delivery — across diverse data sources (APIs, web data, internal feeds, etc.).
  • Hands-on development of scalable, production-grade pipelines within Databricks, including Delta Lake table management, Workflows, and cluster optimization.
  • Build and maintain data models, schemas, and transformation logic in Snowflake, optimizing for performance and reliability.
  • Develop and manage Databricks environments including Unity Catalog, Delta Live Tables, and integration patterns that support both internal data consumers and external sharing use cases.
  • Build and manage orchestration workflows using AWS services (MWAA/Airflow, Lambda, ECS, SQS, MSK) and Databricks-native orchestration where appropriate.
  • Implement and maintain infrastructure as code (IaC) using Terraform, ensuring reproducibility and compliance with cloud standards.
  • Establish and enforce best practices in data modeling, schema design, and ETL/ELT processes for high-volume structured and semi-structured data across Snowflake and Databricks.
  • Ensure data quality, lineage, and observability through automated testing, monitoring, and alerting across all pipeline layers.
  • Collaborate closely with technology leadership to align data platform development with business strategy and product goals.
  • Stay at the forefront of industry trends in data engineering, lakehouse architecture, and cloud-native data platforms.
  • Fulltime
Read More
Arrow Right

Executive Manager - Principal Software Engineer

The Senior Software Engineer will play a pivotal role in software development ac...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
pepsico.com Logo
Pepsico
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A Bachelor's Degree in Computer Science, Engineering or a related field
  • Minimum of 6 years of relevant software development and engineering management experience
  • 3+ years of experience on architecting fault tolerant, high scale distributed systems
  • Commanding knowledge of data structures, algorithms, and object-oriented design
  • Expertise in Java and Spring / SpringBoot ecosystem, JUnit , BackEnd MicroServices, Serverless Computing, Creating REST API'S
  • Experience with Azure Google Cloud, Amazon Web Services and cloud specific PaaS and SaaS solutions
  • Experience with mission critical, 24x7 systems
  • Experience with high throughput cloud native distributed systems
  • Experience implementing and consuming large-scale web services
  • Deep knowledge of design patterns
Job Responsibility
Job Responsibility
  • Support the vision and guide a team of engineers to build and support digital products and services (DPS) across S&T core priorities
  • Partner with User Experience, Product Management, IT, Data & Analytics, Emerging Tech, Innovation, and Process Engineering teams to deliver the Digital Products portfolio
  • Support software development strategy utilizing industry standards. Create roadmap and timing of implementation of the roadmap based on business requirements and strategy
  • Support expanding DPS capabilities through a customer obsessed, services-driven digital solutions platform that leverages data and AI to deliver automated and personalized experiences
  • Help problem solve delivery impediments, risks, issues, and changes tied to the engineering initiatives to the stakeholders
  • Interact with key business partners to recommend solutions that best meet the strategic needs of the business
  • Fulltime
Read More
Arrow Right