CrawlJobs Logo

Principal Software Engineer

United States, Redmond 139900.00 - 274800.00 USD / Year · Job Posted March 19, 2026
Apply Position
Job Link Share

Job Description

Core AI is at the forefront of Microsoft’s mission to redefine how software is built and experienced. We are responsible for building the foundational platforms, services, programming models, and developer experiences that power the next generation of applications using Generative AI. Our work enables developers and enterprises to harness the full potential of AI to create intelligent, adaptive, and transformative software. We build platforms to handle AI workloads for customers and have a significant business impact on products that ship across all Microsoft groups as well as enterprise customers. We are looking for a Principal Software Engineer who will define the future of engineering systems and developer productivity. In this role, you will build high-scale distributed services to support large scale state of the art model training and inference.

Job Responsibility

  • Work on the architecture, design and development of the core compute services powering AzureML to tackle challenging AI problems using state-of-the-art LLM models such as GPT5 and OSS models
  • Work on the architecture, design, and development of the core AI Infrastructure services that support large scale AI training and inferencing
  • Develop, test, and maintain backend services written in C#, Go, Rust, C++, hosted on Kubernetes clusters and Docker containers
  • Develop and operate training/inference infra framework and machine learning systems
  • Enhance systems and applications to ensure high stability, efficiency, & maintainability, low latency, tight cloud security
  • Provide operational support and DRI responsibilities for the product
  • Collaborate closely with engineers, data scientists within the team, internal Microsoft Research teams and external enterprises to build better solutions together
  • Provide vision, expertise, and technical leadership to other team members

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Rust, Go, Java, or Python OR equivalent experience
  • 3+ years of experience operating and designing systems which support large model training
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Nice to have

  • Knowledge and first-hand experience with large model training system
  • Experience in distributed systems and architecture
  • AI infrastructure and workload knowledge

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal Software Engineer

8 matching positions

New

Principal Software Engineer

We are looking for a highly experienced, curious and driven software engineer to...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong software development background including design, architecture, implementation, and testing
  • Knowledge of software development in Golang
  • Advanced knowledge / experience in some/all of networking, security, cloud, Kubernetes, encryption, PKI, JWT, SPIFFE
  • Experience solving problems at enterprise scale, performance and quality standards
  • Experience leading a software development team and mentoring others (with our without line management experience)
  • Experience in product development and working with product managers and field teams
Job Responsibility
Job Responsibility
  • Design and develop software to solve Workload Identity challenges, from prototyping to production, and including client and server
  • Develop, shape, lead, mentor, and collaborate with a close-knit team
  • Work with stakeholders (internal and external) to discuss ideas, present work that has been done, discuss priorities and options
  • Act as the team’s technical lead, splitting up work for others and guiding them through implementation
  • Fulltime
Read More
Arrow Right
New

Principal Software Engineer

Location
Location
United States , Santa Clara
Salary
Salary:
147000.00 - 237500.00 USD / Year
paloaltonetworks.com Logo
Palo Alto Networks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of professional experience in security industry software engineering
  • Expert-level proficiency in at least one typed programming language (e.g., Golang, C/C++, python)
  • Strong foundation in Operating Systems and network security
  • Hands-on experience with Containerization (Docker, Kubernetes)
  • Experience with Cloud Computing platforms (GCP preferred
  • AWS/Azure also valued)
  • Proficiency in CI/CD workflows and configuration management (GitLab CI preferred)
  • Excellent verbal and written communication skills with the ability to articulate complex technical concepts
  • A meticulous attention to detail and a 'security-first' mindset
  • Experience working in Agile/Scrum development environments
Job Responsibility
Job Responsibility
  • Architecture & Design: Spearhead the design and implementation of highly scalable, secure, and performant backend services and on-prem network scanner engines
  • Cloud Development: Build and manage modern cloud-native services, primarily within the Google Cloud Platform (GCP) ecosystem
  • API Excellence: Design and maintain robust, RESTful APIs that serve both internal stakeholders and external global customers
  • Data Modeling: Architect complex data models across both relational (SQL) and non-relational databases to ensure data integrity and high availability
  • Performance Optimization: Use advanced data structures and algorithms to solve complex computational problems and optimize system latency
  • Production Reliability: Troubleshoot, maintain, and enhance production-level code, ensuring high uptime and reliability for new and existing services
  • DevOps Integration: Collaborate with CI/CD pipelines and containerization strategies (Docker/Kubernetes) to streamline deployment and configuration management
  • Mentorship & Collaboration: Work within an Agile environment, participating in peer code reviews and contributing to the technical growth of the team
What we offer
What we offer
  • restricted stock units
  • bonus
  • employee benefits
  • Fulltime
Read More
Arrow Right
New

Principal Software Engineer

We are seeking a talented and motivated Principal Engineer to join our dynamic t...
Location
Location
United States , Cupertino
Salary
Salary:
172000.00 - 349000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A minimum of 15 years of professional software development experience, with a significant portion focused on backend systems and distributed applications
  • Proven expertise in one or more backend programming languages such as Golang (preferred), Java or Python
  • Deep understanding of networking protocols, network architectures, network security, and common networking concepts is essential
  • Proven experience in designing, building, and deploying scalable microservices using Docker, Kubernetes, etc.
  • Significant experience in building, deploying, and operating scalable SaaS applications in a Public Cloud (AWS/GCP) environment
  • Strong understanding of distributed systems principles, including concurrency, scalability, fault tolerance, and consistency
  • Experience with various database technologies, including relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB, Redis) databases
  • Experience designing, building, and consuming RESTful APIs and other integration technologies like WebSocket, Kafka, etc.
  • Excellent analytical and problem-solving skills
  • Strong verbal and written communication skills
Job Responsibility
Job Responsibility
  • Work with product managers, architects, and other engineers to understand the software requirements, and define corresponding functional and design specifications
  • Drive technical decisions and contribute to the overall strategy
  • Design, develop, test, deploy, and maintain high-quality, production-grade software, with a strong emphasis on backend systems
  • Write clean, efficient, and well-documented code
  • Design and implement micro-services for high availability, scalability, performance, and security within our SaaS platform
  • Identify and resolve complex performance bottlenecks and system issues
  • Apply deep knowledge of networking protocols (e.g., TCP/IP, HTTP/S, DNS, NAT), network security, and cloud networking concepts to build robust and secure solutions
  • Design and implement solutions leveraging cloud platforms (e.g., AWS, Azure, GCP) and containerization technologies (e.g., Kubernetes, Docker)
  • Collaborate effectively with cross-functional teams including product management, QA, SRE, and technical assistance team
  • Champion best practices in software development, including code reviews, testing methodologies, CI/CD, and DevOps principles
What we offer
What we offer
  • Health & Wellbeing: comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Personal & Professional Development: programs catered to helping you reach any career goals
  • Unconditional Inclusion: flexibility to manage work and personal needs
  • Variable incentives may also be offered
  • Fulltime
Read More
Arrow Right
New

Principal Software Engineer

The Principal Software Engineer will be a thought leader on architecture and dev...
Location
Location
United States , Massachusetts
Salary
Salary:
200000.00 - 250000.00 USD / Year
apollo-solutions.com Logo
Apollo Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Computer Engineering or a related discipline
  • 8+ years of professional software development experience using Python or another object-oriented language, financial services exposure is a plus
  • 4+ years of experience leading design or architecture of large-scale production systems
  • 3+ years of experience developing large, high-performance, distributed systems
  • 3+ years of experience building high-performance cloud native solutions on public cloud (AWS preferred)
  • 3+ years of experience in container technologies like Kubernetes and Docker
  • 2+ years of experience in building resilient CI/CD pipelines, strong knowledge of Git, and familiarity with a DevOps platform like GitLab
  • 1+ years of experience with Helm and Infrastructure as Code tools (Terraform preferred)
  • strong in computer science fundamentals like data structures, algorithm design and complexity analysis
  • ability to write elegant code, and comfortable with picking up new technologies independently
Job Responsibility
Job Responsibility
  • Work closely with members of the Research group to review and define requirements for the compute platforms, workflow and observability systems, and multiple services (such as Discovery, AI and the others)
  • Provide expert level design that ensures the solution to be scalable, cost effective and to have low maintenance
  • Lead technical design discussions within the team to gather feedback, discuss the merits and risks of different approaches, and reach consensus on the target architecture
  • Develop high quality solutions in both on premise environments and AWS Cloud using Python and other languages
  • Develop Infrastructure-As-Code solutions using Terraform, develop the automated build and deploy pipelines with unit and integrated tests to ensure high quality and efficient operations
  • Provide guidance to other team members on development tasks
  • Promote high quality code via code reviews
  • Provide production support to prevent disruptions to investment processes
  • Fulltime
Read More
Arrow Right
New

Principal Software Engineer

Shape the way the M365 measures and drives the feedback loop for its AI offering...
Location
Location
United States , Redmond
Salary
Salary:
142800.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Partners with appropriate stakeholders to determine user requirements for a set of scenarios
  • Leads identification of dependencies and the development of design documents for a product, application, service, or platform
  • Leads by example and mentors others to produce extensible and maintainable code used across products
  • Leverages subject-matter expertise of cross-product features with appropriate stakeholders (e.g., project managers) to drive multiple group's project plans, release plans, and work items
  • Holds accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions
  • Proactively seeks new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and shares knowledge with other engineers.
  • Fulltime
Read More
Arrow Right
New

Principal Software Engineer

Do you want to build AI-powered developer services that enable a billion builder...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, or equivalent practical experience
  • 10+ years of industry experience building and shipping software using modern programming languages such as C#, C++, Java, Go or Python
  • Track record of successfully leading end-to-end engineering projects from conception to delivery across multiple ship cycles
  • Excellent technical design, problem solving and debugging skills
  • Ability to learn new technologies quickly and adapt to deliver customer and business impact
  • Customer obsession and passion for shipping high quality products
  • Track record of collaborating effectively with multiple cross-functional teams across geographies
Job Responsibility
Job Responsibility
  • Design, implement, test, instrument, document and run PaaS Services in Azure
  • Partner with product management, OSS community, ISV partners, customers, and other stakeholders to define requirements, scope projects and ship products in rapid, iterative cycles
  • Stay up to date on industry trends around AI Advancements, Cloud Native technologies, open source development and dev ops processes, leading efforts on innovation, modern design, and reliability engineering
  • Champion engineering practices of safe and fast paced releases – e.g. flight code changes and drive telemetry and analytics to take a data-driven approach to understanding customer impact
  • Support and influence team culture of customer obsession, continuous improvement, reflection, and growth - mentor, initiate and participate in in design and code sharing
  • Be avid customer advocate – meet with customers, and product support to learn about their experience, analyze how features are performing in production and make the product better
  • Build for security, privacy, scalability, reliability, and compliance
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

OneTrust’s mission is to enable innovation through the responsible use of data a...
Location
Location
India , Bengaluru
Salary
Salary:
Not provided
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science or related field
  • 8+ years of professional software development experience
  • Strong backend experience with Java, Spring Boot, REST APIs
  • Hands-on experience with Kafka or RabbitMQ
  • Experience with Docker and cloud platforms (Azure, AWS, or GCP)
  • Recent hands-on development using Java 7+ and Spring Boot
  • Ownership of production support in real-world environments
  • Experience operating systems at scale and high throughput
Job Responsibility
Job Responsibility
  • Design, develop, and unit test scalable backend services on Microsoft Azure
  • Contribute to cloud-native architecture using Core Java, Spring Boot, and REST APIs
  • Maintain high code quality with 80%+ code coverage (or per team standards)
  • Partner closely with Product Managers, Product Owners, UX, and Engineering teams
  • Contribute to sprint planning, grooming, and architectural discussions
  • Ensure sprint commitments are delivered in line with sprint goals
  • Build high-quality, maintainable code following engineering best practices
  • Reduce defects by identifying and fixing issues early in the development cycle
  • Ensure critical and high-priority incidents are resolved within SLA
  • Own production issue troubleshooting, incident analysis, and root-cause resolution
What we offer
What we offer
  • Comprehensive healthcare coverage
  • Flexible PTO
  • Equity RSUs
  • Annual performance bonus opportunities
  • Retirement account support
  • 14+ weeks of paid parental leave
  • Career development opportunities
  • Company-paid privacy certification exam fees
Read More
Arrow Right

Principal Software Engineer

We use optional cookies to improve your experience on our websites, such as thro...
Location
Location
United States , Houston
Salary
Salary:
142800.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Microsoft is unable to sponsor a work visa for this role due to the nature of the role’s job duties.
Job Responsibility
Job Responsibility
  • Partners with appropriate stakeholders to determine user requirements for a set of scenarios
  • Leads identification of dependencies and the development of design documents for a product, application, service, or platform
  • Leads by example and mentors others to produce extensible and maintainable code used across products
  • Leverages subject-matter expertise of cross-product features with appropriate stakeholders to drive multiple group's project plans, release plans, and work items
  • Holds accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions
  • Proactively seeks new knowledge and adapts to new trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale and shares knowledge with other engineers
  • Embodies our culture and values
What we offer
What we offer
  • Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work
  • Certain roles may be eligible for benefits and other compensation
  • Fulltime
Read More
Arrow Right