CrawlJobs Logo

Principal AI Software Architect

https://www.microsoft.com/ Logo

Microsoft Corporation

Location Icon

Location:
United States , Redmond

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

139900.00 - 274800.00 USD / Year

Job Description:

Do you want to be at the forefront of innovating the latest hardware designs to propel Microsoft’s cloud growth? Are you seeking a unique career opportunity that combines technical capabilities, cross-team collaboration, with business insight and strategy? Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to achieve our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. Join the Systems Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s "Intelligent Cloud" mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live. As Principal AI Software Architect for Microsoft MAIA accelerators within the SPARC team, you will play a pivotal role in enabling and optimizing machine learning model training workflows on our cutting-edge hardware. Your responsibilities will include bringing up and validating training processes on MAIA accelerators, collaborating with engineering and research teams to understand MAIA accelerator architecture, and enabling training recipes developed for Microsoft’s first-party accelerators. You will utilize your hands-on experience with PyTorch and at least one of Triton or CUDA to ensure efficient and scalable deployment of large models. This role is ideal for candidates who thrive in a dynamic environment and are passionate about advancing AI infrastructure and model performance on next-generation hardware platforms.

Job Responsibility:

  • Leads by example across teams and mentors others to produce extensible, maintainable, well-tested, secure, and performant code used across products that adheres to design specifications
  • Leads efforts to continuously improve code performance, testability, maintainability, effectiveness, and cost, while learning about and accounting for relevant trade-offs
  • Identifies best practices and coding patterns (e.g., leveraging state-of-the-art generative artificial intelligence [GenAI], approaches to source code organization, naming conventions) and provides deep expertise in the coding and validation strategy
  • Creates and applies metrics to drive code quality and stability, appropriate coding patterns, and best practices
  • Identifies and anticipates blockers or unknowns during the development process, escalates them, communicates how they will impact timelines, and then leads efforts to identify and implement strategies and/or opportunities to address them
  • Reviews product code and test code to ensure it meets team standards, contains the correct test coverage, and is appropriate for the product or solution area
  • Brings insight to code reviews to help improve code quality, coaching and providing feedback to develop other engineers' skills
  • Conducts code reviews in a timely fashion that helps accelerate the pace of development on the team. Considers diagnosability, reliability, testability, and maintainability when reviewing code, and understands when code is ready to be shared or delivered
  • Applies and reviews for coding patterns, security risks, compliance issues, and best practices in code reviews, providing feedback on code to drive adherence to best practices
  • Uses automated source code analysis tools that are incorporated into the build/development process

Requirements:

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, PyTorch, CUDA/Triton
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Nice to have:

  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Accelerator architecture
  • Mapping of models to accelerators
  • Number formats
  • AI model architecture

Additional Information:

Job Posted:
May 05, 2026

Employment Type:
Fulltime
Work Type:
Hybrid work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Principal AI Software Architect

Principal Software Engineer - Central AI

The Central AI org’s purpose is to accelerate AI innovation across all our produ...
Location
Location
United States , Mountain View; San Francisco; Austin; New York
Salary
Salary:
170800.00 - 274300.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 12 years of hands-on experience in software/technology roles, in Enterprise Products & Solutions in the cloud
  • Proficiency with cloud-native technologies, ideally AWS
  • At least 2 years of experience architecting and implementing multiple features of a SaaS product at a high scale, performance and reliability of 4 nines
  • Experience with building and delivering multi-tenant cloud-native SaaS software
  • Strong understanding of distributed systems, modern cloud-native architectures, and distributed data management
  • Excellent communication skills and demonstrated success in articulating and pitching technical vision to stakeholders
  • Ability to balance short- and long-term objectives, focusing on both technical and business outcomes
Job Responsibility
Job Responsibility
  • Shape the forward-looking technical direction and long-term architecture for pillars in the Search and Data Ecosystem org
  • Collaborate with product, engineering, and design leaders to influence the broader department-level strategy
  • Ensure that the technical strategy you build is aligned with the technical strategy of Atlassian products and platforms
  • Regularly unblock challenges faced in the software development cycle, from technical design to launch
  • Lead code reviews and documentation and take on complex bug fixes, especially on high-risk problems
  • Set the standards for shipping high quality code at high velocity by improving the developer experience
  • Mentor, hire and develop other engineers
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
  • Fulltime
Read More
Arrow Right

Principal Frontend Software Engineer - Design Systems & AI

We’re looking for a passionate Principal Engineer (P60) to join the Design Syste...
Location
Location
Australia
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A strong interest in AI, especially in generative approaches for frontend code that adheres to design systems and frontend standards
  • Systems thinking and experience architecting and maintaining large-scale systems (100+ packages, content, standards, etc.)
  • Proven Tech Lead experience: You’ve led complex technical initiatives and mentored other engineers
  • Experience with Javascript (ES6), HTML5, CSS and experience with modern Javascript frameworks (e.g., React, AngularJS, Vue)
  • Bachelor's or Master's degree (preferably a Computer Science degree or equivalent experience)
  • Extensive experience with modern testing frameworks (e.g., Jest, Cypress, Mocha, Chai)
  • Strong comfortability with the JavaScript language and ecosystem
  • Experience in design system best practices
Job Responsibility
Job Responsibility
  • Lead the technical vision and architecture for AI-driven design system solutions, ensuring scalability, reliability, and compliance with Atlassian’s frontend standards
  • Drive the development of generative AI tools that produce frontend code aligned with our design system and accessibility requirements
  • Tackle the challenges of maintaining and evolving a system of 100+ packages, including content, standards, and tooling
  • Mentor and guide engineers across the team, fostering a culture of technical excellence and innovation
  • Collaborate with cross-functional partners to deliver impactful solutions that elevate the user experience for millions of Atlassian customers
What we offer
What we offer
  • health coverage
  • paid volunteer days
  • wellness resources
Read More
Arrow Right

Principal Software Engineer

Architect and deliver version 2 of our AI claims management platform. Design and...
Location
Location
United States , New York
Salary
Salary:
270000.00 - 300000.00 USD / Year
evolutioniq.com Logo
EvolutionIQ
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10-15+ years in software development
  • at least five years in a leadership or principal role
  • proven track record of architecting and delivering large-scale, critical systems into production
  • extensive expertise in scalable cloud architecture, relational database design, and building multi-tenant backend systems
  • deep understanding of processing unstructured data and working with large-scale datasets and LLMs
  • expert in Python and other relevant technologies
  • skilled in technical documentation, code reviews, and applying state-of-the-art engineering practices
  • deep understanding of insurance-related data challenges preferred
  • strong collaborator with exceptional communication skills
  • an inspirational technical leader with a track record of success in high-stakes projects
Job Responsibility
Job Responsibility
  • Provide strategic technical guidance across the engineering organization, leading the development and implementation of complex software solutions
  • architect scalable, secure, and high-performance systems that integrate cutting-edge AI and ML capabilities, focusing on unstructured data and LLMs
  • act as a top contributor, rapidly turning ideas into thoughtful designs with multiple options, pros, and cons, and swiftly implementing frameworks
  • mentor junior engineers, fostering their growth and aligning the team with the technical vision
  • partner directly with leadership, including the CTO and VPs, to align on technical strategy and deliver impactful solutions
  • ensure reliable and successful deliveries to enterprise clients
  • drive first-principles thinking to solve 0-to-1 problems
What we offer
What we offer
  • Medical, dental, vision, short & long-term disability, life insurance and AD&D, and 401k matching
  • additional family, wellness, and pet benefits
  • paid time off and sick leave
  • 100% paid parental leave (16 weeks for primary caregivers and 12 weeks for secondary caregivers)
  • flexible schedule for new parents returning to work
  • catered lunches
  • happy hours
  • pet-friendly spaces
  • monthly technology stipend
  • $1,000/year for each employee for professional development
  • Fulltime
Read More
Arrow Right

Principal AI Engineer

We are looking for a Principal AI Engineer to lead the design and deployment of ...
Location
Location
United States
Salary
Salary:
200000.00 - 300000.00 USD / Year
apollo.io Logo
Apollo.io
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience
  • at least 3 years in applied LLM or agentic AI systems (2023–present)
  • proven success in deploying LLM-powered products used by real users at scale
  • deep backend & systems engineering expertise with Python, distributed systems, and scalable APIs
  • familiarity with LangChain, LlamaIndex, or similar orchestration frameworks
  • experience with RAG pipelines, vector DBs, embedding models, and semantic search tuning
  • experience managing performance across cloud providers (e.g., AWS Bedrock, OpenAI, Anthropic, etc.)
  • demonstrated experience building multi-step agents, planning workflows, chaining reasoning steps, and integrating APIs with agent memory/state
  • comfort with advanced prompting strategies, few-shot and chain-of-thought reasoning, and embedding retrieval setups
  • strong understanding of AI system evaluation, human ratings, A/B experimentation, and feedback loop pipelines
Job Responsibility
Job Responsibility
  • Architect and lead the development of multi-agent systems capable of long-horizon planning, reasoning, and API orchestration
  • build reusable agentic components that integrate deeply into sales and marketing processes
  • own and evolve our in-house platform for scalable, low-latency, and cost-efficient LLM and agent deployments
  • lead design of interfaces powered by natural language understanding and retrieval-augmented generation (RAG)
  • build embedding-based, intent-aware search and personalization systems tuned to business user needs
  • drive innovation in personalized outreach generation using context-aware generation pipelines
  • tune inference pipelines, caching layers, and model selection logic for high-scale, cost-aware performance
  • define and drive robust offline and online testing methodologies (A/B, sandboxing, human evals) across agents and LLM flows
  • architect human-in-the-loop systems and telemetry to improve accuracy, UX, and explainability over time
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • at least 10 paid holidays per year
  • flex PTO
  • parental leave
  • employee assistance program
  • wellbeing benefits
  • global travel coverage
  • life/AD&D/STD/LTD insurance
  • Fulltime
Read More
Arrow Right

Principal Architect – GenAI & Enterprise Automation

Designs, develops, troubleshoots and debugs software programs for software enhan...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent
  • Typically 10+ years' experience
  • Experience designing and developing software systems design tools and languages
  • Experience in overall architecture of software systems for products and solutions
  • Designing and integrating software systems running on multiple platform types into overall architecture
  • Evaluating and selecting forms and processes for software systems testing and methodology
  • History of innovation with multiple patents or deployed solutions in the field of software design
  • Excellent written and verbal communication skills
  • mastery in English and local language
  • Deep expertise in Copilot, Azure OpenAI, Power Platform, and LLMs
Job Responsibility
Job Responsibility
  • Develops organization-wide architectures and methodologies for software systems design and development
  • Identifies and evaluates new technologies, innovations, and outsourced development partner relationships
  • Reviews and evaluates designs and project activities for compliance with development guidelines and standards
  • Provides guidance and mentoring to less-experienced staff members
  • Integrate with organizational data and workflows for Copilot
  • Establish Prompt Engineering Frameworks with Copilot
  • Enable custom Copilots with internal knowledge, fine-tuned LLMs, and responsible usage practices
  • Enable Agentic Automation with Federated Governance model
  • Lead scalable automation through reusable components, design principles, and CoE enablement
  • Create accelerators, secure connectors, and templates to maximize reuse
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer

Atlassian’s Global Experiences organization is dedicated to creating unified, se...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years of experience in software engineering, with deep expertise in platform and product engineering at scale
  • Exceptional communication and collaboration skills
  • able to influence and partner across teams
  • Deep product engineering background, ideally with experience in platform environments at scale
  • Full stack experience preferred, or strong back-end skills with front-end capability
  • Proven ability to architect, build, and operate large-scale, distributed systems and user-facing applications
  • Strong product mindset and UX sensibility
  • Experience leading multi-year, cross-org technical initiatives that drive business outcomes
  • Passion for innovation, continuous improvement, and fostering an inclusive, high-performing engineering environment
Job Responsibility
Job Responsibility
  • Leading technical strategy and architecture for Platform Apps, ensuring solutions are robust, secure, and consistent
  • Driving innovation in user and admin experiences, including integrating AI-powered insights and advancing Atlassian’s System of Work
  • Collaborating with product, UX, and engineering leaders to define and deliver a roadmap of high-impact, standalone apps
  • Managing negotiations and dependencies across multiple teams and departments, balancing deep project involvement with platform-wide strategic thinking
  • Standardising and mechanising app development processes , transitioning from ad hoc to scalable, repeatable approaches
  • Mentoring engineers and championing engineering excellence, continuous improvement, and an inclusive culture
What we offer
What we offer
  • Flexibility: Work from anywhere Atlassian has a legal entity, with support for remote, hybrid, or in-office work
  • Health and wellbeing resources
  • Paid volunteer days
Read More
Arrow Right

Principal Forward Deployed Engineer, AI

As a Principal Forward Deployed Engineer (FDE) at Atlassian, you’ll be at the fo...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field
  • 10+ years of experience in backend software development
  • 5+ years of experience delivering impactful AI/ML solutions in production environments, including experience as a founding or forward-deployed engineer in 0-to-1 product development
  • Deep expertise in applied AI/ML, including generative AI, LLMs, and agent-based frameworks
  • Proficiency in Python, JavaScript, or similar languages, and experience with APIs, microservices, and enterprise integration
  • Demonstrated ability to solve complex, ambiguous problems and thrive in rapidly changing environments
  • Strong communication and collaboration skills, with experience influencing cross-functional teams without formal authority
  • Experience with AI risk assessment, data privacy, and compliance (e.g., GDPR)
  • Strategic and innovative thinking, with a track record of aligning technical solutions to business goals
Job Responsibility
Job Responsibility
  • Lead the design, development, and deployment of AI/ML-powered solutions tailored to customer needs, leveraging frameworks such as TensorFlow, PyTorch, and agent-based platforms (e.g., LangChain, LlamaIndex)
  • Architect and implement robust application integrations using Python, JavaScript, or similar languages, with a focus on APIs, microservices, and enterprise-scale systems
  • Drive data-driven solution development by analyzing complex datasets to extract insights and inform product direction
  • Champion the adoption of AI-augmented workflow automation within customer environments, maximizing business value and operational efficiency
  • Oversee the end-to-end deployment of AI solutions into production, ensuring continuous evaluation, monitoring, and improvement
  • Navigate risk and compliance requirements, including AI risk assessment, data privacy (GDPR), and regulatory frameworks
  • Mentor and guide junior engineers, fostering a culture of innovation, collaboration, and continuous learning
  • Communicate complex technical concepts clearly to both technical and non-technical stakeholders, creating concise artifacts for peers, partners, and leadership
  • Align technical solutions with business objectives, setting a clear vision for technological progress and measurable results
What we offer
What we offer
  • Health and wellbeing resources
  • Paid volunteer days
Read More
Arrow Right

Senior Principal Engineer - Atlassian Ecosystem and Marketplace

The Atlassian Ecosystem and Marketplace organization enables our customers to do...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience building software
  • 4+ years in an architect/principal role working across teams
  • Broad experience architecting, designing, and building large-scale systems with multiple dependencies
  • Passion for building quality solutions and up-keeping quality standards
  • Success with building, expressing, and pitching a technical vision to stakeholders
  • Experience with collaboration with an ecosystem of teams
  • Success with leading the long-term strategy for software architecture
  • Experience with building and operating large scale, high availability, high reliability services
  • Experience in operational requirements and common challenges of software systems
  • Experience working on developer productivity initiatives
Job Responsibility
Job Responsibility
  • Shape the forward-looking technical direction and long-term architecture for Ecosystem and Marketplace
  • Collaborate with product, engineering and design leaders to understand and influence the broader department level long term strategy
  • Ensure that the technical strategy you build is aligned with the technical strategy of Atlassian products and platforms
  • Partner with principal engineers and architects from other teams and drive exploration of large-scale projects spanning multiple teams in Enterprise
  • Provide pragmatic and balanced advice to the engineering leaders to invest in the long term architecture while also servicing the current systems with high quality
  • Improve, through example, the quality of software construction and meaningful code reviews in an agile environment
  • Be a role model for, and influence a large team of engineers at multiple seniority levels all the way from grads to principal engineers, and mentor engineers across the teams
  • Be influential within your team and work with peers and senior leaders to define and revise the standards for operational excellence across Atlassian
  • Mentor, hire and develop other engineers
What we offer
What we offer
  • Health and wellbeing resources
  • Paid volunteer days
Read More
Arrow Right