CrawlJobs Logo

Principal AI Software Architect

United States, Redmond 139900.00 - 274800.00 USD / Year · Job Posted May 05, 2026
Apply Position
Job Link Share

Job Description

Do you want to be at the forefront of innovating the latest hardware designs to propel Microsoft’s cloud growth? Are you seeking a unique career opportunity that combines technical capabilities, cross-team collaboration, with business insight and strategy? Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to achieve our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. Join the Systems Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s "Intelligent Cloud" mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live. As Principal AI Software Architect for Microsoft MAIA accelerators within the SPARC team, you will play a pivotal role in enabling and optimizing machine learning model training workflows on our cutting-edge hardware. Your responsibilities will include bringing up and validating training processes on MAIA accelerators, collaborating with engineering and research teams to understand MAIA accelerator architecture, and enabling training recipes developed for Microsoft’s first-party accelerators. You will utilize your hands-on experience with PyTorch and at least one of Triton or CUDA to ensure efficient and scalable deployment of large models. This role is ideal for candidates who thrive in a dynamic environment and are passionate about advancing AI infrastructure and model performance on next-generation hardware platforms.

Job Responsibility

  • Leads by example across teams and mentors others to produce extensible, maintainable, well-tested, secure, and performant code used across products that adheres to design specifications
  • Leads efforts to continuously improve code performance, testability, maintainability, effectiveness, and cost, while learning about and accounting for relevant trade-offs
  • Identifies best practices and coding patterns (e.g., leveraging state-of-the-art generative artificial intelligence [GenAI], approaches to source code organization, naming conventions) and provides deep expertise in the coding and validation strategy
  • Creates and applies metrics to drive code quality and stability, appropriate coding patterns, and best practices
  • Identifies and anticipates blockers or unknowns during the development process, escalates them, communicates how they will impact timelines, and then leads efforts to identify and implement strategies and/or opportunities to address them
  • Reviews product code and test code to ensure it meets team standards, contains the correct test coverage, and is appropriate for the product or solution area
  • Brings insight to code reviews to help improve code quality, coaching and providing feedback to develop other engineers' skills
  • Conducts code reviews in a timely fashion that helps accelerate the pace of development on the team. Considers diagnosability, reliability, testability, and maintainability when reviewing code, and understands when code is ready to be shared or delivered
  • Applies and reviews for coding patterns, security risks, compliance issues, and best practices in code reviews, providing feedback on code to drive adherence to best practices
  • Uses automated source code analysis tools that are incorporated into the build/development process

Requirements

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, PyTorch, CUDA/Triton
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Nice to have

  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Accelerator architecture
  • Mapping of models to accelerators
  • Number formats
  • AI model architecture

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Principal AI Software Architect

8 matching positions

Principal AI Software Architect

Principal Artificial Intelligence (AI) Software Architect leads the design, deve...
Location
Location
United States , St. Louis
Salary
Salary:
Not provided
vantagelinks.com Logo
VantageLinks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in the field of computer science, information systems, or computer engineering or equivalent experience
  • 7+ years of experience in software architecture and engineering, with at least 2 years focused on AI/ML systems
  • 5+ years of hands-on experience with application development tools, including Visual Studio .NET
  • 5+ years of hands-on experience with relational database technology, preferably MS SQL Server
Job Responsibility
Job Responsibility
  • Architects and leads the development of AI-driven platforms and scalable software systems aligned with strategic business goals
  • Collaborates cross-functionally with engineering, product, and business teams to define use cases and deliver impactful solutions
  • Evaluates and selects AI and software technologies, frameworks, and tools for optimal performance, scalability, and maintainability
  • Establishes and promotes best practices in AI model development, MLOps, software engineering, DevOps, and system architecture
  • Mentors engineering teams, fostering a culture of innovation, excellence, and continuous improvement
  • Drives technical strategy and long-term planning, aligning engineering efforts with enterprise objectives
  • Ensures compliance with data privacy, security, and ethical standards in all AI and software initiatives
  • Champions engineering excellence through code reviews, automated testing, CI/CD, and agile methodologies
  • Other duties as needed or assigned
Read More
Arrow Right
New

Principal AI Architect

Wells Fargo is seeking a visionary Principal Systems Architect to shape the futu...
Location
Location
United States , Iselin
Salary
Salary:
159000.00 - 305000.00 USD / Year
https://www.wellsfargo.com/ Logo
Wells Fargo
Expiration Date
June 25, 2026
Flip Icon
Requirements
Requirements
  • 7+ years of architecture experience
  • 7+ years of experience creating strategy
  • 2+ years of AI, GenAI, and Agentic AI solutions with Model Risk Management (MRM) and Artificial Intelligence Risk Review (AIRR) governance requirements
Job Responsibility
Job Responsibility
  • Act as an advisor to leadership to develop or influence applications, network, information security, database, operating systems, or web technologies for highly complex business and technical needs across multiple groups
  • Lead the strategy and resolution of highly complex and unique challenges requiring in-depth evaluation across multiple areas or the enterprise, delivering solutions that are long-term, large-scale and require vision, creativity, innovation, advanced analytical and inductive thinking
  • Translate advanced technology experience, an in-depth knowledge of the organizations tactical and strategic business objectives, the enterprise technological environment, the organization structure, and strategic technological opportunities and requirements into technical engineering solutions
  • Provide vision, direction and expertise to leadership on implementing innovative and significant business solutions
  • Artificial Intelligence (AI) and Innovation - Promote a data-driven culture and drive architecture led-innovation
  • Lead architecture alignment for AI, GenAI, and Agentic AI solutions with Model Risk Management (MRM) and Artificial Intelligence Risk Review (AIRR) governance requirements, ensuring designs support required risk assessments, approvals, and enterprise control expectations
  • Partner with Model Risk Management, BCM, Legal, Compliance, Cyber, Data Use Assessment, and Risk Assessable Unit (RAU)-aligned stakeholders to ensure AI-enabled solutions are designed for appropriate model risk ranking, validation, explainability, control uplift, and readiness for AIRR and related tollgates where applicable
  • Define architecture patterns and engineering guardrails that support responsible AI, including traceability, monitoring, auditability, human-in-the-loop controls, secure data usage, resiliency, and change management across the AI service lifecycle
  • Ensure target-state architectures and implementation roadmaps account for post-deployment monitoring, control sustainability, and re-assessment triggers associated with model changes, scope expansion, data/input changes, platform changes, and evolving regulatory requirements
  • Advise business, product, and engineering leaders on how to accelerate AI adoption while meeting enterprise expectations for risk governance, model oversight, policy adherence, and safe deployment at scale
What we offer
What we offer
  • Health benefits
  • 401(k) Plan
  • Paid time off
  • Disability benefits
  • Life insurance, critical illness insurance, and accident insurance
  • Parental leave
  • Critical caregiving leave
  • Discounts and savings
  • Commuter benefits
  • Tuition reimbursement
  • Fulltime
!
Read More
Arrow Right

Principal AI Architect

As the Principal AI Architect for Teradata AI Studio, you will define the techni...
Location
Location
India , Bengaluru, Karnataka, India | Hyderabad, Telangana, India
Salary
Salary:
Not provided
teradata.com Logo
Teradata
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience, including 3+ years in a senior architect or principal engineer role with platform-wide technical scope
  • Demonstrated expertise designing AI/ML platforms or developer tools: model serving infrastructure, feature stores, experiment tracking, MLOps pipelines, or AI agent development environments
  • Deep understanding of LLM integration patterns: RAG architectures, fine-tuning pipelines, evaluation frameworks, and agent tool-calling interfaces
  • Experience with enterprise data platforms (Teradata Vantage, Snowflake, Databricks, or equivalent) at sufficient depth to architect against their APIs, security models, and performance characteristics
Job Responsibility
Job Responsibility
  • Define the technical architecture of Teradata's end-to-end AI development environment
  • Set the architectural direction for how AI Studio integrates with Teradata Vantage's query engine, model registry, feature store, and agent harness
  • Establish the patterns for how enterprise customers build trustworthy AI workflows
  • Ensure that AI Studio is the most capable, governed, and scalable AI development environment in the market
What we offer
What we offer
  • Flexible work model
  • People-first culture
  • Focus on well-being
  • Commitment to fostering an inclusive environment
  • Fulltime
Read More
Arrow Right

Principal AI Software Engineer, Senior Vice President

Are you looking for a career move that will put you at the heart of a global fin...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Exceptional Python Expertise: Demonstrated mastery of core Python, including advanced features, performance optimization, and a deep understanding of the FastAPI framework
  • Prior hands-on experience with Generative AI, Large Language Model (LLM) frameworks (e.g. LangChain, LlamaIndex), and their application in enterprise environments is a must. This must be underpinned by a profound understanding of core machine learning principles, algorithms, and data science methodologies
  • Full Lifecycle Ownership: Extensive hands-on experience and technical authority throughout the entire software development lifecycle, from conceptualization and design to implementation, deployment, and operational ownership of enterprise software solutions, involving significant cross-functional collaboration
  • Strategic System Design: Significant hands-on experience in architecting and designing (architecture, design patterns, reliability, scaling) highly complex new and current systems with broad technical impact
  • Hands-on expertise with containerized deployment technologies (e.g. Kubernetes, OpenShift, Docker) and orchestration strategies
  • Hands-on experience and in-depth understanding of C++ is a significant bonus, particularly for complex code analysis, parsing, and integration into knowledge graph structures
Job Responsibility
Job Responsibility
  • Architect and implement cutting-edge software systems, defining the technical design for our AI solutions to ensure scalability, performance, and reliability
  • Drive the hands-on design, implementation, and deployment of sophisticated systems that automate the analysis of data, code, and documentation
  • Apply deep expertise to structure extracted knowledge within a Credit Risk Domain-aware knowledge graph, including advanced strategies for effectively modelling complex codebases, particularly C++, within this graph
  • Act as a critical technical partner with data scientists, business analysts, and other engineering teams to translate challenging business requirements into robust technical solutions and ensure successful, high-quality project delivery
  • Tackle the most complex technical challenges within our AI initiatives, providing solutions that set the standard for engineering excellence
What we offer
What we offer
  • Generous holiday allowance starting at 27 days plus bank holidays
  • increasing with tenure
  • A discretional annual performance related bonus
  • Private medical insurance packages to suit your personal circumstances
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Principal Ai Architect

At Teradata, we believe that people thrive when empowered with better informatio...
Location
Location
United States , California
Salary
Salary:
217300.00 - 325900.00 USD / Year
teradata.com Logo
Teradata
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of software engineering experience, including 3+ years in a senior architect or principal engineer role with platform-wide technical scope
  • Demonstrated expertise designing AI/ML platforms or developer tools: model serving infrastructure, feature stores, experiment tracking, MLOps pipelines, or AI agent development environments
  • Deep understanding of LLM integration patterns: RAG architectures, fine-tuning pipelines, evaluation frameworks, and agent tool-calling interfaces
  • Experience with enterprise data platforms (Teradata Vantage, Snowflake, Databricks, or equivalent) at sufficient depth to architect against their APIs, security models, and performance characteristics
  • Experience building developer-facing platforms — SDKs, APIs, or IDEs — that external developers adopt and extend
  • Familiarity with open-source AI development tools: MLflow, Weights & Biases, Hugging Face, LangChain, LangGraph, or comparable
  • Understanding of enterprise AI governance requirements: model lineage, data access controls, audit logging, and responsible AI guardrails
  • Experience with cloud-native architecture (AWS, Azure, GCP) and containerized ML workloads (Kubernetes, Docker)
  • Strong cross-functional influence: you can drive alignment across engineering, product, and customer-facing teams without formal authority
  • A portfolio of architectural decisions — RFCs, design docs, or open-source work — that demonstrates your approach
Job Responsibility
Job Responsibility
  • Define the technical architecture of Teradata's end-to-end AI development environment — the platform where data scientists, ML engineers, and AI developers build, test, deploy, and monitor AI and agentic applications on top of Vantage
  • Set the architectural direction for how AI Studio integrates with Teradata Vantage's query engine, model registry, feature store, and agent harness
  • Establish the patterns for how enterprise customers build trustworthy AI workflows — from data preparation through model deployment to agent-driven automation
  • Ensure that AI Studio is the most capable, governed, and scalable AI development environment in the market
  • Ship architectural decisions that other engineers can build on with confidence
  • Drive customer adoption of AI Studio at scale
What we offer
What we offer
  • Healthcare
  • life and disability insurance plans
  • 401(k)-retirement savings plan
  • time-off programs
  • Fulltime
Read More
Arrow Right

Principal Software Architect

Azure Resource Graph’s (ARG part of ARM/Azure Control plane) mission is to Relia...
Location
Location
United States , Multiple Locations
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check
  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • 8+ years deep hands-on working knowledge of building a true cloud-scale services
  • 10+ year experience in one of the object-oriented programming languages including runtime internals like C#, Java, etc
  • 5+ years operational experience in running your service in one of the large-scale clouds like Azure, AWS, GCP
Job Responsibility
Job Responsibility
  • Responsible for the technical design and vision for building the necessary underlying systems to enable high throughput query-ability or high throughput ingestion-services in the platform with ambitious performance goals
  • Design scalable architectures for distributed systems that integrate machine learning and intelligent agents
  • Partner across Azure to build platform capabilities that accelerate AI adoption and unlock new customer experiences
  • Define and lead the strategy for ARG’s evolution into big data and LLM/agentic services
  • Guide engineering teams in building high-performance, future-ready services with immediate customer and business impact
  • Achieving quality results with laser customer focus
  • Build distributed micro-services in the area of proprietary columnar databases, replication, batching, agentic, indexing, change tracking, insights, and in defining graph models
  • Focus on end-to-end services, development, and deployment
  • Fulltime
Read More
Arrow Right

Principal Software Architect

Azure Resource Graph’s (ARG part of ARM/Azure Control plane) mission is to Relia...
Location
Location
United States , Multiple Locations
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • You are responsible for the technical design and vision for building the necessary underlying systems to enable high throughput query-ability or high throughput ingestion-services in the platform with ambitious performance goals.
  • Design scalable architectures for distributed systems that integrate machine learning and intelligent agents.
  • Partner across Azure to build platform capabilities that accelerate AI adoption and unlock new customer experiences.
  • Define and lead the strategy for ARG’s evolution into big data and LLM/agentic services.
  • Guide engineering teams in building high-performance, future-ready services with immediate customer and business impact.
  • Achieving quality results with laser customer focus.
  • Build distributed micro-services in the area of proprietary columnar databases, replication, batching, agentic, indexing, change tracking, insights, and in defining graph models.
  • Focus on end-to-end services, development, and deployment.
  • Fulltime
Read More
Arrow Right

Principal Software Architect

Security represents the most critical priorities for our customers in a world aw...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft background and Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • 6+ years of experience designing and implementing features of high-scale distributed cloud services
  • 3+ years of experience as an architect or technical lead, driving strategic decisions and delivering high-impact technical results
Job Responsibility
Job Responsibility
  • Define and own the long‑term technical strategy and architectural vision for managed identity and service‑to‑service authentication, aligning that vision with organizational goals and communicating it effectively to senior leadership and other stakeholders
  • Translate long‑term strategy into actionable shorter-term execution plans by driving technical and organizational consensus across multiple engineering teams, partner organizations, customers, and leadership, and ensuring successful delivery
  • Provide technical leadership and mentorship across teams delivering security‑ and resilience‑critical capabilities, setting architectural direction and raising the bar on quality through design leadership, code reviews, and direct hands-on technical engagement
  • Own and drive engineering fundamentals at the platform level, shaping investment priorities and proactively identifying and addressing systemic risks related to performance, scale, resilience, testability, and security across the organization
  • Lead innovation in the application of AI by defining strategy and guiding adoption of AI‑driven tools to improve engineering productivity, while also shaping and delivering AI agents that automate operational and engineering workflows at scale
  • Own live‑site excellence for the platform by serving as an organizational incident manager during high‑severity production events, and by engaging deeply in the pre-mortem and post-mortem processes to drive durable learnings and systemic fixes across multiple services
  • Fulltime
Read More
Arrow Right