Principal AI Software Engineer Job at AMD (San Jose)

Principal Ai Software Engineer

WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great prod...

Location

United States , San Jose

Salary:

240000.00 - 360000.00 USD / Year

AMD

Expiration Date

Until further notice

Requirements

Knowledge in GPU architectures, basic knowledge of CPU architecture
Experience in AI/ML software stack spanning compilers, kernels, runtime, libraries, models, frameworks, and performance optimization layers
Understanding of GPU programming such as ROCm, CUDA, OpenCL, etc
Experience in hardware/software co-design, building high-performance products across the full product lifecycle
Experience with operating systems (OS) and device driver development is a plus
Undergrad degree required. Bachelor of Science, Masters, or PhD degree with emphasis in Electrical Engineering, Computer architecture, or Computer Science with relevant experience preferred

Job Responsibility

Hardware-Software Co-design: Collaborate across hardware architecture, compiler, math libraries, kernel and framework teams to influence future silicon features based on evolving AI workload trends
Strong Execution: Deliver innovations and roadmap for AI software stack across all AMD products, ensuring AMD remains the platform of choice for top-tier AI customers
Workload Performance Engineering: Lead the profiling, analysis, and tuning of large-scale models (LLMs, Diffusion, Multimodal, and MoE) to ensure out-of-the-box performance excellence on AMD hardware
Ecosystem Innovation: Drive the development of advanced tools and frameworks for performance estimation, modeling, and automated reporting
Customer Engagement: Partner with top customers and hyperscalers to understand their unique workload requirements and deliver tailored architectural wins and software optimizations
Community & Open Source: Mentor and inspire other engineers and contribute to ROCm Opensource

What we offer

AMD benefits at a glance

Fulltime

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

The PowerPoint team is embarking on an exciting new chapter - evolving a product...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
8+ years of experience in backend service engineering, including work on high-scale infrastructures
Proficiency in one or more systems programming languages such as C#, C++
1+ years of experience in software engineering, designing and developing systems (and APIs) that deploy and integrate with AI models
2+ years of experience working with rich telemetry, making data driven decisions, and carrying out rapid experimentation
2+ years of experience building software for scale, performance, and reliability
Academic or industry experience with building, finetuning, deploying or building eval-driven systems utilizing the models (any category)

Job Responsibility

Lead design and delivery of complex, scalable AI features ensuring resilience and exceptional user experience
Drive technical strategy and architecture decisions across multiple services, influencing partner teams and aligning with compliance and security requirements
Champion modern engineering practices, including AI-driven approaches, automation, and cloud-native patterns, across the full development lifecycle
Mentor and guide engineers, fostering technical excellence and continuous improvement in security, reliability, and performance
Collaborate cross-org to solve challenging technical problems, streamline processes, and reduce operational costs while improving live-site health
Design and implement scalable backend services optimized for machine learning workflows and large language model integration
Develop and maintain evaluation-driven systems that leverage text and multimodal inputs (e.g., images) to power visual-creation experiences
Build and optimize APIs and infrastructure to support high-performance model inference and experimentation at scale
Collaborate with product, ML, and design teams to integrate models into user-facing features, ensuring seamless functionality and performance
Conduct model evaluations and experiments, analyze results, and iterate on improvements to enhance accuracy and user experience

Fulltime

Senior Software Engineer and Principal Software Engineer

We are building a planet-scale multi-modal database and infrastructure for execu...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, or Java
OR Equivalent experience
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Java
OR equivalent experience
Experience in shipping products and scalable, reliable services
Currently programming/coding in your current or most recent role
Hands on experience with asynchronous programming and concurrency (threads, tasks, futures, async/await)
Experience with Azure Kubernetes Service (AKS), Amazon Elastic Kubernetes Service (EKS), and/or Google Kubernetes Engine (GKE)
Experience in building database engines, query engines, indexing solutions (columnar, full-text, vector), at scale
Experience with programming CUDA, AI systems at scale

Job Responsibility

Independently execute in the face of ambiguity
Leads identification of dependencies and the development of design documents for a product, application, service, or platform
Writes efficient systems code and able to debug distributed systems
Holds accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions

Fulltime

Principal AI Software Engineer, Senior Vice President

Are you looking for a career move that will put you at the heart of a global fin...

Location

United Kingdom , London

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

Exceptional Python Expertise: Demonstrated mastery of core Python, including advanced features, performance optimization, and a deep understanding of the FastAPI framework
Prior hands-on experience with Generative AI, Large Language Model (LLM) frameworks (e.g. LangChain, LlamaIndex), and their application in enterprise environments is a must. This must be underpinned by a profound understanding of core machine learning principles, algorithms, and data science methodologies
Full Lifecycle Ownership: Extensive hands-on experience and technical authority throughout the entire software development lifecycle, from conceptualization and design to implementation, deployment, and operational ownership of enterprise software solutions, involving significant cross-functional collaboration
Strategic System Design: Significant hands-on experience in architecting and designing (architecture, design patterns, reliability, scaling) highly complex new and current systems with broad technical impact
Hands-on expertise with containerized deployment technologies (e.g. Kubernetes, OpenShift, Docker) and orchestration strategies
Hands-on experience and in-depth understanding of C++ is a significant bonus, particularly for complex code analysis, parsing, and integration into knowledge graph structures

Job Responsibility

Architect and implement cutting-edge software systems, defining the technical design for our AI solutions to ensure scalability, performance, and reliability
Drive the hands-on design, implementation, and deployment of sophisticated systems that automate the analysis of data, code, and documentation
Apply deep expertise to structure extracted knowledge within a Credit Risk Domain-aware knowledge graph, including advanced strategies for effectively modelling complex codebases, particularly C++, within this graph
Act as a critical technical partner with data scientists, business analysts, and other engineering teams to translate challenging business requirements into robust technical solutions and ensure successful, high-quality project delivery
Tackle the most complex technical challenges within our AI initiatives, providing solutions that set the standard for engineering excellence

What we offer

Generous holiday allowance starting at 27 days plus bank holidays
increasing with tenure
A discretional annual performance related bonus
Private medical insurance packages to suit your personal circumstances
Employee Assistance Program
Pension Plan
Paid Parental Leave
Special discounts for employees, family, and friends
Access to an array of learning and development resources

Fulltime

Principal Software Engineer (AI / Agentic Developer Productivity)

Are you a Software Engineer already at the forefront of agentic AI development —...

Location

United States , Redmond

Salary:

139900.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Prior experience building with Agent SDKs, large language models (LLMs), prompt engineering, or AI orchestration frameworks (e.g., LangChain, Semantic Kernel, AutoGen, LlamaIndex, or similar)
Familiarity with agentic AI development patterns — multi-step reasoning, tool/function calling, retrieval-augmented generation (RAG), and human-in-the-loop workflows
Proven experience as a Software Engineer delivering large-scale, production-quality systems
Proficient software engineering fundamentals: system design, algorithms, testing, debugging, and code review
Demonstrated ability to lead technical direction and mentor peers in a collaborative team environment
Comfort working in ambiguous, fast-moving problem spaces where best practices are still being established
Hands-on experience with AI-powered developer tooling and coding assistants, such as GitHub Copilot and Copilot Workspace, Claude Code, OpenAI Codex / ChatGPT, Cursor
Prior experience using agentic plugins, agents, skills, hooks, etc.
Experience dogfooding, evaluating, and forming opinions on emerging AI developer tools, and translating those insights into team-wide best practices

Job Responsibility

Own and deliver complete features across the development lifecycle, including design, architecture, implementation, testability, debugging, shipping, and servicing
Use AI in your daily coding and advocate to the team and customers an evolving state-of-the-art of how best to do this
Demonstrate resiliency to experiment and try multiple AI approaches that may not work — because no one has tried them before
Provide mentorship and coaching to engineers in, and beyond, your team
Write and review clean, well-thought-out code with an emphasis on quality, performance, simplicity, durability, scalability, and maintainability
Contribute positively to a culture where everyone can bring their full and authentic self and where we do our best work as a result

Fulltime

Principal Software Engineer- AI

Project Sophia is a new generation business application, built ground up from ma...

Location

United States , Redmond

Salary:

139900.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements
Required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Job Responsibility

Design, implement, and ship AI-first product capabilities end-to-end from rapid prototype to production, spanning LLM-powered services, retrieval/grounding pipelines, and intelligent UX experiences
Shape and evolve full-stack architecture, integrating front-end experiences, back-end services, and AI orchestration layers
Collaborate with design, research, and platform teams to adapt or fine-tune LLMs/SLMs and multimodal models for real-world customer scenarios
Build agentic, tool-using, and multimodal workflows that reason across data and services
Drive engineering excellence, including secure-by-design principles, accessibility compliance, automated testing, and high-quality code craftsmanship
Define and apply evaluation frameworks for AI systems, using telemetry, experimentation, and continuous feedback loops
Drive live-site reliability and operational excellence, participating in On-Call rotations

Fulltime

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...

Location

United States , San Francisco

Salary:

165000.00 - 220000.00 USD / Year

OneTrust

Expiration Date

Until further notice

Requirements

Bachelor's or master's degree in computer science, Engineering, or related technical or business field
12+ years of professional software engineering/development experience
Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
Experience with elastic search and data streaming tools like Kafka
Good understanding of web services and SOA related standards like REST/OAuth/JSON
Moderate understanding of code and script (Python, Bash)
Good experience with SQL and NoSQL databases

Job Responsibility

Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust's AI Governance product
Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
Build features with RAG, agent workflows, and model orchestration
Own technical design for critical systems, ensuring scalability, security, and reliability
Maintain strong automated unit/integration test coverage and engineering standards
Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team's discussions on system architecture and component design
Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
Lead architecture discussions and technical planning
Drive alignment across teams on platform design and priorities
Contribute to sprint planning and delivery

What we offer

Comprehensive healthcare coverage
flexible PTO
equity RSUs
annual performance bonus opportunities
retirement account support
14+ weeks of paid parental leave
career development opportunities
company-paid privacy certification exam fees

Fulltime

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...

Location

United States , Atlanta

Salary:

165000.00 - 220000.00 USD / Year

OneTrust

Expiration Date

Until further notice

Requirements

Bachelor's or master's degree in computer science, Engineering, or related technical or business field
12+ years of professional software engineering/development experience
Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
Experience with elastic search and data streaming tools like Kafka
Good understanding of web services and SOA related standards like REST/OAuth/JSON
Moderate understanding of code and script (Python, Bash)
Good experience with SQL and NoSQL databases

Job Responsibility

Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust’s AI Governance product
Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
Build features with RAG, agent workflows, and model orchestration
Own technical design for critical systems, ensuring scalability, security, and reliability
Maintain strong automated unit/integration test coverage and engineering standards
Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team’s discussions on system architecture and component design
Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
Lead architecture discussions and technical planning
Drive alignment across teams on platform design and priorities
Contribute to sprint planning and delivery

What we offer

Comprehensive healthcare coverage
Flexible PTO
Equity RSUs
Annual performance bonus opportunities
Retirement account support
14+ weeks of paid parental leave
Career development opportunities
Company-paid privacy certification exam fees

Fulltime

Select Country

Principal AI Software Engineer

Job Description

Job Responsibility

Requirements

Nice to have

What we offer

Looking for more opportunities?

Principal AI Software Engineer

Principal Ai Software Engineer

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

Senior Software Engineer and Principal Software Engineer

Principal AI Software Engineer, Senior Vice President

Principal Software Engineer (AI / Agentic Developer Productivity)

Principal Software Engineer- AI

Senior Principal Software Engineer - AI Governance

Senior Principal Software Engineer - AI Governance

Our AI answers in your language