Principal Software Engineer - Responsible AI Job at Microsoft Corporation (Mountain View)

Senior Software Engineer and Principal Software Engineer

We are building a planet-scale multi-modal database and infrastructure for execu...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, or Java
OR Equivalent experience
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Java
OR equivalent experience
Experience in shipping products and scalable, reliable services
Currently programming/coding in your current or most recent role
Hands on experience with asynchronous programming and concurrency (threads, tasks, futures, async/await)
Experience with Azure Kubernetes Service (AKS), Amazon Elastic Kubernetes Service (EKS), and/or Google Kubernetes Engine (GKE)
Experience in building database engines, query engines, indexing solutions (columnar, full-text, vector), at scale
Experience with programming CUDA, AI systems at scale

Job Responsibility

Independently execute in the face of ambiguity
Leads identification of dependencies and the development of design documents for a product, application, service, or platform
Writes efficient systems code and able to debug distributed systems
Holds accountability as a Designated Responsible Individual (DRI), mentoring engineers across products/solutions, working on-call to monitor system/product/service for degradation, downtime, or interruptions

Fulltime

Principal Software Engineer, AI Developer Tools

At Docker, we make app development easier so developers can focus on what matter...

Location

United States , Seattle

Salary:

232000.00 - 319000.00 USD / Year

Docker

Expiration Date

Until further notice

Requirements

10+ years software engineering experience with 3+ years in Staff or Principal Engineer roles
Deep expertise in AI/ML technologies with hands-on production experience building LLM-powered applications, AI agents, or AI-assisted developer tools
Strong understanding of LLM APIs (OpenAI, Anthropic, etc.), prompt engineering, agent orchestration frameworks, and practical applications of AI in software development workflows
Proven track record of architecting and building highly scalable distributed systems and developer-facing platforms
Production experience with modern cloud-native infrastructure including Kubernetes, GitOps deployment patterns, observability systems, and CI/CD pipelines
Proficiency in Go (preferred), Rust, Java, or Python with strong software engineering fundamentals
Experience designing developer tools, platform engineering systems, or internal tools that enable other teams
Exceptional product and platform mindset considering business outcomes, developer experience, and technical trade-offs
Strong communication skills with ability to influence technical and non-technical stakeholders across the organization
Track record of technical mentorship and elevating engineering teams' capabilities

Job Responsibility

Define the long-term technical vision and architecture for AI-powered developer tools and the self-service platform that enables teams to build their own AI agents
Establish architectural patterns, technical standards, and best practices for LLM integration, AI agent development, and production AI systems serving developers
Lead technical strategy for platform capabilities including deployment frameworks (ArgoCD/GitOps), observability integration (Grafana), security controls, and operational tooling for AI developer tools
Design highly available, scalable infrastructure for hosting AI agents and developer tools with predictable performance and intelligent resource management
Drive technical decisions on AI technology choices, LLM provider strategies, prompt engineering approaches, and agent orchestration frameworks
Partner with Senior Manager and product leadership to align technical architecture with business objectives and productization opportunities
Architect and build production-ready AI agents for developer productivity including code review assistants, test generators, deployment diagnostics, and incident response automation
Design and implement the self-service platform infrastructure that reduces time-to-production for new AI tools from weeks to days
Build systems that accelerate adoption of AI-native development tools (Claude Code, Cursor, Warp) across Docker's engineering organization
Establish reliability, security, and performance standards for AI systems including SLOs, monitoring, incident response, and cost management

What we offer

Freedom & flexibility
fit your work around your life
Designated quarterly Whaleness Days plus end of year Whaleness break
Home office setup
we want you comfortable while you work
16 weeks of paid Parental leave
Technology stipend equivalent to $100 net/month
PTO plan that encourages you to take time to do the things you enjoy
Training stipend for conferences, courses and classes
Equity

Fulltime

Principal Software Engineer, AI Tools and Security

Docker’s AI Tools & Security team is building the foundation for the next genera...

Location

United States , Seattle

Salary:

232000.00 - 319000.00 USD / Year

Docker

Expiration Date

Until further notice

Requirements

10+ years of backend engineering experience, including extensive work on production-grade, distributed systems at scale
Technical leadership across multiple teams or domains, with a proven ability to drive architectural vision, set technical direction, and influence long-term product strategy
Exceptional product and platform mindset—you think beyond implementation details to how technology shapes developer and business outcomes
Expertise in designing and evolving large-scale, cloud-native systems, with deep knowledge of distributed computing, service-oriented architecture, and performance optimization
Demonstrated experience building secure, resilient, and high-throughput backend services, with a strong grasp of reliability engineering principles (SLOs, observability, incident response)
Fluency in Go (preferred) or another modern systems language (Rust, Java, C++, etc.), with the ability to lead technical design reviews and mentor others in language-specific best practices
Strong grasp of software engineering fundamentals—CI/CD, testing strategy, source control, and deployment automation—applied in complex, multi-service environments
Proven track record of technical mentorship and cross-functional collaboration, enabling teams to deliver high-impact, high-quality software efficiently
Deep experience with major cloud platforms (AWS, Azure, GCP) and infrastructure-as-code tooling
Ownership mentality with a bias for action and iterative delivery, balancing short-term impact with long-term architectural health

Job Responsibility

Define the technical solution for a new product
Help shape the product with peers in Product and Design
Mentor other technical team members
Be the technical point of contact for the team

What we offer

Freedom & flexibility
fit your work around your life
Designated quarterly Whaleness Days plus end of year Whaleness break
Home office setup
we want you comfortable while you work
16 weeks of paid Parental leave
Technology stipend equivalent to $100 net/month
PTO plan that encourages you to take time to do the things you enjoy
Training stipend for conferences, courses and classes
Equity

Fulltime

Principal Software Engineer, AI

The NL2KQL (Natural Language to Kusto Query Language) team builds AI powered cap...

Location

United States , Bellevue

Salary:

139900.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Candidates must be able to meet Microsoft, customer and/or government security screening requirements are required for this role
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Job Responsibility

Leads by example within the team by producing extensible and maintainable code
Drives identification of dependencies and the development of design documents. For areas of dependency and overlap with other teams or team members, drives coordination and communicates across teams and resolves conflicts between teams
Leads discussions for the architecture of products/solutions and creates proposals for architecture
Innovation through experimentation: Initiate and guide experiments to evaluate new technologies and determine best-fit solutions
Support Data Scientists and research members in the team by offering rigid engineering environment to innovate, fail fast and deliver quickly
Develop scalable, high-quality solutions: Build software that is reliable, maintainable, and scalable to meet evolving business needs
Support and Develop Others: Mentor team members, encourage inclusive engineering practices, and contribute to building a diverse and talented workforce aligned with our mission
Embed operational excellence: Incorporate live site readiness, monitoring, and incident response into the development lifecycle
AI first development: Employ AI for development cycle, embracing non-deterministic nature of AI products with evals and experimentation

Fulltime

New

Principal Software Engineer, Security AI

The Cloud & AI organization accelerates Microsoft’s mission and bold ambitions t...

Location

United States , Mountain View

Salary:

142800.00 - 304200.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Candidates must be able to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Job Responsibility

Design, build, and operate AI-powered software services that support security engineering across Microsoft’s cloud environment
Develop AI-enabled workflows that help engineering and security teams analyze information, retrieve relevant context, summarize findings, and make faster, higher-quality decisions
Build scalable systems that use large language models, retrieval-augmented generation, embeddings, semantic search, knowledge graphs, and related AI techniques to support security scenarios
Create evaluation, measurement, and monitoring approaches that help assess AI system quality, reliability, safety, and effectiveness in production environments
Partner with engineering, applied science, product, security operations, and other teams to translate AI advances into practical, secure, durable and reliable platform capabilities
Incorporate responsible AI, privacy, security, and compliance considerations into the design, deployment, and operation of AI-powered systems
Contribute to production readiness for services, including architecture, APIs, reliability, scalability, observability, cost efficiency, incident response, and continuous improvement
Provide technical leadership through design documents, architecture discussions, code reviews, and collaboration with partner teams
Mentor engineers and help raise the engineering bar through thoughtful technical guidance, high-quality implementation, and operational excellence
Use data, telemetry, partner feedback, and operational learnings to continuously improve AI capabilities, system reliability, and platform impact

What we offer

Benefits and other compensation may be eligible
Additional benefits and pay information available at https://careers.microsoft.com/us/en/us-corporate-pay

Fulltime

Principal Software Engineer - Azure AI Translation & Language Team

Do you want to build a foundational platform that powers global AI experiences a...

Location

United States , Redmond

Salary:

139900.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science, Engineering, or related field AND 6+ years of software development experience with coding in languages including, but not limited to, C, C++, C#, Java, or Rust OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Job Responsibility

Lead the design and implementation of large-scale, distributed systems that power Azure AI translation and language services
Define and evolve platform architecture for high availability, scalability, and performance across global deployments
Drive improvements in reliability, fault tolerance, and operational excellence for mission-critical services
Build and enhance core infrastructure components such as service orchestration, workload management, and data pipelines
Establish best practices for service observability, monitoring, alerting, and incident response
Collaborate with partner teams (including applied science and product teams) to enable robust and scalable service integrations
Mentor engineers and set a high bar for system design, code quality, and engineering rigor across the team

Fulltime

Principal Software Engineer - Fullstack, AI

We are looking for an experienced Principal Software Engineer (Fullstack, AI) to...

Location

Germany , Berlin

Salary:

Not provided

Babbel

Expiration Date

Until further notice

Requirements

Extensive experience designing, building, and operating distributed systems using Typescript and AWS
Deep expertise in APIs, asynchronous systems, data modeling, and service-to-service communication in production environments
Strong architectural judgment and the ability to communicate trade-offs clearly in service of product and learner outcomes
Proven ability to improve system-level outcomes such as reliability, scalability, delivery speed, and operational excellence
Hands-on fluency with AI-assisted development tools and demonstrated integration of AI into daily engineering workflows
Experience experimenting with or building AI-powered systems, LLM integrations, or AI-enabled features
Pragmatic, metrics-driven judgment in evaluating where AI adds meaningful value versus where traditional approaches are superior
A track record of influencing technical direction across multiple teams without relying on formal authority
Strong product mindset with experience connecting technical decisions to experimentation and measurable customer impact
Demonstrated ability to mentor senior engineers, raise technical standards, and elevate AI fluency across an organization

Job Responsibility

Drive architectural coherence and technical direction across multiple customer-facing systems and teams
Design and evolve high-leverage APIs, data models, and distributed systems that power learner journeys, personalization, and experimentation
Establish shared patterns, abstractions, and standards that reduce fragmentation and increase engineering leverage
Act as a role model for AI-native workflows across design, coding, testing, code review, debugging, and incident response
Champion effective and responsible usage of AI-assisted development tools and scalable prompting practices
Identify and implement opportunities where AI can measurably improve developer productivity, delivery speed, and production quality
Define guardrails and evaluation approaches to ensure AI usage is secure, reliable, and aligned with engineering standards
Improve delivery performance by advancing continuous delivery, observability, and production excellence practices
Anticipate cross-team risks and dependencies early and proactively de-risk them to protect learner experience and commitments
Multiply your impact through mentoring senior engineers, influencing without authority, and stepping in hands-on when critical paths require it

What we offer

30 vacation days
3-month Sabbatical
Family and life situation counseling
Flexible working hours and remote-friendly options
Jobbatical (up to 3 months inside the EU and UK)
Fully equipped office with nap, faith and family rooms
Internal learning opportunities
Yearly learning & development budget for external training
Free full access to Babbel & Babbel Live classes
Mobility benefits options

Fulltime

Principal Software Engineer – Gen AI Platforms

We are Citi’s Application, Platform and Engineering group, a start-up with the e...

Location

India , Pune

Salary:

Not provided

Citi

Expiration Date

Until further notice

Requirements

14+ Years of Hands on experience is a must have
Expert-level fluency in Golang is a must-have
Deep experience building concurrent, high-throughput systems
Deep expertise in the Kubernetes ecosystem, container orchestration, and modern security paradigms
Understanding of language models, fine-tuning methodologies, and RAG architectures, JIT context retrieval strategies
Proven experience designing control planes, sandboxing systems for AI experimentation, and managing large-scale vector stores and search algorithms
Extensive experience in large-scale ETL development and data pipeline architecture
Experience maintaining and/or contributing to bug bounty, responsible disclosure programs, and AI safety/guardrail implementations
Experience leading technical initiatives within fast-paced startup environments or driving startup-like agility within a large enterprise

Job Responsibility

Engineering at scale: You will build scaled, robust services and platforms centred around generative AI. This may also include developing CLIs, SDKs, runtimes and more
Thought Leadership: Drive architectural vision and lead the 0-1 build of foundational, enterprise-grade AI platforms and products
System Design: Design and build high-quality, highly reliable, and secure distributed systems with developer and user experience at the center
Strategic Direction: Create "firsts" in the Generative AI space for Citi, acting as a core member of the team that defines the strategic technical direction for the entire bank
Scale & Iterate: Continually iterate and scale Generative AI products to handle massive throughput, whilst anticipating and listening to the complex needs of internal customers
Cross-Org Influence: You must be able to drive technical alignment across multiple engineering organizations, breaking down silos to deliver cohesive AI capabilities

Fulltime

Select Country

Principal Software Engineer - Responsible AI

Job Description

Job Responsibility

Requirements

Looking for more opportunities?