Senior Principal Software Engineer - AI Governance Job at OneTrust (San Francisco)

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...

Location

United States , Atlanta

Salary:

165000.00 - 220000.00 USD / Year

OneTrust

Expiration Date

Until further notice

Requirements

Bachelor's or master's degree in computer science, Engineering, or related technical or business field
12+ years of professional software engineering/development experience
Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
Experience with elastic search and data streaming tools like Kafka
Good understanding of web services and SOA related standards like REST/OAuth/JSON
Moderate understanding of code and script (Python, Bash)
Good experience with SQL and NoSQL databases

Job Responsibility

Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust’s AI Governance product
Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
Build features with RAG, agent workflows, and model orchestration
Own technical design for critical systems, ensuring scalability, security, and reliability
Maintain strong automated unit/integration test coverage and engineering standards
Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team’s discussions on system architecture and component design
Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
Lead architecture discussions and technical planning
Drive alignment across teams on platform design and priorities
Contribute to sprint planning and delivery

What we offer

Comprehensive healthcare coverage
Flexible PTO
Equity RSUs
Annual performance bonus opportunities
Retirement account support
14+ weeks of paid parental leave
Career development opportunities
Company-paid privacy certification exam fees

Fulltime

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

The PowerPoint team is embarking on an exciting new chapter - evolving a product...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
8+ years of experience in backend service engineering, including work on high-scale infrastructures
Proficiency in one or more systems programming languages such as C#, C++
1+ years of experience in software engineering, designing and developing systems (and APIs) that deploy and integrate with AI models
2+ years of experience working with rich telemetry, making data driven decisions, and carrying out rapid experimentation
2+ years of experience building software for scale, performance, and reliability
Academic or industry experience with building, finetuning, deploying or building eval-driven systems utilizing the models (any category)

Job Responsibility

Lead design and delivery of complex, scalable AI features ensuring resilience and exceptional user experience
Drive technical strategy and architecture decisions across multiple services, influencing partner teams and aligning with compliance and security requirements
Champion modern engineering practices, including AI-driven approaches, automation, and cloud-native patterns, across the full development lifecycle
Mentor and guide engineers, fostering technical excellence and continuous improvement in security, reliability, and performance
Collaborate cross-org to solve challenging technical problems, streamline processes, and reduce operational costs while improving live-site health
Design and implement scalable backend services optimized for machine learning workflows and large language model integration
Develop and maintain evaluation-driven systems that leverage text and multimodal inputs (e.g., images) to power visual-creation experiences
Build and optimize APIs and infrastructure to support high-performance model inference and experimentation at scale
Collaborate with product, ML, and design teams to integrate models into user-facing features, ensuring seamless functionality and performance
Conduct model evaluations and experiments, analyze results, and iterate on improvements to enhance accuracy and user experience

Fulltime

Senior and Principal Software Engineer - Core AI

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...

Location

United States , Redmond

Salary:

139900.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Go, Java, or Python
OR equivalent experience
6+ years technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems
Experience building AI or ML related applications
1+ years of technical engineering experience with machine learning or Artificial Intelligence (AI) systems

Job Responsibility

Design, implement and deliver AI services to support product offerings for large-scale agent observability
Collaborate closely with product management and partner teams to align technical direction with business goals
Take end-to-end responsibility for the development lifecycle and production readiness of the services you build and drive the team’s DevOps culture
Engage with customers to gather feedback and resolve complex issues
Understand Microsoft businesses and collaborate with stakeholders towards cohesive, end-to-end experiences for Microsoft customers
Innovate on technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products
Embody our culture and values

Fulltime

Senior Principal Software Engineer, Infrastructure

At Docker, we make app development easier so developers can focus on what matter...

Location

United States , Seattle

Salary:

251000.00 - 352000.00 USD / Year

Docker

Expiration Date

Until further notice

Requirements

12+ years of software engineering experience with demonstrated expertise across multiple platform domains (identity, billing, data, infrastructure)
Proven track record architecting and delivering large-scale distributed systems serving millions of users and thousands of enterprise customers
Deep expertise in at least two of: identity/access management systems, billing/monetization platforms, data platforms, or cloud infrastructure
Broad working knowledge across all platform domains with ability to make sound architectural decisions spanning multiple areas
Expert-level understanding of API design, service architecture, and system integration patterns at scale
Experience with cloud platforms (AWS, GCP, or Azure) and modern infrastructure patterns (Kubernetes, service mesh, infrastructure-as-code)
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
Track record of establishing strategic technical plans that directly enabled business outcomes (revenue growth, cost reduction, market expansion)
Experience translating business strategy into technical architecture and roadmaps
Demonstrated ability to identify and prioritize investments that provide maximum platform leverage

Job Responsibility

Define and own the multi-year technical vision for Docker's foundational platform, encompassing accounts, billing, data, enterprise governance, and infrastructure
Establish strategic plans and objectives for major platform initiatives, making architectural decisions that ensure effective achievement of Docker's business objectives
Contribute to and drive the strategic vision in collaboration with the VP of Engineering, translating organizational strategy into technical roadmaps that span multiple teams and years
Identify and prioritize platform investments that provide maximum leverage—capabilities built once that enable rapid iteration across all Docker products
Develop architectural principles and standards that guide technical decisions across the Bridge organization and influence product engineering teams
Anticipate future business needs and ensure platform architecture provides the flexibility to support Docker's evolving commercial models
Lead large cross-company programs that require coordination across Desktop, Hub, AI, Security, Cloud, and Platform teams
Architect the unified platform interfaces ("Control Planes") that enable product teams to answer canonical questions like "Can this user access this feature?" or "How much has this organization consumed?" without understanding underlying complexity
Drive convergence of fragmented systems across Docker—replacing product-specific implementations with shared platform capabilities for authentication, authorization, billing, and observability
Establish technical contracts between platform and product teams that enable independent velocity while ensuring consistency and reliability

What we offer

Freedom & flexibility
fit your work around your life
Designated quarterly Whaleness Days plus end of year Whaleness break
Home office setup
we want you comfortable while you work
16 weeks of paid Parental leave
Technology stipend equivalent to $100 net/month
PTO plan that encourages you to take time to do the things you enjoy
Training stipend for conferences, courses and classes
Equity

Fulltime

Senior + Principal Software Engineers- Front End Applied AI for Microsoft Threat Protection (MTP)

The Microsoft Security Organization is building the next generation of security ...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to JavaScript, TypeScript, HTML, CSS OR equivalent experience.
Ability to meet Microsoft, customer and/or government security screening requirements including Microsoft Cloud Background Check.
Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to JavaScript, TypeScript, HTML, CSS OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to JavaScript, TypeScript, HTML, CSS OR equivalent experience.
4+ years of hands on experience building modern front end and/or full stack applications in production environments
Experience developing user facing web applications using modern front end frameworks such as React, Angular, or similar component based frameworks
Experience designing and implementing scalable client side application architecture across enterprise or cloud based software platforms
Ability to collaborate across service boundaries with backend or AI platform teams to integrate user interfaces with distributed systems
Experience architecting scalable UI platforms or experience layers that integrate with cloud scale services or AI powered systems
Experience managing or technically leading engineering teams, including driving design decisions, mentoring engineers, and leading execution of complex software initiatives
Demonstrated experience partnering closely with product management, engineering, and design teams to deliver user centric software experiences

Job Responsibility

Design and build AI driven security product experiences powered by large language models, multimodal models, and emerging frontier AI capabilities
Develop scalable full stack solutions that enable AI native workflows across threat detection, triage, investigation, and incident response
Partner deeply across engineering, product management, and design teams to create holistic, intuitive user experiences for interacting with AI powered security systems
Translate complex security workflows into user centric AI optimized interfaces that enable automation, augmentation, and governed autonomy
Rapidly prototype and iterate on AI native experiences within live production environments while maintaining Microsoft standards for security, reliability, privacy, and trust
Collaborate with backend AI platform teams to integrate reasoning systems into end to end user experiences and operational workflows
Shape the long term technical direction of AI driven user interaction paradigms across the Microsoft Threat Protection platform
Mentor engineers and drive engineering excellence across cross disciplinary teams

What we offer

Certain roles may be eligible for benefits and other compensation
Additional benefits and pay information available at https://careers.microsoft.com/us/en/us-corporate-pay

Fulltime

Principal Software Engineer

The Principal Software Engineer is the senior-most hands-on technical leader for...

Location

India , Chennai

Salary:

Not provided

RX Global

Expiration Date

Until further notice

Requirements

Proven experience as a senior technical leader across multiple teams/services within a bounded domain
Strong polyglot background (e.g., C#/.NET, Java, JavaScript/Node) and ability to choose fit-for-purpose technologies
Experience modernising systems: migrating from legacy architectures to cloud-native patterns, reducing technical debt, and decommissioning safely
Experience in systems analysis, design and a solid understanding of development, quality assurance and integration methodologies
Experience developing integrated solutions within a broad technical and business context of significant impact
Experience evaluating third-party services and platforms (security, cost, operations, integration complexity)
Experience leading cross‑team architectural change, platform adoption, or measurable improvements to reliability/cost/performance (with before/after metrics)
Familiarity with responsible AI usage in engineering workflows (policy/guardrails, data privacy, human‑in‑the‑loop review)
Bachelor’s/Master’s degree in Computer Science (or related) or equivalent professional experience
Expert software design skills: SOLID, DDD, event-driven architecture patterns, modular design, and maintainable codebases

Job Responsibility

Engineering Leadership & Culture: Create an environment where teams can do their best work by removing blockers, improving engineering practices, and contributing to a culture of psychological safety and high standards
Mentor and coach engineers across teams—especially senior engineers and emerging tech leads—in architecture, systems thinking, and operational excellence
Promote strong technical ownership ("you build it, you run it"), including operational readiness and post-incident learning
Support scalable knowledge-sharing mechanisms (e.g., tech talks, playbooks, templates, reference implementations)
Participate in hiring loops and help onboard new engineers into domain patterns and practices
Provide hands-on contributions where needed (prototypes, reference implementations, complex refactors, high-risk changes)
Guide teams in decomposition and sequencing to reduce delivery risk
support estimation/sizing and technical discovery
Leads through influence
demonstrates integrity, accountability, and constructive challenge

What we offer

Comprehensive Health Insurance: Covers you, your immediate family, and parents
Enhanced Health Insurance Options: Competitive rates negotiated by the company
Group Life Insurance: Ensuring financial security for your loved ones
Group Accident Insurance: Extra protection for accidental death and permanent disablement
Flexible Working Arrangement: Achieve a harmonious work-life balance
Employee Assistance Program: Access support for personal and work-related challenges
Medical Screening: Your well-being is a top priority
Modern Family Benefits: Maternity, paternity, and adoption support
Long-Service Awards: Recognizing dedication and commitment
New Baby Gift: Celebrating the joy of parenthood

Fulltime

Principal Software Engineer

Microsoft 365 Intelligent Conversation and Communications Cloud (IC3) powers bil...

Location

United States , Redmond

Salary:

142800.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Job Responsibility

Set the technical strategy and architecture for AEGIS — multi-service security platforms, AI agentic systems (agentic vulnerability detection, continuous assessment, triage, automated/recommended remediation), and the developer-facing surfaces hundreds of IC3 engineers depend on. Own the 12–24 month technical roadmap and trade-offs
Provide architecture depth and review rigor across IC3 security work — lead design reviews, security reviews, and threat-model deep dives
act as the final technical reviewer on the most ambiguous, highest-risk designs
raise the bar without becoming a bottleneck
Define and enforce quality gates — codify the policies, controls, telemetry, and pipeline checks (SFI waves, secure-by-default patterns, identity / network / data protections, container hardening, key management) that make consistent security execution the default across IC3 services
Exercise compliance judgment — translate SOC 2, ISO 27001, GDPR, HIPAA, FedRAMP, DoD IL5, and Microsoft internal standards (SFI, S360) into concrete engineering requirements and automation
make the call when policy, business risk, and engineering reality conflict
Drive partner alignment across IC3 and M365 — with security architects, MSRC, privacy, compliance, and service-owner leadership
resolve cross-team architectural disagreements
ensure SFI and incident-driven work lands as a coherent program, not isolated point fixes

Fulltime

Senior Principal AI Infrastructure Architect

The Senior Principal AI Infrastructure Architect is a highly skilled and advance...

Location

Italy , Milano

Salary:

Not provided

NTT DATA

Expiration Date

Until further notice

Requirements

Significant experience in a consulting, presales or architecture role within a large-scale (preferably multi-national) technology services environment, with a track record of leading AI infrastructure pursuits
Demonstrable experience designing and delivering production AI platforms — from single multi-GPU servers through to multi-rack training clusters and inference factories
Strong working knowledge of the AI hardware vendor landscape (NVIDIA, AMD, Intel, Dell, HPE, Lenovo, Supermicro, Cisco, Pure, VAST, WEKA, DDN, NetApp) and how to position partner ecosystems competitively
Proven ability to translate AI workload requirements (model size, parameter count, sequence length, throughput SLOs, latency targets) into accurate hardware bills of materials and sizing justifications
Significant client engagement and consulting experience, including client needs assessment, change management and the ability to identify whitespace for follow-on AI infrastructure and managed-services work
Significant business development and presales experience on infrastructure-led deals, ideally including sovereign AI, AI Factory or regulated-industry GenAI programmes
Strong understanding of how AI infrastructure integrates with business processes, applications, data platforms and existing enterprise architecture
Bachelor's degree or equivalent in Information Technology, Engineering, Computer Science or a related field
Deep, hands-on knowledge of AI hardware: GPU and accelerator portfolios (NVIDIA Hopper / Blackwell, AMD MI300/MI325, Intel Gaudi 3, emerging custom silicon), host CPU platforms (Intel Xeon, AMD EPYC, NVIDIA Grace), system topologies (HGX, DGX, MGX, OAM) and how each choice maps to specific AI workloads
Strong understanding of AI-class storage: parallel filesystems, all-flash NVMe platforms, S3-class object stores, checkpoint and dataset pipelines and the I/O patterns of large-scale training and inference (VAST, WEKA, DDN EXAScaler, Pure FlashBlade, NetApp ONTAP AI, Dell PowerScale)

Job Responsibility

Lead the end-to-end design of large, complex AI infrastructure solutions — covering accelerated compute (NVIDIA H100/H200/B200 and GB200 NVL72, AMD Instinct MI300X/MI325X, Intel Gaudi 3), CPU host platforms (Intel Xeon, AMD EPYC, NVIDIA Grace), high-throughput storage tiers and lossless AI fabric — for enterprise, sovereign AI and AI Factory clients
Architect reference designs built on NVIDIA DGX/HGX SuperPOD, Dell AI Factory with NVIDIA, Cisco Nexus HyperFabric AI, HPE / Lenovo / Supermicro accelerated compute and equivalent platforms, balancing single-node performance with cluster-scale efficiency
Size and validate GPU clusters against real workloads — foundation-model pre-training, distributed fine-tuning, RAG, real-time and batch inference — using the right combination of NVLink/NVSwitch domains, InfiniBand NDR/XDR or Ultra Ethernet / NVIDIA Spectrum-X fabrics and tiered NVMe and parallel storage (VAST, WEKA, DDN, Pure FlashBlade, NetApp ONTAP AI, Dell PowerScale)
Define the supporting datacenter design: high-density power (50–140 kW/rack), direct-to-chip and rear-door liquid cooling, structured cabling for AI fabrics and modular deployment models across on-prem, colo and sovereign-cloud footprints
Work closely with the sales team to drive the presales process for AI infrastructure pursuits — client discovery, technical workshops, proposal writing, executive presentations and bid defence
Translate clients' AI ambitions and business outcomes into a hardware and platform roadmap, positioning NTT DATA's end-to-end portfolio — silicon, systems, storage, fabric, MLOps stack and managed services — to land service-led AI solutions
Lead integration of compute, storage, networking, the AI software stack (CUDA, ROCm, Triton, NIM, NVIDIA AI Enterprise, Run:ai, Slurm, Kubernetes / Kubeflow) and managed-service operating models across multiple domains, delivery units and geographies
Build business cases, TCO and unit-economics models (cost per token, cost per training run, GPU-hour economics) and end-to-end transition roadmaps for cloud-to-private AI migrations and sovereign AI deployments
Define architectural principles for AI infrastructure — accelerator utilisation, data gravity, multi-tenancy, model lifecycle, energy efficiency — and apply them to influence architectural outcomes and governance
Develop As-Is, Vision, FMO and To-Be AI platform architectures, identify gaps and develop transition roadmaps

Fulltime

Select Country

Senior Principal Software Engineer - AI Governance

Job Description

Job Responsibility

Requirements

Nice to have

What we offer

Looking for more opportunities?

Senior Principal Software Engineer - AI Governance

Senior Principal Software Engineer - AI Governance

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

Senior and Principal Software Engineer - Core AI

Senior Principal Software Engineer, Infrastructure

Senior + Principal Software Engineers- Front End Applied AI for Microsoft Threat Protection (MTP)

Principal Software Engineer

Principal Software Engineer

Senior Principal AI Infrastructure Architect

Our AI answers in your language