Senior Principal Software Engineer - AI Governance Job at OneTrust (San Francisco)

Principal Engineer

The Principal AI/ML Operations Engineer leads the architecture, automation, and ...

Location

United States , Pleasanton, California

Salary:

251000.00 - 314500.00 USD / Year

BlackLine

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field
10+ years in ML infrastructure, DevOps, and software system architecture
4+ years in leading MLOps or AI Ops platforms
Strong programming skills in languages such as Python, Java, or Scala
Expertise in ML frameworks (TensorFlow, PyTorch, scikit-learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow)
Proven experience operating production pipelines for ML and LLM-based systems across cloud ecosystems (GCP, AWS, Azure)
Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management
Strong competencies in CI/CD, IaC, and DevSecOps pipelines integrating testing, compliance, and deployment automation
Hands-on with observability stacks (Prometheus, Grafana, Newrelic) for model and agent performance tracking
Understanding of governance frameworks for Responsible AI, auditability, and cost metering across training and inference workloads

Job Responsibility

Define enterprise-level standards and reference architectures for ML-Ops and AIOps systems
Partner with data science, security, and product teams to set evaluation and governance standards (Guardrails, Bias, Drift, Latency SLAs)
Mentor senior engineers and drive design reviews for ML pipelines, model registries, and agentic runtime environments
Lead incident response and reliability strategies for ML/AI systems
Lead the deployment of AI models and systems in various environments
Collaborate with development teams to integrate AI solutions into existing workflows and applications
Ensure seamless integration with different platforms and technologies
Define and manage MCP Registry for agentic component onboarding, lifecycle versioning, and dependency governance
Build CI/CD pipelines automating LLM agent deployment, policy validation, and prompt evaluation of workflows
Develop and operationalize experimentation frameworks for agent evaluations, scenario regression, and performance analytics

What we offer

short-term and long-term incentive programs
robust offering of benefit and wellness plans

Fulltime

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...

Location

United States , Atlanta

Salary:

165000.00 - 220000.00 USD / Year

OneTrust

Expiration Date

Until further notice

Requirements

Bachelor's or master's degree in computer science, Engineering, or related technical or business field
12+ years of professional software engineering/development experience
Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
Experience with elastic search and data streaming tools like Kafka
Good understanding of web services and SOA related standards like REST/OAuth/JSON
Moderate understanding of code and script (Python, Bash)
Good experience with SQL and NoSQL databases

Job Responsibility

Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust’s AI Governance product
Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
Build features with RAG, agent workflows, and model orchestration
Own technical design for critical systems, ensuring scalability, security, and reliability
Maintain strong automated unit/integration test coverage and engineering standards
Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team’s discussions on system architecture and component design
Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
Lead architecture discussions and technical planning
Drive alignment across teams on platform design and priorities
Contribute to sprint planning and delivery

What we offer

Comprehensive healthcare coverage
Flexible PTO
Equity RSUs
Annual performance bonus opportunities
Retirement account support
14+ weeks of paid parental leave
Career development opportunities
Company-paid privacy certification exam fees

Fulltime

Senior Staff Engineer, Applied AI

GEICO is seeking a Senior Staff Engineer, Applied AI to provide technical archit...

Location

United States , Chevy Chase, MD; Palo Alto, CA

Salary:

130000.00 - 260000.00 USD / Year

Geico

Expiration Date

Until further notice

Requirements

8 or more years of professional software engineering or applied machine learning experience
2 or more years working with Generative AI or LLM-based systems in production
Proven track record of architecting and delivering complex AI/ML capabilities that span multiple teams and have measurable business impact
Deep hands-on expertise with Python and modern AI frameworks including LangChain, LangGraph, LangSmith, LlamaIndex, Hugging Face, OpenAI/Anthropic APIs, and emerging agentic frameworks
Demonstrated experience building and deploying production RAG (Retrieval-Augmented Generation) systems including document ingestion, chunking strategies, vector search, and context retrieval
Demonstrated experience designing and operating production AI systems including multi-agent architectures, intelligent automation, and workflow orchestration
Strong understanding of agent architectures, workflow orchestration, retrieval-augmented generation (RAG), vector databases, knowledge graphs, and semantic reasoning
Familiarity with Agent-to-Agent (A2A) communication protocols and Model Context Protocol (MCP) for building interoperable AI systems
Experience ensuring platform scalability, cross-domain coherence, and alignment with AI platform capabilities and strategy
Strong expertise in distributed systems, microservices architecture, service design, performance optimization, and reliability engineering

Job Responsibility

Specify architectures and system decompositions for AI/ML capabilities that involve significant integrations and cross-team collaboration across multiple product areas
Provide technical architecture and leadership for medium to large, complex, cross-functional AI initiatives with visibility at the tech VP level
Architect and lead implementation of advanced Generative AI solutions including agent-based systems, intelligent automation, document intelligence, and decision support systems that span multiple business domains
Design and implement sophisticated agentic workflows that orchestrate multiple AI agents, tools, APIs, reasoning steps, and business logic to automate complex enterprise processes at scale
Question status quo with an eye for simpler designs and more secure approaches, influencing tech VPs to set direction for multiple teams
Build systems and platforms that meet the highest standards for scalability, resilience, performance, availability, security, and compliance
Identify and scope opportunities for automating business processes using AI across multiple product areas and business domains
Advance the state-of-the-art in applied AI by integrating knowledge graphs, vector reasoning, retrieval architectures, and multi-agent systems to solve complex business problems
Drive innovation by exploring new models, frameworks, reasoning techniques, and AI architectures and applying them strategically to high-impact business challenges
Run rigorous experimentation programs including hypothesis definition, A/B testing, measurement frameworks, and iterative improvement across production AI systems

What we offer

Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
Financial benefits including market-competitive compensation
a 401K savings plan vested from day one that offers a 6% match
performance and recognition-based incentives
and tuition assistance
Access to additional benefits like mental healthcare as well as fertility and adoption assistance
Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year

Fulltime

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

The PowerPoint team is embarking on an exciting new chapter - evolving a product...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
8+ years of experience in backend service engineering, including work on high-scale infrastructures
Proficiency in one or more systems programming languages such as C#, C++
1+ years of experience in software engineering, designing and developing systems (and APIs) that deploy and integrate with AI models
2+ years of experience working with rich telemetry, making data driven decisions, and carrying out rapid experimentation
2+ years of experience building software for scale, performance, and reliability
Academic or industry experience with building, finetuning, deploying or building eval-driven systems utilizing the models (any category)

Job Responsibility

Lead design and delivery of complex, scalable AI features ensuring resilience and exceptional user experience
Drive technical strategy and architecture decisions across multiple services, influencing partner teams and aligning with compliance and security requirements
Champion modern engineering practices, including AI-driven approaches, automation, and cloud-native patterns, across the full development lifecycle
Mentor and guide engineers, fostering technical excellence and continuous improvement in security, reliability, and performance
Collaborate cross-org to solve challenging technical problems, streamline processes, and reduce operational costs while improving live-site health
Design and implement scalable backend services optimized for machine learning workflows and large language model integration
Develop and maintain evaluation-driven systems that leverage text and multimodal inputs (e.g., images) to power visual-creation experiences
Build and optimize APIs and infrastructure to support high-performance model inference and experimentation at scale
Collaborate with product, ML, and design teams to integrate models into user-facing features, ensuring seamless functionality and performance
Conduct model evaluations and experiments, analyze results, and iterate on improvements to enhance accuracy and user experience

Fulltime

New

Senior + Principal Software Engineers- Front End Applied AI for Microsoft Threat Protection (MTP)

The Microsoft Security Organization is building the next generation of security ...

Location

United States , Redmond

Salary:

119800.00 - 234700.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to JavaScript, TypeScript, HTML, CSS OR equivalent experience.
Ability to meet Microsoft, customer and/or government security screening requirements including Microsoft Cloud Background Check.
Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to JavaScript, TypeScript, HTML, CSS OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to JavaScript, TypeScript, HTML, CSS OR equivalent experience.
4+ years of hands on experience building modern front end and/or full stack applications in production environments
Experience developing user facing web applications using modern front end frameworks such as React, Angular, or similar component based frameworks
Experience designing and implementing scalable client side application architecture across enterprise or cloud based software platforms
Ability to collaborate across service boundaries with backend or AI platform teams to integrate user interfaces with distributed systems
Experience architecting scalable UI platforms or experience layers that integrate with cloud scale services or AI powered systems
Experience managing or technically leading engineering teams, including driving design decisions, mentoring engineers, and leading execution of complex software initiatives
Demonstrated experience partnering closely with product management, engineering, and design teams to deliver user centric software experiences

Job Responsibility

Design and build AI driven security product experiences powered by large language models, multimodal models, and emerging frontier AI capabilities
Develop scalable full stack solutions that enable AI native workflows across threat detection, triage, investigation, and incident response
Partner deeply across engineering, product management, and design teams to create holistic, intuitive user experiences for interacting with AI powered security systems
Translate complex security workflows into user centric AI optimized interfaces that enable automation, augmentation, and governed autonomy
Rapidly prototype and iterate on AI native experiences within live production environments while maintaining Microsoft standards for security, reliability, privacy, and trust
Collaborate with backend AI platform teams to integrate reasoning systems into end to end user experiences and operational workflows
Shape the long term technical direction of AI driven user interaction paradigms across the Microsoft Threat Protection platform
Mentor engineers and drive engineering excellence across cross disciplinary teams

What we offer

Certain roles may be eligible for benefits and other compensation
Additional benefits and pay information available at https://careers.microsoft.com/us/en/us-corporate-pay

Fulltime

Senior Principal Software Engineer, Infrastructure

At Docker, we make app development easier so developers can focus on what matter...

Location

United States , Seattle

Salary:

251000.00 - 352000.00 USD / Year

Docker

Expiration Date

Until further notice

Requirements

12+ years of software engineering experience with demonstrated expertise across multiple platform domains (identity, billing, data, infrastructure)
Proven track record architecting and delivering large-scale distributed systems serving millions of users and thousands of enterprise customers
Deep expertise in at least two of: identity/access management systems, billing/monetization platforms, data platforms, or cloud infrastructure
Broad working knowledge across all platform domains with ability to make sound architectural decisions spanning multiple areas
Expert-level understanding of API design, service architecture, and system integration patterns at scale
Experience with cloud platforms (AWS, GCP, or Azure) and modern infrastructure patterns (Kubernetes, service mesh, infrastructure-as-code)
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
Track record of establishing strategic technical plans that directly enabled business outcomes (revenue growth, cost reduction, market expansion)
Experience translating business strategy into technical architecture and roadmaps
Demonstrated ability to identify and prioritize investments that provide maximum platform leverage

Job Responsibility

Define and own the multi-year technical vision for Docker's foundational platform, encompassing accounts, billing, data, enterprise governance, and infrastructure
Establish strategic plans and objectives for major platform initiatives, making architectural decisions that ensure effective achievement of Docker's business objectives
Contribute to and drive the strategic vision in collaboration with the VP of Engineering, translating organizational strategy into technical roadmaps that span multiple teams and years
Identify and prioritize platform investments that provide maximum leverage—capabilities built once that enable rapid iteration across all Docker products
Develop architectural principles and standards that guide technical decisions across the Bridge organization and influence product engineering teams
Anticipate future business needs and ensure platform architecture provides the flexibility to support Docker's evolving commercial models
Lead large cross-company programs that require coordination across Desktop, Hub, AI, Security, Cloud, and Platform teams
Architect the unified platform interfaces ("Control Planes") that enable product teams to answer canonical questions like "Can this user access this feature?" or "How much has this organization consumed?" without understanding underlying complexity
Drive convergence of fragmented systems across Docker—replacing product-specific implementations with shared platform capabilities for authentication, authorization, billing, and observability
Establish technical contracts between platform and product teams that enable independent velocity while ensuring consistency and reliability

What we offer

Freedom & flexibility
fit your work around your life
Designated quarterly Whaleness Days plus end of year Whaleness break
Home office setup
we want you comfortable while you work
16 weeks of paid Parental leave
Technology stipend equivalent to $100 net/month
PTO plan that encourages you to take time to do the things you enjoy
Training stipend for conferences, courses and classes
Equity

Fulltime

Executive Director, Agentic AI

The Executive Director, Agentic AI will define and lead the enterprise strategy,...

Location

United States , Sacramento

Salary:

175100.00 - 334750.00 USD / Year

CVS Health

Expiration Date

May 30, 2026

Requirements

12+ years in software engineering, platforms, or AI/ML, with 5+ years in senior leadership roles
Hands-on experience delivering AI systems at enterprise scale (not just experimentation)
Deep understanding of: LLMs, SLMs, RAG, embeddings, vector databases
Agent frameworks and orchestration patterns
Distributed systems, APIs, event-driven architectures
Proven ability to operate in regulated, high-availability environments
Strong executive communication and stakeholder-management skills

Job Responsibility

Define the enterprise Agentic AI vision and roadmap, aligned to business outcomes (cost reduction, revenue growth, productivity, experience uplift)
Establish clear differentiation between LLM tools, copilots, workflows, and autonomous/multi-agent systems
Identify and prioritize high-value agentic use cases (e.g., customer support resolution, claims/prior auth automation, contract leakage reduction, operational orchestration, developer productivity)
Own the design and evolution of the Agentic AI Platform, including: Multi-agent frameworks (planner, executor, verifier, critic, retriever agents)
Tool/function calling and API orchestration
RAG, memory, state management, and context persistence
Human-in-the-loop / human-on-the-loop controls
Define standards for agent lifecycle management (design, testing, deployment, observability, rollback)
Partner with Digital Platform and Integration teams to ensure agents are API-first, event-driven, and scalable
Lead delivery of production-grade agentic solutions, not POCs

What we offer

Affordable medical plan options
401(k) plan (including matching company contributions)
Employee stock purchase plan
No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
Paid time off
Flexible work schedules
Family leave
Dependent care resources
Colleague assistance programs
Tuition assistance

Fulltime

Senior and Principal Software Engineer - Core AI

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...

Location

United States , Redmond

Salary:

139900.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Go, Java, or Python
OR equivalent experience
6+ years technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems
Experience building AI or ML related applications
1+ years of technical engineering experience with machine learning or Artificial Intelligence (AI) systems

Job Responsibility

Design, implement and deliver AI services to support product offerings for large-scale agent observability
Collaborate closely with product management and partner teams to align technical direction with business goals
Take end-to-end responsibility for the development lifecycle and production readiness of the services you build and drive the team’s DevOps culture
Engage with customers to gather feedback and resolve complex issues
Understand Microsoft businesses and collaborate with stakeholders towards cohesive, end-to-end experiences for Microsoft customers
Innovate on technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products
Embody our culture and values

Fulltime

Senior Principal Software Engineer - AI Governance

OneTrust

Location:
United States , San Francisco

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
March 13, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Principal Software Engineer - AI Governance

Principal Engineer

Senior Principal Software Engineer - AI Governance

Senior Staff Engineer, Applied AI

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

Senior + Principal Software Engineers- Front End Applied AI for Microsoft Threat Protection (MTP)

Senior Principal Software Engineer, Infrastructure

Executive Director, Agentic AI

Senior and Principal Software Engineer - Core AI

Senior Principal Software Engineer - AI Governance

OneTrust

Location:United States , San Francisco

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:March 13, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Principal Software Engineer - AI Governance

Principal Engineer

Senior Principal Software Engineer - AI Governance

Senior Staff Engineer, Applied AI

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

Senior + Principal Software Engineers- Front End Applied AI for Microsoft Threat Protection (MTP)

Senior Principal Software Engineer, Infrastructure

Executive Director, Agentic AI

Senior and Principal Software Engineer - Core AI

Location:
United States , San Francisco

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
March 13, 2026