Senior Principal Software Engineer - AI Governance Job at OneTrust (Atlanta)

Principal Engineer

The Principal AI/ML Operations Engineer leads the architecture, automation, and ...

Location

United States , Pleasanton, California

Salary:

251000.00 - 314500.00 USD / Year

BlackLine

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field
10+ years in ML infrastructure, DevOps, and software system architecture
4+ years in leading MLOps or AI Ops platforms
Strong programming skills in languages such as Python, Java, or Scala
Expertise in ML frameworks (TensorFlow, PyTorch, scikit-learn) and orchestration tools (Airflow, Kubeflow, Vertex AI, MLflow)
Proven experience operating production pipelines for ML and LLM-based systems across cloud ecosystems (GCP, AWS, Azure)
Deep familiarity with LangChain, LangGraph, ADK or similar agentic system runtime management
Strong competencies in CI/CD, IaC, and DevSecOps pipelines integrating testing, compliance, and deployment automation
Hands-on with observability stacks (Prometheus, Grafana, Newrelic) for model and agent performance tracking
Understanding of governance frameworks for Responsible AI, auditability, and cost metering across training and inference workloads

Job Responsibility

Define enterprise-level standards and reference architectures for ML-Ops and AIOps systems
Partner with data science, security, and product teams to set evaluation and governance standards (Guardrails, Bias, Drift, Latency SLAs)
Mentor senior engineers and drive design reviews for ML pipelines, model registries, and agentic runtime environments
Lead incident response and reliability strategies for ML/AI systems
Lead the deployment of AI models and systems in various environments
Collaborate with development teams to integrate AI solutions into existing workflows and applications
Ensure seamless integration with different platforms and technologies
Define and manage MCP Registry for agentic component onboarding, lifecycle versioning, and dependency governance
Build CI/CD pipelines automating LLM agent deployment, policy validation, and prompt evaluation of workflows
Develop and operationalize experimentation frameworks for agent evaluations, scenario regression, and performance analytics

What we offer

short-term and long-term incentive programs
robust offering of benefit and wellness plans

Fulltime

Distinguished Engineer- AI Agentics Engineering

At CVS Health, we’re building a world of health around every consumer and surrou...

Location

United States , Woonsocket

Salary:

175100.00 - 334750.00 USD / Year

CVS Health

Expiration Date

March 31, 2026

Requirements

15+ years of Software Engineering experience required
7+ years in AI/ML engineering with 3+ years specifically in agentic AI or autonomous systems
Proven experience building multi-agent systems from scratch (not just fine-tuning existing models)
Deep expertise in: Multi-agent system architectures: Actor model frameworks, distributed consensus protocols, agent communication standards (FIPA-ACL, KQML, MCP, A2A), and coordination patterns (hierarchical, peer-to-peer, marketplace-based)
LLM Integration Platforms: OpenAI API, Anthropic Claude API, Azure OpenAI Service, Google Vertex AI, and on-premises LLM deployment (vLLM, TensorRT-LLM, Ollama)
Agentic Frameworks: LangChain, LangGraph, AutoGen, CrewAI, Semantic Kernel, and custom agent runtime environments
Tool-using AI Systems: Function calling implementations, API integration patterns, IDE (Cursor, Windsurf), Notebooks (Jupyter), tool selection algorithms, and sandbox execution environments for safe tool usage
Agent Orchestration Platforms: Kubernetes-based agent deployment, Apache Airflow for agent workflows, Temporal for durable agent executions, Agentspace, and event-driven architectures (Apache Kafka, RabbitMQ)
Vector Databases & Knowledge Systems: Pinecone, Weaviate, Chroma, Qdrant for agent memory systems, and knowledge graph technologies (Neo4j, Amazon Neptune, Apache Jena)
Real-time Inference Infrastructure: NVIDIA Triton Inference Server, Ray Serve, TorchServe, and streaming architectures for sub-100ms agent response times

Job Responsibility

Strategic Agentic Architecture & Design: Drive the end-to-end architecture for highly scalable, multi-agent systems that can operate autonomously across complex enterprise workflows
Partner with other Principal Engineers, AI Architects, and executive leadership to shape the long-term agentic roadmap
Champion best practices for agent reliability, interpretability, safety, and performance optimization
Agent Platform Development & Orchestration: Oversee the design and development of new AI agent platforms from the ground up
Implement robust agent lifecycle management, including spawning, monitoring, termination, and inter-agent communication protocols
Foster an engineering culture that values agent autonomy, emergent intelligence, and continuous learning capabilities
Multi-Agent Systems & Emerging AI Technologies: Provide thought leadership on how multi-agent systems, large language models, and reinforcement learning create unique demands on infrastructure
Understand how to move AI agents from proof-of-concept to production-ready autonomous systems
Evaluate and recommend emerging agentic technologies and guide their integration into the broader technology stack
Cross-Functional Leadership & AI Mentoring: Serve as a key technical advisor for C-level executives and product leaders

What we offer

Affordable medical plan options
401(k) plan (including matching company contributions)
Employee stock purchase plan
No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
Paid time off
Flexible work schedules
Family leave
Dependent care resources
Colleague assistance programs
Tuition assistance

Fulltime

New

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...

Location

United States , San Francisco

Salary:

165000.00 - 220000.00 USD / Year

OneTrust

Expiration Date

Until further notice

Requirements

Bachelor's or master's degree in computer science, Engineering, or related technical or business field
12+ years of professional software engineering/development experience
Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
Experience with elastic search and data streaming tools like Kafka
Good understanding of web services and SOA related standards like REST/OAuth/JSON
Moderate understanding of code and script (Python, Bash)
Good experience with SQL and NoSQL databases

Job Responsibility

Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust's AI Governance product
Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
Build features with RAG, agent workflows, and model orchestration
Own technical design for critical systems, ensuring scalability, security, and reliability
Maintain strong automated unit/integration test coverage and engineering standards
Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team's discussions on system architecture and component design
Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
Lead architecture discussions and technical planning
Drive alignment across teams on platform design and priorities
Contribute to sprint planning and delivery

What we offer

Comprehensive healthcare coverage
flexible PTO
equity RSUs
annual performance bonus opportunities
retirement account support
14+ weeks of paid parental leave
career development opportunities
company-paid privacy certification exam fees

Fulltime

Senior Staff Engineer, Applied AI

GEICO is seeking a Senior Staff Engineer, Applied AI to provide technical archit...

Location

United States , Chevy Chase, MD; Palo Alto, CA

Salary:

130000.00 - 260000.00 USD / Year

Geico

Expiration Date

Until further notice

Requirements

8 or more years of professional software engineering or applied machine learning experience
2 or more years working with Generative AI or LLM-based systems in production
Proven track record of architecting and delivering complex AI/ML capabilities that span multiple teams and have measurable business impact
Deep hands-on expertise with Python and modern AI frameworks including LangChain, LangGraph, LangSmith, LlamaIndex, Hugging Face, OpenAI/Anthropic APIs, and emerging agentic frameworks
Demonstrated experience building and deploying production RAG (Retrieval-Augmented Generation) systems including document ingestion, chunking strategies, vector search, and context retrieval
Demonstrated experience designing and operating production AI systems including multi-agent architectures, intelligent automation, and workflow orchestration
Strong understanding of agent architectures, workflow orchestration, retrieval-augmented generation (RAG), vector databases, knowledge graphs, and semantic reasoning
Familiarity with Agent-to-Agent (A2A) communication protocols and Model Context Protocol (MCP) for building interoperable AI systems
Experience ensuring platform scalability, cross-domain coherence, and alignment with AI platform capabilities and strategy
Strong expertise in distributed systems, microservices architecture, service design, performance optimization, and reliability engineering

Job Responsibility

Specify architectures and system decompositions for AI/ML capabilities that involve significant integrations and cross-team collaboration across multiple product areas
Provide technical architecture and leadership for medium to large, complex, cross-functional AI initiatives with visibility at the tech VP level
Architect and lead implementation of advanced Generative AI solutions including agent-based systems, intelligent automation, document intelligence, and decision support systems that span multiple business domains
Design and implement sophisticated agentic workflows that orchestrate multiple AI agents, tools, APIs, reasoning steps, and business logic to automate complex enterprise processes at scale
Question status quo with an eye for simpler designs and more secure approaches, influencing tech VPs to set direction for multiple teams
Build systems and platforms that meet the highest standards for scalability, resilience, performance, availability, security, and compliance
Identify and scope opportunities for automating business processes using AI across multiple product areas and business domains
Advance the state-of-the-art in applied AI by integrating knowledge graphs, vector reasoning, retrieval architectures, and multi-agent systems to solve complex business problems
Drive innovation by exploring new models, frameworks, reasoning techniques, and AI architectures and applying them strategically to high-impact business challenges
Run rigorous experimentation programs including hypothesis definition, A/B testing, measurement frameworks, and iterative improvement across production AI systems

What we offer

Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being
Financial benefits including market-competitive compensation
a 401K savings plan vested from day one that offers a 6% match
performance and recognition-based incentives
and tuition assistance
Access to additional benefits like mental healthcare as well as fertility and adoption assistance
Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year

Fulltime

Senior Principal Software Engineer, Infrastructure

At Docker, we make app development easier so developers can focus on what matter...

Location

United States , Seattle

Salary:

251000.00 - 352000.00 USD / Year

Docker

Expiration Date

Until further notice

Requirements

12+ years of software engineering experience with demonstrated expertise across multiple platform domains (identity, billing, data, infrastructure)
Proven track record architecting and delivering large-scale distributed systems serving millions of users and thousands of enterprise customers
Deep expertise in at least two of: identity/access management systems, billing/monetization platforms, data platforms, or cloud infrastructure
Broad working knowledge across all platform domains with ability to make sound architectural decisions spanning multiple areas
Expert-level understanding of API design, service architecture, and system integration patterns at scale
Experience with cloud platforms (AWS, GCP, or Azure) and modern infrastructure patterns (Kubernetes, service mesh, infrastructure-as-code)
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
Track record of establishing strategic technical plans that directly enabled business outcomes (revenue growth, cost reduction, market expansion)
Experience translating business strategy into technical architecture and roadmaps
Demonstrated ability to identify and prioritize investments that provide maximum platform leverage

Job Responsibility

Define and own the multi-year technical vision for Docker's foundational platform, encompassing accounts, billing, data, enterprise governance, and infrastructure
Establish strategic plans and objectives for major platform initiatives, making architectural decisions that ensure effective achievement of Docker's business objectives
Contribute to and drive the strategic vision in collaboration with the VP of Engineering, translating organizational strategy into technical roadmaps that span multiple teams and years
Identify and prioritize platform investments that provide maximum leverage—capabilities built once that enable rapid iteration across all Docker products
Develop architectural principles and standards that guide technical decisions across the Bridge organization and influence product engineering teams
Anticipate future business needs and ensure platform architecture provides the flexibility to support Docker's evolving commercial models
Lead large cross-company programs that require coordination across Desktop, Hub, AI, Security, Cloud, and Platform teams
Architect the unified platform interfaces ("Control Planes") that enable product teams to answer canonical questions like "Can this user access this feature?" or "How much has this organization consumed?" without understanding underlying complexity
Drive convergence of fragmented systems across Docker—replacing product-specific implementations with shared platform capabilities for authentication, authorization, billing, and observability
Establish technical contracts between platform and product teams that enable independent velocity while ensuring consistency and reliability

What we offer

Freedom & flexibility
fit your work around your life
Designated quarterly Whaleness Days plus end of year Whaleness break
Home office setup
we want you comfortable while you work
16 weeks of paid Parental leave
Technology stipend equivalent to $100 net/month
PTO plan that encourages you to take time to do the things you enjoy
Training stipend for conferences, courses and classes
Equity

Fulltime

Principal Architect - Apps & AI

Microsoft Industry Solutions – Global Center Innovation and Delivery Center (GCI...

Location

India , Hyderabad

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

22+ years of experience in software engineering and enterprise architecture
Significant experience operating at CxO level technical leadership roles
Proven track record leading large-scale transformation programs across cloud, data, AI, and modern application platforms
Strong executive communication, stakeholder influence, and decision-making capability
Bachelor’s degree in Computer Science, Engineering, or equivalent experience
Advanced certifications and industry recognition preferred
Expertise in Full Stack Application Engineering
Expertise in AI-Driven & AI-Enabled Application Development
Expertise in Cloud-Native Architecture (Azure)
Expertise in DevOps, Platform & Developer Productivity

Job Responsibility

AI First Enterprise Delivery Leadership
Own and drive enterprise scale architecture and delivery execution across highly complex customer portfolios
Embed AI first and AI native principles across solution design, delivery models, and operating frameworks
Serve as the primary executive technical interface for CIO / CTO / CDO leadership
Lead strategic recovery and stabilization of high risk or mission critical programs
Influence architectural direction beyond a single program
Engineering Excellence
Set and enforce engineering excellence standards across organizations
Champion modern engineering practices including AI assisted development, DevSecOps, SRE, observability, and platform engineering
Drive creation and reuse of enterprise grade reference architectures, accelerators, patterns, and paved road platforms

Fulltime

Principal Architect - Data & AI

The Principal Architect (L65) is a senior executive level technical leader accou...

Location

India , Hyderabad

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

22+ years of experience in software, data, and platform engineering
15+ years in enterprise architecture and technical leadership roles
Proven track record of influencing and delivering transformation outcomes at CXO level
Deep expertise in modern delivery methodologies and go-to-market acceleration models
Exceptional executive communication, stakeholder influence, and decision-making skills
Bachelor's degree in engineering, Computer Science, or equivalent experience
advanced certifications preferred
Expertise in Enterprise Data Architecture & Modern Platforms
Expertise in Data Engineering & Large Scale Data Processing
Expertise in Database Platforms, Performance & Capacity Engineering

Job Responsibility

Define and drive enterprise scale AI first delivery strategies
Lead end-to-end technical accountability for mission critical, multiprogram engagements
Establish delivery models that scale intelligent automation, autonomous systems, and AI native execution
Act as the executive technical authority during escalations
Partner with CIO/CTO/CDO leadership to balance innovation, governance, cost, security, and speed
Set enterprise architecture standards and technical guardrails
Ensure production grade quality through architecture reviews, performance benchmarks, security controls
Champion modern engineering practices including DevSecOps, platform engineering, CI/CD, SRE, and AI assisted development
Foster a culture of technical rigor, accountability, and continuous evolution
Shape forward-looking architecture visions for customers

Fulltime

Ai Consultant (Principal Ai Engineer)

We are looking for an AI Consultant (Principal AI Engineer) to support the desig...

Location

United Kingdom , London

Salary:

Not provided

Mastercard

Expiration Date

March 28, 2026

Requirements

Extensive architecture and engineering experience: 12+ years designing and building complex software systems, with strong depth in system and solution architecture
Enterprise solution architecture expertise: Proven experience translating business and technical requirements into scalable architectures involving multiple systems, integrations, and data sources
AI and generative AI familiarity: Solid understanding of AI and ML concepts, with hands on exposure to generative AI and LLM based systems in enterprise contexts
Agentic AI understanding: Familiarity with agent based architectures, orchestration patterns, and enterprise considerations such as guardrails, observability, and control
Partner and consulting mindset: Experience working directly with customers or partners in a consulting, advisory, or solution engineering role. Comfortable influencing architectural decisions
Strong communication skills: Ability to explain complex technical concepts clearly, create effective documentation, and engage senior technical and business stakeholders
Technical leadership: Experience guiding engineering teams through design decisions, reviews, and implementation challenges
Education and fundamentals: Bachelor’s or Master’s degree in Computer Science or a related field, with strong computer science and systems design fundamentals
Software engineering proficiency: Strong programming skills in languages such as Python, Java, or JavaScript/TypeScript. Ability to reason across backend systems, APIs, and data layers
Systems and cloud architecture: Experience designing distributed systems on AWS, Azure, or GCP. Familiar with microservices, event driven architectures, and API centric design

Job Responsibility

Partner-facing solution consulting: Engage directly with partners and customers to understand their system architectures, integration patterns, and data environments. Lead technical discovery sessions and act as a trusted advisor on applying Agentic AI solutions within their constraints
Architect AI-enabled solutions: Design end to end architectures for Agentic AI systems, including agent orchestration, data flows, model integration, APIs, and security boundaries. Ensure designs align with partner environments such as cloud, hybrid, or on prem deployments
Translate requirements into blueprints: Convert business and technical requirements into clear solution architectures, reference designs, and implementation guidance that partners can execute against
Guide AI and data integration: Advise on data requirements, data readiness, and integration of AI models with enterprise systems. Provide guidance on patterns such as retrieval augmented generation (RAG), tool using agents, and human in the loop workflows
Define best practices and guardrails: Apply Responsible AI principles, including data governance, security, safety controls, and risk mitigation. Contribute to standards, templates, and reference architectures for repeatable partner deployments
Collaborate with internal teams: Work with product, engineering, and platform teams to align partner needs with product capabilities and roadmap. Support pilots, proofs of concept, and early customer implementations
Technical communication and enablement: Produce architecture diagrams, documentation, and presentations. Clearly explain technical trade offs and architectural decisions to both technical and non technical stakeholders
Stay current on Agentic AI: Track emerging tools, frameworks, and architectural patterns in generative and Agentic AI, and guide partners on practical adoption

Fulltime

Senior Principal Software Engineer - AI Governance

OneTrust

Location:
United States , Atlanta

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:
March 13, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Principal Software Engineer - AI Governance

Principal Engineer

Distinguished Engineer- AI Agentics Engineering

Senior Principal Software Engineer - AI Governance

Senior Staff Engineer, Applied AI

Senior Principal Software Engineer, Infrastructure

Principal Architect - Apps & AI

Principal Architect - Data & AI

Ai Consultant (Principal Ai Engineer)

Senior Principal Software Engineer - AI Governance

OneTrust

Location:United States , Atlanta

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Nice to have:

Additional Information:

Job Posted:March 13, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Senior Principal Software Engineer - AI Governance

Principal Engineer

Distinguished Engineer- AI Agentics Engineering

Senior Principal Software Engineer - AI Governance

Senior Staff Engineer, Applied AI

Senior Principal Software Engineer, Infrastructure

Principal Architect - Apps & AI

Principal Architect - Data & AI

Ai Consultant (Principal Ai Engineer)

Location:
United States , Atlanta

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
March 13, 2026