CrawlJobs Logo

Senior Principal Software Engineer - AI Governance

United States, Atlanta 165000.00 - 220000.00 USD / Year · Job Posted March 13, 2026
Apply Position
Job Link Share

Job Description

As a Senior Principal Software Engineer, you will serve as a technical leader for OneTrust’s AI Governance platform, driving the design, scalability, and reliability of systems that enable enterprises to deploy and govern AI and LLM-powered applications responsibly. You will deeply understand how customers build, deploy, and operate AI systems, and translate those needs into secure, compliant, and observable platform capabilities.

Job Responsibility

  • Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust’s AI Governance product
  • Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
  • Build features with RAG, agent workflows, and model orchestration
  • Own technical design for critical systems, ensuring scalability, security, and reliability
  • Maintain strong automated unit/integration test coverage and engineering standards
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team’s discussions on system architecture and component design
  • Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
  • Lead architecture discussions and technical planning
  • Drive alignment across teams on platform design and priorities
  • Contribute to sprint planning and delivery
  • Reduce defects by identifying and addressing issues early in the development lifecycle
  • Ensure critical and high priority CII’s are delivered per SLA
  • Promote early defect detection through strong design and testing
  • Improve system monitoring, resilience, and operational maturity
  • Set standards for clean, secure, and maintainable code
  • Conduct thorough reviews for distributed and AI-enabled systems
  • Guide engineers on testing, automation, and AI system validation
  • Help build high-performing teams by mentoring the team on new technical skills
  • Influence technical strategy and long-term platform direction
  • Build a culture of ownership, learning, and engineering excellence

Requirements

  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 12+ years of professional software engineering/development experience
  • Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
  • Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
  • Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
  • Agile development (Scrum, XP, or Pair Programming) experience
  • Ability to use a wide variety of open-source technologies and cloud services
  • Familiarity with public cloud providers such as (Azure, Google Cloud, or AWS)

Nice to have

  • Experience with different databases (Relational and document) is a strong asset
  • Familiarity with continuous integration and continuous deployment (CI/CD) tools
  • Proficiency in Kubernetes, including cluster deployment, scaling, and management is highly desirable
  • Background in enterprise, regulated, or security-focused environments

What we offer

  • Comprehensive healthcare coverage
  • Flexible PTO
  • Equity RSUs
  • Annual performance bonus opportunities
  • Retirement account support
  • 14+ weeks of paid parental leave
  • Career development opportunities
  • Company-paid privacy certification exam fees

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Similar Jobs for

Senior Principal Software Engineer - AI Governance

8 matching positions

Senior Principal Software Engineer - AI Governance

As a Senior Principal Software Engineer, you will serve as a technical leader fo...
Location
Location
United States , San Francisco
Salary
Salary:
165000.00 - 220000.00 USD / Year
onetrust.com Logo
OneTrust
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or master's degree in computer science, Engineering, or related technical or business field
  • 12+ years of professional software engineering/development experience
  • Strong expertise in Java/J2EE, Spring, design patterns, microservices architecture, and cloud-native distributed systems
  • Proven experience building production-grade agentic AI systems with robust tool-use, guardrails, and observability for enterprise-scale workloads
  • Solid understanding of RAG pipelines, agent workflows, model orchestration, and evaluation practices
  • Working experience with one or more AI platforms like Amazon SageMaker, Google Vertex, AWS Bedrock etc.
  • Experience with elastic search and data streaming tools like Kafka
  • Good understanding of web services and SOA related standards like REST/OAuth/JSON
  • Moderate understanding of code and script (Python, Bash)
  • Good experience with SQL and NoSQL databases
Job Responsibility
Job Responsibility
  • Lead the design and development of Java/Python microservices and shared libraries integrating with AI platforms for OneTrust's AI Governance product
  • Design, build, and test cloud-native applications deployed on Microsoft Azure using Core Java, REST, and the Spring ecosystem
  • Build features with RAG, agent workflows, and model orchestration
  • Own technical design for critical systems, ensuring scalability, security, and reliability
  • Maintain strong automated unit/integration test coverage and engineering standards
  • Work closely with UX, Product Managers and/or Product Owners, as well as other developers to contribute to planning and grooming sessions and drive team's discussions on system architecture and component design
  • Partner with Product, UX, and Customer Success to understand customer AI use cases and governance needs
  • Lead architecture discussions and technical planning
  • Drive alignment across teams on platform design and priorities
  • Contribute to sprint planning and delivery
What we offer
What we offer
  • Comprehensive healthcare coverage
  • flexible PTO
  • equity RSUs
  • annual performance bonus opportunities
  • retirement account support
  • 14+ weeks of paid parental leave
  • career development opportunities
  • company-paid privacy certification exam fees
  • Fulltime
Read More
Arrow Right

Senior Software Engineer and Principal Software Engineer - Power Point AI Team

The PowerPoint team is embarking on an exciting new chapter - evolving a product...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 8+ years of experience in backend service engineering, including work on high-scale infrastructures
  • Proficiency in one or more systems programming languages such as C#, C++
  • 1+ years of experience in software engineering, designing and developing systems (and APIs) that deploy and integrate with AI models
  • 2+ years of experience working with rich telemetry, making data driven decisions, and carrying out rapid experimentation
  • 2+ years of experience building software for scale, performance, and reliability
  • Academic or industry experience with building, finetuning, deploying or building eval-driven systems utilizing the models (any category)
Job Responsibility
Job Responsibility
  • Lead design and delivery of complex, scalable AI features ensuring resilience and exceptional user experience
  • Drive technical strategy and architecture decisions across multiple services, influencing partner teams and aligning with compliance and security requirements
  • Champion modern engineering practices, including AI-driven approaches, automation, and cloud-native patterns, across the full development lifecycle
  • Mentor and guide engineers, fostering technical excellence and continuous improvement in security, reliability, and performance
  • Collaborate cross-org to solve challenging technical problems, streamline processes, and reduce operational costs while improving live-site health
  • Design and implement scalable backend services optimized for machine learning workflows and large language model integration
  • Develop and maintain evaluation-driven systems that leverage text and multimodal inputs (e.g., images) to power visual-creation experiences
  • Build and optimize APIs and infrastructure to support high-performance model inference and experimentation at scale
  • Collaborate with product, ML, and design teams to integrate models into user-facing features, ensuring seamless functionality and performance
  • Conduct model evaluations and experiments, analyze results, and iterate on improvements to enhance accuracy and user experience
  • Fulltime
Read More
Arrow Right

Senior and Principal Software Engineer - Core AI

Core AI is at the forefront of Microsoft’s mission to redefine how software is b...
Location
Location
United States , Redmond
Salary
Salary:
139900.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C++, C#, Go, Java, or Python
  • OR equivalent experience
  • 6+ years technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems
  • Experience building AI or ML related applications
  • 1+ years of technical engineering experience with machine learning or Artificial Intelligence (AI) systems
Job Responsibility
Job Responsibility
  • Design, implement and deliver AI services to support product offerings for large-scale agent observability
  • Collaborate closely with product management and partner teams to align technical direction with business goals
  • Take end-to-end responsibility for the development lifecycle and production readiness of the services you build and drive the team’s DevOps culture
  • Engage with customers to gather feedback and resolve complex issues
  • Understand Microsoft businesses and collaborate with stakeholders towards cohesive, end-to-end experiences for Microsoft customers
  • Innovate on technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products
  • Embody our culture and values
  • Fulltime
Read More
Arrow Right

Senior Principal Software Engineer, Infrastructure

At Docker, we make app development easier so developers can focus on what matter...
Location
Location
United States , Seattle
Salary
Salary:
251000.00 - 352000.00 USD / Year
docker.com Logo
Docker
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of software engineering experience with demonstrated expertise across multiple platform domains (identity, billing, data, infrastructure)
  • Proven track record architecting and delivering large-scale distributed systems serving millions of users and thousands of enterprise customers
  • Deep expertise in at least two of: identity/access management systems, billing/monetization platforms, data platforms, or cloud infrastructure
  • Broad working knowledge across all platform domains with ability to make sound architectural decisions spanning multiple areas
  • Expert-level understanding of API design, service architecture, and system integration patterns at scale
  • Experience with cloud platforms (AWS, GCP, or Azure) and modern infrastructure patterns (Kubernetes, service mesh, infrastructure-as-code)
  • Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
  • Track record of establishing strategic technical plans that directly enabled business outcomes (revenue growth, cost reduction, market expansion)
  • Experience translating business strategy into technical architecture and roadmaps
  • Demonstrated ability to identify and prioritize investments that provide maximum platform leverage
Job Responsibility
Job Responsibility
  • Define and own the multi-year technical vision for Docker's foundational platform, encompassing accounts, billing, data, enterprise governance, and infrastructure
  • Establish strategic plans and objectives for major platform initiatives, making architectural decisions that ensure effective achievement of Docker's business objectives
  • Contribute to and drive the strategic vision in collaboration with the VP of Engineering, translating organizational strategy into technical roadmaps that span multiple teams and years
  • Identify and prioritize platform investments that provide maximum leverage—capabilities built once that enable rapid iteration across all Docker products
  • Develop architectural principles and standards that guide technical decisions across the Bridge organization and influence product engineering teams
  • Anticipate future business needs and ensure platform architecture provides the flexibility to support Docker's evolving commercial models
  • Lead large cross-company programs that require coordination across Desktop, Hub, AI, Security, Cloud, and Platform teams
  • Architect the unified platform interfaces ("Control Planes") that enable product teams to answer canonical questions like "Can this user access this feature?" or "How much has this organization consumed?" without understanding underlying complexity
  • Drive convergence of fragmented systems across Docker—replacing product-specific implementations with shared platform capabilities for authentication, authorization, billing, and observability
  • Establish technical contracts between platform and product teams that enable independent velocity while ensuring consistency and reliability
What we offer
What we offer
  • Freedom & flexibility
  • fit your work around your life
  • Designated quarterly Whaleness Days plus end of year Whaleness break
  • Home office setup
  • we want you comfortable while you work
  • 16 weeks of paid Parental leave
  • Technology stipend equivalent to $100 net/month
  • PTO plan that encourages you to take time to do the things you enjoy
  • Training stipend for conferences, courses and classes
  • Equity
  • Fulltime
Read More
Arrow Right

Senior + Principal Software Engineers- Front End Applied AI for Microsoft Threat Protection (MTP)

The Microsoft Security Organization is building the next generation of security ...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to JavaScript, TypeScript, HTML, CSS OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements including Microsoft Cloud Background Check.
  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to JavaScript, TypeScript, HTML, CSS OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to JavaScript, TypeScript, HTML, CSS OR equivalent experience.
  • 4+ years of hands on experience building modern front end and/or full stack applications in production environments
  • Experience developing user facing web applications using modern front end frameworks such as React, Angular, or similar component based frameworks
  • Experience designing and implementing scalable client side application architecture across enterprise or cloud based software platforms
  • Ability to collaborate across service boundaries with backend or AI platform teams to integrate user interfaces with distributed systems
  • Experience architecting scalable UI platforms or experience layers that integrate with cloud scale services or AI powered systems
  • Experience managing or technically leading engineering teams, including driving design decisions, mentoring engineers, and leading execution of complex software initiatives
  • Demonstrated experience partnering closely with product management, engineering, and design teams to deliver user centric software experiences
Job Responsibility
Job Responsibility
  • Design and build AI driven security product experiences powered by large language models, multimodal models, and emerging frontier AI capabilities
  • Develop scalable full stack solutions that enable AI native workflows across threat detection, triage, investigation, and incident response
  • Partner deeply across engineering, product management, and design teams to create holistic, intuitive user experiences for interacting with AI powered security systems
  • Translate complex security workflows into user centric AI optimized interfaces that enable automation, augmentation, and governed autonomy
  • Rapidly prototype and iterate on AI native experiences within live production environments while maintaining Microsoft standards for security, reliability, privacy, and trust
  • Collaborate with backend AI platform teams to integrate reasoning systems into end to end user experiences and operational workflows
  • Shape the long term technical direction of AI driven user interaction paradigms across the Microsoft Threat Protection platform
  • Mentor engineers and drive engineering excellence across cross disciplinary teams
What we offer
What we offer
  • Certain roles may be eligible for benefits and other compensation
  • Additional benefits and pay information available at https://careers.microsoft.com/us/en/us-corporate-pay
  • Fulltime
Read More
Arrow Right
New

Principal Software Engineer

We are developing Manufacturing and Engineering AI tools that help employees gai...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
amgen.com Logo
Amgen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 13-17 years of engineering experience building or platforming cloud services or developer platforms, with 3+ years leading engineering teams or technical programs
  • Proven experience designing and operating cloud-native platforms using Kubernetes, containers, microservices, and related distributed system patterns
  • Hands-on experience with LLM serving or adjacent model-serving patterns, including inference endpoints, routing, scaling, batching, and latency/cost optimization
  • Practical knowledge of API gateway patterns, authentication and authorization, and secure integrations
  • Familiarity with cost attribution and FinOps concepts for cloud and AI workloads
  • Strong track record partnering with product managers and senior technical stakeholders to deliver platform capabilities and roadmaps
  • Excellent communication skills with the ability to explain technical tradeoffs clearly to both technical and non-technical audiences
  • Experience with observability and SRE practices, including metrics, tracing, logging, incident management, and production support
  • Master's / Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Define the technical vision and reference architecture for AI platforms supporting chatbots, agents, orchestration, and related enterprise services
  • Translate product and business requirements into scalable platform capabilities, including agent hosting, model access, AI gateways, observability, and operational tooling
  • Drive platform decisions around LLM serving, model endpoints, caching, batching, latency-versus-cost tradeoffs, and multi-model support
  • Lead architecture for manufacturing integrations and industrial data connectivity, including patterns for SCADA, Data Historian, MES, ERP, LIMS, APIs, event streams, and document-based knowledge sources
  • Own platform reliability, scalability, and cost by defining SLIs/SLOs, capacity planning, cost attribution, and FinOps practices
  • Collaborate with Product Owners, Principal Engineers, and stakeholders to define roadmap, acceptance criteria, and delivery milestones
  • Lead and mentor engineers delivering platform services, integrations, CI/CD for agents and models, and marketplace/catalog capabilities
  • Establish standards for security, compliance, and model governance, including data handling, access controls, logging, auditability, and traceability
  • Be hands-on when needed to prototype architectures, review designs, troubleshoot production incidents, and participate in code and design reviews
What we offer
What we offer
  • In addition to the base salary, Amgen offers competitive and comprehensive Total Rewards Plans that are aligned with local industry standards
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

The Principal Software Engineer is the senior-most hands-on technical leader for...
Location
Location
India , Chennai
Salary
Salary:
Not provided
rxglobal.com Logo
RX Global
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience as a senior technical leader across multiple teams/services within a bounded domain
  • Strong polyglot background (e.g., C#/.NET, Java, JavaScript/Node) and ability to choose fit-for-purpose technologies
  • Experience modernising systems: migrating from legacy architectures to cloud-native patterns, reducing technical debt, and decommissioning safely
  • Experience in systems analysis, design and a solid understanding of development, quality assurance and integration methodologies
  • Experience developing integrated solutions within a broad technical and business context of significant impact
  • Experience evaluating third-party services and platforms (security, cost, operations, integration complexity)
  • Experience leading cross‑team architectural change, platform adoption, or measurable improvements to reliability/cost/performance (with before/after metrics)
  • Familiarity with responsible AI usage in engineering workflows (policy/guardrails, data privacy, human‑in‑the‑loop review)
  • Bachelor’s/Master’s degree in Computer Science (or related) or equivalent professional experience
  • Expert software design skills: SOLID, DDD, event-driven architecture patterns, modular design, and maintainable codebases
Job Responsibility
Job Responsibility
  • Engineering Leadership & Culture: Create an environment where teams can do their best work by removing blockers, improving engineering practices, and contributing to a culture of psychological safety and high standards
  • Mentor and coach engineers across teams—especially senior engineers and emerging tech leads—in architecture, systems thinking, and operational excellence
  • Promote strong technical ownership ("you build it, you run it"), including operational readiness and post-incident learning
  • Support scalable knowledge-sharing mechanisms (e.g., tech talks, playbooks, templates, reference implementations)
  • Participate in hiring loops and help onboard new engineers into domain patterns and practices
  • Provide hands-on contributions where needed (prototypes, reference implementations, complex refactors, high-risk changes)
  • Guide teams in decomposition and sequencing to reduce delivery risk
  • support estimation/sizing and technical discovery
  • Leads through influence
  • demonstrates integrity, accountability, and constructive challenge
What we offer
What we offer
  • Comprehensive Health Insurance: Covers you, your immediate family, and parents
  • Enhanced Health Insurance Options: Competitive rates negotiated by the company
  • Group Life Insurance: Ensuring financial security for your loved ones
  • Group Accident Insurance: Extra protection for accidental death and permanent disablement
  • Flexible Working Arrangement: Achieve a harmonious work-life balance
  • Employee Assistance Program: Access support for personal and work-related challenges
  • Medical Screening: Your well-being is a top priority
  • Modern Family Benefits: Maternity, paternity, and adoption support
  • Long-Service Awards: Recognizing dedication and commitment
  • New Baby Gift: Celebrating the joy of parenthood
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

Microsoft 365 Intelligent Conversation and Communications Cloud (IC3) powers bil...
Location
Location
United States , Redmond
Salary
Salary:
142800.00 - 274800.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Job Responsibility
Job Responsibility
  • Set the technical strategy and architecture for AEGIS — multi-service security platforms, AI agentic systems (agentic vulnerability detection, continuous assessment, triage, automated/recommended remediation), and the developer-facing surfaces hundreds of IC3 engineers depend on. Own the 12–24 month technical roadmap and trade-offs
  • Provide architecture depth and review rigor across IC3 security work — lead design reviews, security reviews, and threat-model deep dives
  • act as the final technical reviewer on the most ambiguous, highest-risk designs
  • raise the bar without becoming a bottleneck
  • Define and enforce quality gates — codify the policies, controls, telemetry, and pipeline checks (SFI waves, secure-by-default patterns, identity / network / data protections, container hardening, key management) that make consistent security execution the default across IC3 services
  • Exercise compliance judgment — translate SOC 2, ISO 27001, GDPR, HIPAA, FedRAMP, DoD IL5, and Microsoft internal standards (SFI, S360) into concrete engineering requirements and automation
  • make the call when policy, business risk, and engineering reality conflict
  • Drive partner alignment across IC3 and M365 — with security architects, MSRC, privacy, compliance, and service-owner leadership
  • resolve cross-team architectural disagreements
  • ensure SFI and incident-driven work lands as a coherent program, not isolated point fixes
  • Fulltime
Read More
Arrow Right