Principal Product Manager - Observability & Evaluations Job at Microsoft Corporation (New York)

Principal Product Manager, AI

LogicMonitor® is the AI-first hybrid observability platform powering the next ge...

Location

India , Pune

Salary:

Not provided

LogicMonitor

Expiration Date

Until further notice

Requirements

8 to 9 years of product management experience, ideally in B2B software
Strong hands on fluency with AI powered products and how modern AI systems work
Proven experience owning products end to end in ambiguous environments
Strong customer instincts and comfort being customer facing
Ability to think strategically while executing tactically
Clear communicator who can align teams without relying on authority
Bias for action and comfort with scrappy execution

Job Responsibility

End to end ownership of major Edwin AI product areas from discovery to delivery to adoption
Deep customer engagement to uncover real problems and validate solutions
Clear product strategy and roadmap grounded in customer value, data, and business outcomes
Hands on collaboration with engineering, design, GTM, and applied AI teams
Product decisions across AI capabilities including agents, workflows, and intelligent experiences
Success metrics like adoption, usage, customer impact, and business outcomes
Spend real time with customers through calls, demos, feedback sessions, and follow ups
Translate messy customer problems into crisp product bets and shipped features
Work closely with engineers on scope, tradeoffs, and delivery details
Get hands on with AI concepts like prompting, evaluations, agent behavior, and failure modes

Principal Product Manager - AI Governance (Azure AI Foundry)

AI is transforming how organizations operate, and with it comes a new frontier o...

Location

United States , Redmond

Salary:

139900.00 - 274800.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor’s Degree AND 8+ years in product management, program management, or technical leadership roles OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Deep familiarity with AI/ML systems, model governance, or enterprise compliance frameworks
Proven experience driving cross-functional initiatives with engineering, security, and policy teams
Excellent communication skills with demonstrated ability to influence across organizational boundaries
10+ years of product management or applied AI experience, ideally in enterprise cloud or responsible AI domains
Knowledge of AI governance frameworks (EU AI Act, NIST AI RMF, ISO 42001, SOC 2, etc.)
Experience building or integrating security, compliance, or observability products
Familiarity with agentic AI systems and associated risk classes (e.g., sensitive data leakage, prohibited actions, task drift, jailbreaks)

Job Responsibility

Lead the AI Governance product area within Azure AI Foundry — defining the long-term vision, strategy, and roadmap for policy management, compliance automation, and regulatory readiness
Design and deliver core governance experiences, including agent-level policies, data sensitivity signals, prohibited action controls, and AI system compliance dashboards
Integrate Foundry governance with Microsoft’s broader security and compliance stack — Entra (identity and A2A policies), Purview (data classification and DLP), and Defender (threat insights)
Translate emerging AI regulations (EU AI Act, ISO 42001, NIST AI RMF) into actionable platform capabilities and customer experiences
Partner with Responsible AI researchers and engineering teams to operationalize ethical principles into measurable safeguards and evaluators
Collaborate with customers, industry bodies, and policymakers to help shape standards for trustworthy AI deployment
Establish and track success metrics (governance coverage, compliance posture, customer adoption), ensuring measurable impact and clarity across engineering and partner orgs
Represent the product in executive and customer forums, evangelizing Microsoft’s approach to responsible, governed AI systems

Fulltime

New

Lead GenAI Principal Engineer & Manager, SVP

We are seeking a highly skilled Lead Generative AI Principal Engineer & Manager ...

Location

Canada , Mississauga

Salary:

145100.00 - 217700.00 USD / Year

Citi

Expiration Date

Until further notice

Requirements

6+ years' experience in the software industry, with proven success in a senior position such as Principal Engineer or Architect (recent hands-on experience required)
3+ years' experience serving as a people manager
Highly experienced in delivering complex technical solutions to production, preferably within the Python and AI/ML ecosystem
Proficiency in programming languages such as Python
Passion for and proven hands-on experience integrating with AI/ML technologies
Experience with cloud architectures and public cloud offerings
A strong and diverse technical background, with the ability to quickly learn new technologies and influence highly skilled engineering teams
Excellent communication, leadership, and organizational abilities
Excellent analytical and problem-solving skills with the ability to think strategically
Experience in the financial industry is a major advantage

Job Responsibility

Lead the end-to-end development of highly complex AI solutions, infrastructure, and architecture
Lead and guide a team of engineers and data scientists, reviewing designs and code to uphold the highest levels of engineering standards
Translate ambiguous product or business problems into clear technical direction, defining success metrics for engineering and data science teams
Design robust model architectures, retrieval strategies, prompting/orchestration layers, and evaluation frameworks that meet product, reliability, and scalability requirements
Engage with data-science, technical, and business stakeholders to define and architect solutions for key use-cases across our lines of business
Actively contribute to software development, both as a hands-on coder and as a reviewer
Build and maintain core Python-based Generative AI components, including RAG pipelines, model wrappers, orchestration logic, and data loaders using FastAPI, ADK, and internal libraries
Ensure robust error handling, observability, and test coverage across all codebases
Manage executive stakeholder relationships in technology, acting as a partner and trusted advisor
Manage multiple concurrent initiatives and projects of varying sizes and complexity

Fulltime

Principal Software Engineer

The Microsoft Content team powers AI-driven experiences for more than 1B users a...

Location

United States , Redmond

Salary:

163000.00 - 296400.00 USD / Year

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Proven track record of architecting and delivering large-scale distributed systems or platforms used by millions of users
Deep expertise in backend systems, cloud-native architecture, and service-oriented or microservices-based design
Experience owning and evolving production systems with high availability, low latency, and solid operational rigor
Solid fundamentals in system design, distributed systems, data modeling, and performance optimization
Demonstrated ability to drive technical strategy and influence across multiple teams or organizations
Experience leading complex, ambiguous, and high-impact technical initiatives end-to-end

Job Responsibility

Define and drive long-term technical strategy for large-scale distributed systems and platforms spanning multiple teams and organizations
Establish architectural principles, patterns, and standards that ensure consistency, scalability, and maintainability across services
Lead the design of system-of-systems architectures, integrating services, data, and AI capabilities into cohesive platforms
Make high-impact technical decisions that balance innovation, risk, cost, and long-term sustainability
Architect and evolve backend services, APIs, data infrastructure, and platform capabilities that operate at global scale
Ensure systems meet stringent requirements for availability, latency, throughput, security, privacy, and cost efficiency
Drive operational excellence through observability, resiliency design, incident management, and continuous improvement
Identify and eliminate systemic inefficiencies across services, infrastructure, and development workflows
Define how LLMs and intelligent systems are integrated into core platform architecture (not as isolated features)
Establish patterns for retrieval, grounding, orchestration, memory, and tool use in production systems

Fulltime

Senior Principal Architect

We are seeking a deeply technical Senior Principal Architects to define and driv...

Location

India , Bangalore

Salary:

Not provided

Microsoft Corporation

Expiration Date

Until further notice

Requirements

Bachelor’s Degree in Computer Science or related technical field AND 15+ years of professional software engineering experience, or equivalent practical experience
8+ years of senior technical leadership experience influencing engineers, technical leads, architects, applied scientists, or cross-functional engineering teams across complex platform or product areas
Proven experience architecting and delivering large-scale production systems with meaningful reliability, scalability, latency, correctness, availability, security, and operational requirements
Deep technical experience in one or more of the following platform areas: AI/ML systems, agentic systems, model-serving infrastructure, decisioning systems, distributed systems, data platforms, workflow platforms, risk platforms, security platforms, or Trust & Safety systems
Experience building or technically leading production AI/ML systems, including exposure to modern AI patterns such as LLM-based workflows, retrieval-augmented generation, model orchestration, automated reasoning, human-in-the-loop systems, AI-assisted operational tooling, or agentic workflows
Strong understanding of the engineering requirements for deploying AI or decision systems in production, including evaluation, observability, quality measurement, rollout safety, fallback behavior, latency/cost tradeoffs, drift detection, explainability, governance, and operational reliability
Experience designing high-integrity systems where decisions must be auditable, reproducible, explainable, governed, and secure, especially when handling sensitive signals, advertiser impact, policy enforcement, risk decisions, or compliance-sensitive workflows
Ability to drive clarity from ambiguity, define technical direction, create reusable platform abstractions, and influence execution across multiple teams without relying on direct management authority
Strong written and verbal communication skills, including the ability to explain architecture, tradeoffs, risks, sequencing, and technical strategy to senior engineering, science, product, policy, security, and business leaders

Job Responsibility

AI Platform Architecture and Technical Strategy
Define the long-term architecture for the Ads Trust & Safety AI Platform across ingestion, signal acquisition, entity intelligence, retrieval, model orchestration, agentic workflows, decisioning, enforcement, human review, audit, and measurement
Translate broad Trust & Safety, Risk, Fraud, Security, and Policy needs into reusable platform capabilities
Establish reference architectures, design principles, technical standards, and engineering patterns for high-integrity AI and decisioning systems
Drive architecture choices across latency, throughput, quality, cost, explainability, governance, reliability, and operational safety
Identify critical platform gaps and create a roadmap that balances near-term delivery with long-term leverage
Deep Research Agents and AI-Assisted Investigation
Architect platform for Deep Research Agents that investigate domains, landing pages, advertisers, business entities, ownership patterns, web presence, reputation, policy risk, and fraud signals
Architect workflows that combine retrieval, crawling, structured evidence extraction, LLM reasoning, policy grounding, risk scoring and human in the loop
Architect guardrails for agentic systems, including source provenance, confidence scoring, hallucination controls, audit logs, escalation paths, and human override

Fulltime

Principal Machine Learning Engineer - Forecasting

We are seeking a Principal Machine Learning Engineer to join the Forecasting tea...

Location

India , Hyderabad

Salary:

Not provided

Amgen

Expiration Date

Until further notice

Requirements

Degree and 12+ years of experience in machine learning engineering, software engineering, data science engineering, or a related quantitative discipline.
10+ years of professional experience building, deploying, and operating production ML, AI, data, or software systems, including significant experience as a technical lead on complex, cross-functional initiatives.
Demonstrated track record of designing or architecting new and existing systems with emphasis on reliability, scale, security, maintainability, and operational excellence.
Deep hands-on experience with the full ML engineering lifecycle, including data pipelines, feature engineering, experimentation, model training, model integration, testing, deployment, monitoring, evaluation, observability, and continuous improvement.
Strong experience deploying forecasting, probabilistic, Bayesian, predictive, NLP, deep learning, or LLM-based systems in production environments.
Experience building or integrating AI systems, including LLM-powered applications, agentic workflows, retrieval or information-retrieval systems, evaluation frameworks, and human-in-the-loop review patterns.
Strong object-oriented programming skills in Python and SQL, with experience using modern ML and software development frameworks such as scikit-learn, PyTorch, TensorFlow/JAX, Spark, Ray, MLflow, Airflow/Prefect/Dagster, FastAPI, or equivalent technologies.
Experience with cloud platforms and distributed systems, including containerization, CI/CD, infrastructure-as-code, model serving, workflow orchestration, batch and streaming data processing, and production support.
Strong software engineering fundamentals, including system design, architecture trade-off analysis, testing strategies, code reviews, source control, build and release processes, performance optimization, and maintainability.
Demonstrated ability to communicate technical strategy, system tradeoffs, and delivery risks to technical and non-technical stakeholders, including senior leaders, product/program owners, scientists, and business partners.

Job Responsibility

Define and drive the technical strategy for enterprise forecasting and AI decision systems, aligning architecture, reusable platforms, and delivery roadmaps to Amgen's planning, supply, commercial, manufacturing, operations, and patient-focused priorities.
Partner with data scientists, product and program leaders, operations, commercial, manufacturing, supply chain, finance, and other business stakeholders to translate ambiguous requirements into shipped software and measurable business outcomes.
Architect, build, and scale production ML, LLM, and agentic AI systems that combine forecasting, predictive analytics, simulation, optimization, and autonomous or semi-autonomous workflow automation.
Productionize advanced statistical, Bayesian, deep learning, and machine learning models, including training, validation, inference, serving, evaluation, lifecycle management, and governed deployment.
Lead development of AI agent components that automate complex forecasting and operational workflows across multiple systems, decision points, datasets, and user groups while preserving appropriate human-in-the-loop review and escalation patterns.
Design secure integrations across enterprise APIs, databases, analytics platforms, workflow systems, cloud services, and AI orchestration patterns to enable multi-system decision support and scalable automation.
Establish robust MLOps and AI engineering capabilities, including model versioning, CI/CD, automated retraining, performance monitoring, observability, drift detection, service-level reliability, rollback strategies, and operational runbooks.
Implement guardrails, model and agent evaluation frameworks, auditability, explainability, responsible AI controls, and human-in-the-loop operating models for production AI systems in high-impact and regulated business contexts.
Research and evaluate state-of-the-art open-source, vendor, and internal tools related to forecasting, LLMs, AI agents, MLOps, model optimization, model serving, and scalable AI infrastructure for potential application to Amgen business problems.
Provide principal-level technical mentorship, design review leadership, and engineering standard-setting across teams, promoting code quality, documentation, reproducibility, testing, security, privacy, maintainability, and operational excellence.

Fulltime

Principal Software Automation/test Engineer

At Palo Alto Networks, we're not just building products — we're redefining what'...

Location

United States , Santa Clara

Salary:

147000.00 - 237500.00 USD / Year

Palo Alto Networks

Expiration Date

Until further notice

Requirements

9+ years in software tooling or infrastructure engineering within large-scale enterprises or high-growth startups
Strong programming skills in Python
Proven experience leveraging AI/ML technologies (LLMs, agentic frameworks, prompt engineering) to build intelligent engineering tools
Deep understanding of public cloud platforms (AWS, GCP, Azure) and building tools that leverage cloud-native services
Demonstrated experience designing complex tooling frameworks from scratch with a focus on scalability and extensibility
Proficiency in integrating technologies such as Pytest, Selenium, Playwright, Terraform, Docker, and Kubernetes
Strong troubleshooting skills and experience supporting tooling for distributed systems and SaaS-based products
Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field

Job Responsibility

Architect Next-Gen Platforms: Lead the design of tooling platforms and comprehensive strategies for complex, large-scale systems
Drive AI-Powered Automation: Leverage AI to design intelligent tools that enhance testing efficiency, code quality, and productivity across the organization
Build Agentic Workflows: Integrate LLM-powered assistants and agentic workflows to automate repetitive tasks like test case creation, log analysis, and code review triage
Operationalize Emerging Tech: Evaluate and adopt technologies such as Retrieval-Augmented Generation (RAG) and fine-tuned models to push the boundaries of engineering automation
Establish AI Guardrails: Define best practices for responsible AI usage, including hallucination mitigation and human-in-the-loop review processes
Enhance Developer Experience: Design and implement internal tools, SDKs, and frameworks to boost engineering velocity and productivity
Advanced Framework Development: Build robust automation frameworks equipped with detailed reporting, observability, and seamless CI/CD integration
Cloud-Native Environments: Manage complex testbeds and infrastructure-as-code solutions to support varied development and testing scenarios
Predictive Analytics: Develop AI-driven defect prediction and root cause analysis tools to accelerate the QA lifecycle
Influence Strategy: Provide insights into engineering efficiency and tooling gaps to influence the development of cutting-edge solutions

What we offer

restricted stock units
bonus

Fulltime

Principal Software Engineer

The Principal Software Engineer is the senior-most hands-on technical leader for...

Location

India , Chennai

Salary:

Not provided

RX Global

Expiration Date

Until further notice

Requirements

Proven experience as a senior technical leader across multiple teams/services within a bounded domain
Strong polyglot background (e.g., C#/.NET, Java, JavaScript/Node) and ability to choose fit-for-purpose technologies
Experience modernising systems: migrating from legacy architectures to cloud-native patterns, reducing technical debt, and decommissioning safely
Experience in systems analysis, design and a solid understanding of development, quality assurance and integration methodologies
Experience developing integrated solutions within a broad technical and business context of significant impact
Experience evaluating third-party services and platforms (security, cost, operations, integration complexity)
Experience leading cross‑team architectural change, platform adoption, or measurable improvements to reliability/cost/performance (with before/after metrics)
Familiarity with responsible AI usage in engineering workflows (policy/guardrails, data privacy, human‑in‑the‑loop review)
Bachelor’s/Master’s degree in Computer Science (or related) or equivalent professional experience
Expert software design skills: SOLID, DDD, event-driven architecture patterns, modular design, and maintainable codebases

Job Responsibility

Engineering Leadership & Culture: Create an environment where teams can do their best work by removing blockers, improving engineering practices, and contributing to a culture of psychological safety and high standards
Mentor and coach engineers across teams—especially senior engineers and emerging tech leads—in architecture, systems thinking, and operational excellence
Promote strong technical ownership ("you build it, you run it"), including operational readiness and post-incident learning
Support scalable knowledge-sharing mechanisms (e.g., tech talks, playbooks, templates, reference implementations)
Participate in hiring loops and help onboard new engineers into domain patterns and practices
Provide hands-on contributions where needed (prototypes, reference implementations, complex refactors, high-risk changes)
Guide teams in decomposition and sequencing to reduce delivery risk
support estimation/sizing and technical discovery
Leads through influence
demonstrates integrity, accountability, and constructive challenge

What we offer

Comprehensive Health Insurance: Covers you, your immediate family, and parents
Enhanced Health Insurance Options: Competitive rates negotiated by the company
Group Life Insurance: Ensuring financial security for your loved ones
Group Accident Insurance: Extra protection for accidental death and permanent disablement
Flexible Working Arrangement: Achieve a harmonious work-life balance
Employee Assistance Program: Access support for personal and work-related challenges
Medical Screening: Your well-being is a top priority
Modern Family Benefits: Maternity, paternity, and adoption support
Long-Service Awards: Recognizing dedication and commitment
New Baby Gift: Celebrating the joy of parenthood

Fulltime

Select Country

Principal Product Manager - Observability & Evaluations

Job Description

Job Responsibility

Requirements

Looking for more opportunities?