Senior Software Engineer, Tooling

Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world. The Microsoft AI Red Team is an interdisciplinary group of security experts, adversarial ML researchers, and software engineers with the mission of proactively identifying failures in Microsoft’s AI systems before they impact customers. Within the AI Red Team, our Tooling group builds platforms and developer experiences that enable teams across Microsoft to evaluate AI-powered systems at scale. Our team is the home of PyRIT (https://github.com/Azure/PyRIT ), an open-source framework used for AI risk identification and evaluation. We are expanding this space by building a new platform that enables product teams to run system-level evaluations of agentic applications and model-enabled experiences inside normal engineering workflows. We are looking for a Senior Software Engineer to help build this new system-level evaluation platform for agentic applications and model-enabled experiences. These systems increasingly involve multi-step reasoning, tool and API use, multimodal inputs, and memory. In this role, you will lead architecture and technical direction, drive key design decisions, and deliver a platform that integrates into engineering workflows and pipelines to test and measure a broad set of risks and harms.