Starred repositories
Public CVE list maintained by Microsoft Security's Frontier Offensive Research & Generative Exploitation (FORGE) Lab.
Medusa's Memory Heist Card Game - learn about AI Safety through a video game
Requirement-driven evaluation harness for AI agents and LLM applications. Generate behavior-specific test cases, run them against any target (hosted models, callable wrappers, OTel-traced agents), …
Open detection-rule standard for AI agent security threats — like Sigma, but for AI agents. Executable, testable rules for prompt injection, tool poisoning, context exfiltration and MCP attacks. Me…
Collection of evals for Inspect AI
Inspect: A framework for large language model evaluations
Repository for "StrongREJECT for Empty Jailbreaks" paper
Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts
A database migrations tool for SQLAlchemy.
A pytest-native safety and security testing framework for agentic AI applications
Repository for "Structured Visual Narratives Undermine Safety Alignment in Multimodal Large Language Models"
A tool that validates academic paper references
An extremely fast Python type checker and language server, written in Rust.
This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs at https://learn.microsoft.com/python/azure/ or our v…
[ICLR'26 Oral] RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments
Benchmarking LLM agents on Cyber Threat Investigation.
Simple Prompt Injection Kit for Evaluation and Exploitation
Recursively scan a Python module and export numpydoc docstrings to JSON
Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs