Auditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.
☆160Nov 10, 2026Updated this week
Alternatives and similar repositories for awesome-auditable-ai
Users that are interested in awesome-auditable-ai are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Audit any agent decision across its past, present, and future, on one typed graph.☆31Oct 26, 2026Updated 2 weeks ago
- CatchBench: a benchmark for auditing agent failures across the full lifecycle.☆12Oct 26, 2026Updated 2 weeks ago
- [NeurIPS 2026] AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems☆26Updated this week
- Load public agent-trajectory datasets and agent traces into one ATIF-based run record☆32Updated this week
- SafeSearch: a reinforcement learning framework that jointly optimizes safety and utility in LLM-based search agents.☆16Nov 4, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The official implementation of the paper "AgentLAB: Benchmarking LLM Agents against Long-Horizon Attacks"☆52Jun 1, 2026Updated 5 months ago
- ☆10Oct 7, 2026Updated last month
- Configurable inference harness for long-horizon agentic search: 6 agent families, 5 context-management strategies, page memory, 3 multi-a…☆11May 27, 2026Updated 5 months ago
- ☆11Jan 10, 2025Updated last year
- Sierra decompiler and analyzer☆13Apr 22, 2025Updated last year
- Official code for the paper: "Multi-User Large Language Model Agents"☆38Updated this week
- The Bloomberg Terminal for Prediction Markets☆14Oct 25, 2026Updated 2 weeks ago
- [FSE'26] Agent-centric Debugging Interface (ADI)☆19Jun 3, 2026Updated 5 months ago
- ☆51May 29, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official Repo of Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agents☆102Jun 2, 2026Updated 5 months ago
- Official Repo for the paper "SecPO: Principled Adversarial Training for Prompt Injection Security"☆14Updated this week
- Static security scanner for LLM agents — prompt injection, MCP config auditing, taint analysis. 51 rules mapped to OWASP Agentic Top 10 (…☆245Sep 13, 2026Updated last month
- A local inspector for your agents, with a native macOS app☆20Oct 31, 2026Updated last week
- Code for the paper "Emergent Collusion in Long-Horizon LLM Agent Interaction"☆19Sep 24, 2026Updated last month
- OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents [NeurIPS 2025 Spotlight]☆78Sep 18, 2025Updated last year
- CITETRACER: Cascading Multi-Agent for Citation Hallucination Detection☆14Oct 26, 2026Updated 2 weeks ago
- ☆15Jan 30, 2026Updated 9 months ago
- Code for ACL 2025 accepted paper titled "MPO: Multilingual Safety Alignment via Reward Gap Optimization"☆12Jun 5, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official Implementation of "ToolSafe: Enhancing Tool Invocation Safety of LLM-based Agents via Proactive Step-level Guardrail and Feedbac…☆86Nov 5, 2026Updated last week
- SafePyramid: A Hierarchical Benchmark for In-context Policy Guardrailing☆15Sep 23, 2026Updated last month
- Codebase for Distillation Robustifies Unlearning☆11Jun 11, 2025Updated last year
- LLM Safeguarding with Internal Representations☆23Apr 27, 2026Updated 6 months ago
- [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"☆256Oct 23, 2026Updated 2 weeks ago
- AgenTracer: A Lightweight Failure Attributor for Agentic Systems☆112Aug 27, 2026Updated 2 months ago
- ☆14Jan 4, 2025Updated last year
- ☆44Oct 11, 2026Updated last month
- [ICML 2026] Official implementation for paper "Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Ag…☆40Jul 31, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆16Dec 10, 2024Updated last year
- Introduce a continuous intermediate representation between "masks" and "tokens" for dLLM☆15Dec 1, 2025Updated 11 months ago
- ☆39Jun 13, 2026Updated 4 months ago
- ☆168Aug 11, 2025Updated last year
- Official repo for SteeringSafety☆11Oct 16, 2025Updated last year
- [COLM 2025] JailDAM: Jailbreak Detection with Adaptive Memory for Vision-Language Model☆27Nov 25, 2025Updated 11 months ago
- BackdoorAgent is a stage-aware framework and benchmark that instruments LLM-agent workflows (planning, memory, tools) to systematically i…☆51Mar 16, 2026Updated 7 months ago
Are these results useful?