ServiceNow / DoomArenaLinks
DoomArena is a Framework for Testing AI Agents Against Evolving Security Threats
☆51Updated 4 months ago
Alternatives and similar repositories for DoomArena
Users that are interested in DoomArena are comparing it to the libraries listed below
Sorting:
- ☆190Updated last month
- OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents [NeurIPS 2025 Spotlight]☆46Updated 4 months ago
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆79Updated 5 months ago
- ☆50Updated last year
- Collection of evals for Inspect AI☆357Updated this week
- ☆65Updated this week
- ☆34Updated 11 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆425Updated this week
- Improving Alignment and Robustness with Circuit Breakers☆258Updated last year
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆66Updated 7 months ago
- ☆144Updated 6 months ago
- ☆40Updated last year
- Code to break Llama Guard☆32Updated 2 years ago
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆184Updated last year
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆116Updated last year
- A data construction and evaluation framework to quantify privacy norm awareness of language models (LMs) and emerging privacy risk of LM …☆41Updated 11 months ago
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆124Updated last year
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆150Updated last week
- ☆133Updated 3 months ago
- Dataset for the Tensor Trust project☆47Updated last year
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆102Updated 2 years ago
- ☆217Updated last week
- ☆257Updated 3 weeks ago
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆70Updated last year
- Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]☆43Updated last year
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆157Updated 8 months ago
- Codebase for Obfuscated Activations Bypass LLM Latent-Space Defenses☆27Updated 11 months ago
- [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents☆64Updated 2 months ago
- A Comprehensive Assessment of Trustworthiness in GPT Models☆311Updated last year
- Python package for measuring memorization in LLMs.☆182Updated 6 months ago