Alternatives and similar repositories for walledeval

Users that are interested in walledeval are comparing it to the libraries listed below

• allenai / wildguard
  Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs
  ☆76Updated 5 months ago
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆100Updated last year
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆115Updated 5 months ago
• thunlp / Advbench
  Code and data of the EMNLP 2022 paper "Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversaria…
  ☆50Updated 2 years ago
• XuandongZhao / weak-to-strong
  [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models
  ☆74Updated 2 weeks ago
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆82Updated last year
• ThuCCSLab / JailbreakEval
  [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.
  ☆156Updated last month
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆97Updated 2 months ago
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆203Updated 7 months ago
• centerforaisafety / wmdp
  WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…
  ☆119Updated last year
• dsbowen / strong_reject
  ☆60Updated this week
• uiuc-kang-lab / InjecAgent
  ☆62Updated 10 months ago
• Aatrox103 / SAP
  ☆45Updated last year
• declare-lab / ferret
  Ferret: Faster and Effective Automated Red Teaming with Reward-Based Scoring Technique
  ☆15Updated 8 months ago
• AI-secure / DecodingTrust
  A Comprehensive Assessment of Trustworthiness in GPT Models
  ☆290Updated 8 months ago
• DAMO-NLP-SG / multilingual-safety-for-LLMs
  [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
  ☆73Updated last year
• andyzoujm / breaking-llama-guard
  Code to break Llama Guard
  ☆31Updated last year
• niconi19 / LLM-Conversation-Safety
  [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey
  ☆95Updated 9 months ago
• uw-nsl / SafeDecoding
  Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  ☆130Updated 9 months ago
• azshue / AutoPoison
  The official repository of the paper "On the Exploitability of Instruction Tuning".
  ☆62Updated last year
• Yu-Fangxu / COLD-Attack
  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
  ☆152Updated 5 months ago
• Babelscape / ALERT
  Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"
  ☆41Updated 7 months ago
• AlignmentResearch / gpt-4-novel-apis-attacks
  ☆20Updated last year
• allenai / wildteaming
  ☆25Updated 9 months ago
• microsoft / BIPIA
  A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
  ☆66Updated last year
• AIM-Intelligence / Automated-Multi-Turn-Jailbreaks
  ☆62Updated 5 months ago
• IBM / activation-steering
  General-purpose activation steering library
  ☆68Updated last week
• Libr-AI / do-not-answer
  Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs
  ☆244Updated 11 months ago
• FSoft-AI4Code / CodeMMLU
  [ICLR 2025] 🚀 CodeMMLU Evaluator: A framework for evaluating LM models on CodeMMLU MCQs benchmark.
  ☆23Updated 3 weeks ago
• OSU-NLP-Group / AmpleGCG
  AmpleGCG: Learning a Universal and Transferable Generator of Adversarial Attacks on Both Open and Closed LLM
  ☆62Updated 6 months ago