Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs
☆142Dec 2, 2024Updated last year
Alternatives and similar repositories for wildguard
Users that are interested in wildguard are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An official codebase for "NormLens: Reading Books is Great, But Not if You Are Driving! Visually Grounded Reasoning about Defeasible Comm…☆10May 9, 2024Updated 2 years ago
- A simple evaluation of generative language models and safety classifiers.☆111Aug 31, 2026Updated 2 months ago
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆690Apr 4, 2025Updated last year
- Automated Safety Testing of Large Language Models☆17Jan 31, 2025Updated last year
- ☆160Aug 9, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal☆1,082Aug 16, 2024Updated 2 years ago
- This repository contains code for the paper "Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a…☆13Jun 11, 2022Updated 4 years ago
- [ICLR 2025] Code implementation of R^2-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoning☆24Jul 8, 2024Updated 2 years ago
- BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).☆185Oct 27, 2023Updated 3 years ago
- A fast + lightweight implementation of the GCG algorithm in PyTorch☆355May 13, 2025Updated last year
- ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors [EMNLP 2024 Findings]☆231Sep 29, 2024Updated 2 years ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆151Feb 24, 2025Updated last year
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆353Jun 7, 2024Updated 2 years ago
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆300Jul 28, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆184Jul 2, 2024Updated 2 years ago
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆200Apr 1, 2025Updated last year
- Repository for "StrongREJECT for Empty Jailbreaks" paper☆161Nov 3, 2024Updated 2 years ago
- Aioli: A unified optimization framework for language model data mixing☆34Jan 17, 2025Updated last year
- This repository contains data, code and models for contextual noncompliance.☆26Jul 18, 2024Updated 2 years ago
- ☆15Jun 2, 2026Updated 5 months ago
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆104Jul 2, 2026Updated 4 months ago
- ☆44Aug 10, 2024Updated 2 years ago
- [ACL24] Official Repo of Paper `ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMs`☆100Aug 15, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆168Nov 30, 2024Updated last year
- ☆206Nov 26, 2023Updated 2 years ago
- Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLM☆40Jan 17, 2025Updated last year
- [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion☆61Oct 1, 2025Updated last year
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆161Apr 15, 2024Updated 2 years ago
- ICLR 206☆14Aug 18, 2026Updated 2 months ago
- https://arxiv.org/abs/2102.12594☆14Oct 3, 2023Updated 3 years ago
- [ICML 2025] Official repository for paper "OR-Bench: An Over-Refusal Benchmark for Large Language Models"☆31Mar 4, 2025Updated last year
- ☆23Oct 25, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 【ACL 2024】 SALAD benchmark & MD-Judge☆176Mar 8, 2025Updated last year
- ☆30May 14, 2025Updated last year
- Towards Safe LLM with our simple-yet-highly-effective Intention Analysis Prompting☆22Mar 25, 2024Updated 2 years ago
- Does Refusal Training in LLMs Generalize to the Past Tense? [ICLR 2025]☆79Jan 23, 2025Updated last year
- Automatic Jailbreaking of the Text-to-Image Generative AI Systems☆15Jun 23, 2024Updated 2 years ago
- TAP: An automated jailbreaking method for black-box LLMs☆251Dec 10, 2024Updated last year
- ☆30Aug 12, 2026Updated 2 months ago