allenai / real-toxicity-promptsView external linksLinks
☆228Feb 23, 2021Updated 4 years ago
Alternatives and similar repositories for real-toxicity-prompts
Users that are interested in real-toxicity-prompts are comparing it to the libraries listed below
Sorting:
- This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…☆128Mar 1, 2024Updated last year
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆86Mar 2, 2021Updated 4 years ago
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆89Aug 20, 2021Updated 4 years ago
- [NeurIPS 2024 D&B] Evaluating Copyright Takedown Methods for Language Models☆17Jul 17, 2024Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆127Feb 24, 2025Updated 11 months ago
- code associated with ACL 2021 DExperts paper☆118May 24, 2023Updated 2 years ago
- TruthfulQA: Measuring How Models Imitate Human Falsehoods☆884Jan 16, 2025Updated last year
- Aligning AI With Shared Human Values (ICLR 2021)☆315Apr 21, 2023Updated 2 years ago
- This repo contains the code for generating the ToxiGen dataset, published at ACL 2022.☆346Jun 17, 2024Updated last year
- Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"☆10Dec 13, 2024Updated last year
- Repository for the Bias Benchmark for QA dataset.☆137Jan 8, 2024Updated 2 years ago
- LLM red teaming datasets from the paper 'Student-Teacher Prompting for Red Teaming to Improve Guardrails' for the ART of Safety Workshop …☆22Oct 12, 2023Updated 2 years ago
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆49Jan 15, 2026Updated last month
- ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.☆93May 9, 2024Updated last year
- ☆164Sep 2, 2024Updated last year
- Butler 是一个用于自动化服务管理和任务调度的工具项目。☆15Updated this week
- Data for evaluating gender bias in coreference resolution systems.☆80May 14, 2019Updated 6 years ago
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,815Jun 17, 2025Updated 8 months ago
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆314Jun 7, 2024Updated last year
- Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging. Arxiv, 2024.☆16Oct 28, 2024Updated last year
- GeDi: Generative Discriminator Guided Sequence Generation☆211Jun 16, 2025Updated 8 months ago
- ☆17Dec 21, 2023Updated 2 years ago
- A library for mechanistic anomaly detection☆22Jan 9, 2025Updated last year
- Perspective is an API that uses machine learning models to score the perceived impact a comment might have on a conversation. See https:/…☆926Mar 25, 2021Updated 4 years ago
- Official repo for NeurIPS'24 paper "WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models"☆18Dec 16, 2024Updated last year
- Using GPT-3 to detect hate speech that contains sexist and racist content☆24Nov 11, 2025Updated 3 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆191Apr 17, 2025Updated 10 months ago
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆158May 29, 2025Updated 8 months ago
- ☆59Aug 22, 2024Updated last year
- StereoSet: Measuring stereotypical bias in pretrained language models☆199Dec 8, 2022Updated 3 years ago
- Code repo of our paper Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (https://arxiv.org/abs/2406.10794…☆23Jul 26, 2024Updated last year
- ☆31Aug 9, 2024Updated last year
- A Comprehensive Assessment of Trustworthiness in GPT Models☆311Sep 16, 2024Updated last year
- ☆44Oct 1, 2024Updated last year
- ☆25Sep 5, 2024Updated last year
- 🌏 UI component library for the future, based on WebComponent.☆23Nov 12, 2024Updated last year
- ☆146Jul 23, 2025Updated 6 months ago
- ☆30Aug 2, 2024Updated last year
- Official Repository for Can Language Models be Instructed to Protect Personal Information?☆13Oct 8, 2023Updated 2 years ago