openai / moderation-api-release
☆129Updated 2 years ago
Alternatives and similar repositories for moderation-api-release:
Users that are interested in moderation-api-release are comparing it to the libraries listed below
- Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs☆74Updated 4 months ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆95Updated 2 months ago
- ☆206Updated 4 years ago
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆88Updated this week
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆97Updated last year
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆108Updated last year
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆62Updated last year
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆68Updated last year
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆111Updated last year
- A Comprehensive Assessment of Trustworthiness in GPT Models☆284Updated 7 months ago
- Inspecting and Editing Knowledge Representations in Language Models☆116Updated last year
- Improving Alignment and Robustness with Circuit Breakers☆197Updated 7 months ago
- ☆54Updated 2 years ago
- A simple evaluation of generative language models and safety classifiers.☆54Updated 8 months ago
- ☆44Updated 7 months ago
- Weak-to-Strong Jailbreaking on Large Language Models☆73Updated last year
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆80Updated 4 years ago
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆74Updated last year
- ☆42Updated last year
- This repo contains the code for generating the ToxiGen dataset, published at ACL 2022.☆311Updated 10 months ago
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆141Updated last year
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆110Updated last year
- SILO Language Models code repository☆81Updated last year
- ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.☆80Updated 11 months ago
- ☆55Updated 2 months ago
- Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"☆56Updated last year
- ☆73Updated last year
- ☆93Updated 11 months ago
- ☆106Updated 11 months ago