Alternatives and similar repositories for real-toxicity-prompts

Users that are interested in real-toxicity-prompts are comparing it to the libraries listed below

• microsoft / TOXIGEN
  This repo contains the code for generating the ToxiGen dataset, published at ACL 2022.
  ☆345Updated last year
• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆85Updated 4 years ago
• nyu-mll / BBQ
  Repository for the Bias Benchmark for QA dataset.
  ☆134Updated 2 years ago
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆414Updated 9 months ago
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆204Updated this week
• mkshing / Prompt-Tuning
  Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"
  ☆167Updated 4 years ago
• nyu-mll / crows-pairs
  This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…
  ☆127Updated last year
• realtimeqa / realtimeqa_public
  ☆83Updated last week
• RUCAIBox / HaluEval
  This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.
  ☆549Updated last year
• openai / moderation-api-release
  ☆153Updated 3 years ago
• jinlanfu / GPTScore
  Source Code of Paper "GPTScore: Evaluate as You Desire"
  ☆259Updated 2 years ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆98Updated 2 years ago
• glgh / awesome-llm-human-preference-datasets
  A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
  ☆387Updated 2 years ago
• anthropics / ConstitutionalHarmlessnessPaper
  ☆250Updated 3 years ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆183Updated 3 years ago
• nayeon7lee / FactualityPrompt
  ☆88Updated 3 years ago
• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆153Updated 5 months ago
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆108Updated last year
• swj0419 / detect-pretrain-code
  This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Aji…
  ☆236Updated 2 years ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆148Updated last year
• Libr-AI / do-not-answer
  Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs
  ☆306Updated last year
• AlexTMallen / adaptive-retrieval
  ☆188Updated 6 months ago
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆374Updated 2 years ago
• tatsu-lab / opinions_qa
  ☆116Updated last year
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆63Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆82Updated last week
• orhonovich / unnatural-instructions
  ☆180Updated 2 years ago
• asahi417 / lmppl
  Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …
  ☆165Updated 7 months ago
• AI21Labs / in-context-ralm
  ☆295Updated 2 years ago
• shizhediao / active-prompt
  Source code for the paper "Active Prompting with Chain-of-Thought for Large Language Models"
  ☆248Updated last year