Alternatives and similar repositories for real-toxicity-prompts

Users that are interested in real-toxicity-prompts are comparing it to the libraries listed below

• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆79Updated 4 years ago
• nyu-mll / BBQ
  Repository for the Bias Benchmark for QA dataset.
  ☆127Updated last year
• nyu-mll / crows-pairs
  This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…
  ☆123Updated last year
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆376Updated 4 months ago
• openai / moderation-api-release
  ☆139Updated 3 years ago
• microsoft / TOXIGEN
  This repo contains the code for generating the ToxiGen dataset, published at ACL 2022.
  ☆330Updated last year
• AlexTMallen / adaptive-retrieval
  ☆185Updated last month
• RUCAIBox / HaluEval
  This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.
  ☆498Updated last year
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆202Updated 3 months ago
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆103Updated last year
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆137Updated last year
• swj0419 / detect-pretrain-code
  This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Aji…
  ☆230Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆162Updated last year
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆116Updated 2 years ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆56Updated 2 years ago
• tatsu-lab / opinions_qa
  ☆114Updated last year
• Libr-AI / do-not-answer
  Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs
  ☆281Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆96Updated 2 years ago
• realtimeqa / realtimeqa_public
  ☆77Updated last year
• jinlanfu / GPTScore
  Source Code of Paper "GPTScore: Evaluate as You Desire"
  ☆255Updated 2 years ago
• vr25 / hallucination-foundation-model-survey
  A Survey of Hallucination in Large Foundation Models
  ☆53Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆129Updated last year
• hendrycks / ethics
  Aligning AI With Shared Human Values (ICLR 2021)
  ☆297Updated 2 years ago
• nayeon7lee / FactualityPrompt
  ☆87Updated 2 years ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆223Updated 9 months ago
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆247Updated last year
• chaochun / nlu-asdiv-dataset
  ☆49Updated 2 years ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆181Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆81Updated last month