Alternatives and similar repositories for real-toxicity-prompts:

Users that are interested in real-toxicity-prompts are comparing it to the libraries listed below

• openai / moderation-api-release
  ☆122Updated 2 years ago
• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆71Updated 3 years ago
• microsoft / TOXIGEN
  This repo contains the code for generating the ToxiGen dataset, published at ACL 2022.
  ☆297Updated 8 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆90Updated 11 months ago
• realtimeqa / realtimeqa_public
  ☆71Updated last year
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆121Updated 11 months ago
• nyu-mll / crows-pairs
  This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…
  ☆111Updated 11 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆112Updated last year
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆57Updated last year
• nyu-mll / BBQ
  Repository for the Bias Benchmark for QA dataset.
  ☆101Updated last year
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆157Updated 9 months ago
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆196Updated 2 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆125Updated 11 months ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆179Updated 2 years ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆102Updated last year
• AlexTMallen / adaptive-retrieval
  ☆174Updated 2 years ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆84Updated last week
• PKU-Alignment / beavertails
  BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).
  ☆122Updated last year
• manyoso / haltt4llm
  This project is an attempt to create a common metric to test LLM's for progress in eliminating hallucinations which is the most serious c…
  ☆222Updated last year
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆75Updated 3 months ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated 3 weeks ago
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• jinlanfu / GPTScore
  Source Code of Paper "GPTScore: Evaluate as You Desire"
  ☆238Updated 2 years ago
• GXimingLu / Quark
  ☆75Updated last year
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆321Updated 9 months ago
• orhonovich / instruction-induction
  ☆64Updated 2 years ago
• OSU-NLP-Group / AttrScore
  Code, datasets, models for the paper "Automatic Evaluation of Attribution by Large Language Models"
  ☆54Updated last year
• bhargaviparanjape / language-programmes
  ☆172Updated last year
• mkshing / Prompt-Tuning
  Implementation of "The Power of Scale for Parameter-Efficient Prompt Tuning"
  ☆164Updated 3 years ago