Alternatives and similar repositories for BBQ

Users that are interested in BBQ are comparing it to the libraries listed below

• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆79Updated 4 years ago
• nyu-mll / crows-pairs
  This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…
  ☆123Updated last year
• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆145Updated last week
• i-gallegos / Fair-LLM-Benchmark
  ☆144Updated last year
• tatsu-lab / opinions_qa
  ☆112Updated last year
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆373Updated 4 months ago
• balevinstein / Probes
  ☆54Updated 2 years ago
• AlexTMallen / adaptive-retrieval
  ☆184Updated last month
• realtimeqa / realtimeqa_public
  ☆77Updated last year
• allenai / real-toxicity-prompts
  ☆216Updated 4 years ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• SALT-NLP / CultureBank
  ☆45Updated last year
• allenai / unqover
  UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)
  ☆22Updated 4 years ago
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆202Updated 3 months ago
• tsor13 / kaleido
  ☆22Updated last year
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆25Updated 5 months ago
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆98Updated 6 months ago
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆80Updated 6 years ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆96Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆81Updated last month
• genglinliu / UnknownBench
  Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge
  ☆14Updated last year
• Yixiao-Song / VeriScore
  ☆29Updated 8 months ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆174Updated last year
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆110Updated 6 months ago
• vr25 / hallucination-foundation-model-survey
  A Survey of Hallucination in Large Foundation Models
  ☆54Updated last year
• RUCAIBox / Language-Specific-Neurons
  ☆81Updated 8 months ago
• RUCAIBox / HaluEval
  This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.
  ☆497Updated last year
• myracheng / markedpersonas
  Code and data for Marked Personas (ACL 2023)
  ☆28Updated 2 years ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆116Updated 2 years ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆42Updated last year