Alternatives and similar repositories for BBQ

Users that are interested in BBQ are comparing it to the libraries listed below

• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆80Updated 4 years ago
• nyu-mll / crows-pairs
  This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…
  ☆124Updated last year
• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆147Updated last month
• tatsu-lab / opinions_qa
  ☆115Updated last year
• allenai / real-toxicity-prompts
  ☆220Updated 4 years ago
• i-gallegos / Fair-LLM-Benchmark
  ☆150Updated 2 years ago
• genglinliu / UnknownBench
  Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge
  ☆14Updated last year
• balevinstein / Probes
  ☆56Updated 2 years ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆115Updated 7 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆96Updated 2 years ago
• allenai / unqover
  UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)
  ☆21Updated 4 years ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• shmsw25 / FActScore
  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…
  ☆385Updated 5 months ago
• realtimeqa / realtimeqa_public
  ☆78Updated last year
• SALT-NLP / chain-of-thought-bias
  ☆28Updated last year
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆70Updated 2 years ago
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆97Updated 2 years ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• AlexTMallen / adaptive-retrieval
  ☆189Updated 3 months ago
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆25Updated 6 months ago
• RUCAIBox / Language-Specific-Neurons
  ☆84Updated 9 months ago
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆105Updated last year
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆62Updated 2 years ago
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆150Updated 3 weeks ago
• vr25 / hallucination-foundation-model-survey
  A Survey of Hallucination in Large Foundation Models
  ☆54Updated last year
• joeljang / knowledge-unlearning
  [ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models
  ☆82Updated last year
• AlexWan0 / rag-convincingness
  ☆27Updated last year
• nayeon7lee / FactualityPrompt
  ☆86Updated 2 years ago
• princeton-nlp / MQuAKE
  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  ☆116Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆80Updated 6 months ago