Alternatives and similar repositories for BBQ

Users that are interested in BBQ are comparing it to the libraries listed below

• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆80Updated 4 years ago
• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆136Updated 4 months ago
• nyu-mll / crows-pairs
  This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…
  ☆118Updated last year
• i-gallegos / Fair-LLM-Benchmark
  ☆132Updated last year
• allenai / unqover
  UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)
  ☆22Updated 3 years ago
• balevinstein / Probes
  ☆50Updated last year
• tatsu-lab / opinions_qa
  ☆106Updated last year
• AlexWan0 / rag-convincingness
  ☆27Updated last year
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆77Updated 6 years ago
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆93Updated 3 months ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• princeton-nlp / MABEL
  EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975
  ☆37Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆72Updated 2 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆80Updated 2 months ago
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆22Updated 2 months ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆96Updated 2 months ago
• SALT-NLP / chain-of-thought-bias
  ☆26Updated 7 months ago
• myracheng / markedpersonas
  Code and data for Marked Personas (ACL 2023)
  ☆24Updated last year
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆68Updated 2 years ago
• s-nlp / paradetox
  Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"
  ☆30Updated last month
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆57Updated 5 months ago
• tsor13 / kaleido
  ☆22Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆73Updated last year
• IBM / activation-steering
  General-purpose activation steering library
  ☆66Updated last week
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆82Updated last year
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• genglinliu / UnknownBench
  Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge
  ☆13Updated last year
• lifan-yuan / OOD_NLP
  [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…
  ☆33Updated last year
• d223302 / LLM-Evaluation
  Can Large Language Models Be an Alternative to Human Evaluations?
  ☆9Updated last year