Alternatives and similar repositories for BBQ

Users that are interested in BBQ are comparing it to the libraries listed below

• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆80Updated 4 years ago
• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆137Updated 5 months ago
• i-gallegos / Fair-LLM-Benchmark
  ☆133Updated last year
• balevinstein / Probes
  ☆50Updated last year
• nyu-mll / crows-pairs
  This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…
  ☆119Updated last year
• tatsu-lab / opinions_qa
  ☆106Updated last year
• allenai / unqover
  UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)
  ☆22Updated 3 years ago
• rudinger / winogender-schemas
  Data for evaluating gender bias in coreference resolution systems.
  ☆76Updated 6 years ago
• ntunlp / LLMSanitize
  An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
  ☆57Updated 9 months ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• SALT-NLP / CultureBank
  ☆42Updated last year
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆200Updated 3 weeks ago
• RUCAIBox / Language-Specific-Neurons
  ☆75Updated 5 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• tingofurro / summac
  Codebase, data and models for the SummaC paper in TACL
  ☆94Updated 4 months ago
• IBM / activation-steering
  General-purpose activation steering library
  ☆75Updated 3 weeks ago
• realtimeqa / realtimeqa_public
  ☆75Updated last year
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆93Updated last year
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆24Updated 2 months ago
• d223302 / LLM-Evaluation
  Can Large Language Models Be an Alternative to Human Evaluations?
  ☆9Updated last year
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆155Updated last year
• myracheng / markedpersonas
  Code and data for Marked Personas (ACL 2023)
  ☆24Updated 2 years ago
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆68Updated 2 years ago
• AlexWan0 / rag-convincingness
  ☆27Updated last year
• princeton-nlp / MQuAKE
  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  ☆111Updated 8 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆76Updated last year
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆110Updated last year
• anthonywchen / RARR
  RARR: Researching and Revising What Language Models Say, Using Language Models
  ☆47Updated last year
• OpenMOSS / Language-Model-SAEs
  For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
  ☆116Updated this week
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆76Updated last year