Alternatives and similar repositories for benchbench

Users that are interested in benchbench are comparing it to the libraries listed below

• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆43Updated 6 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆95Updated 3 weeks ago
• allenai / bff
  ☆38Updated last year
• tatsu-lab / opinions_qa
  ☆106Updated last year
• RulinShao / massive-serve
  Python package for serving a local search engine. One command to download and serve a datastore---that's it 😎.
  ☆21Updated 3 weeks ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆133Updated 5 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 4 months ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆84Updated 10 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆130Updated last year
• lovodkin93 / attribute-first-then-generate
  Repository for "Attribute First, then Generate: Locally-attributable Grounded Text Generation", ACL 2024
  ☆29Updated 6 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆43Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated last month
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 3 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 9 months ago
• jaehunjung1 / cascaded-selective-evaluation
  ☆24Updated 4 months ago
• marzenakrp / nocha
  ☆51Updated 8 months ago
• ryokamoi / llm-self-correction-papers
  List of papers on Self-Correction of LLMs.
  ☆73Updated 6 months ago
• XiangLi1999 / AutoBencher
  ☆29Updated 11 months ago
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆37Updated 10 months ago
• mungg / FABLES
  ☆57Updated 9 months ago
• cambridgeltl / composable-sft
  A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.
  ☆73Updated 10 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆78Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆81Updated last year
• kaistAI / InstructIR
  IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…
  ☆32Updated last year
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆58Updated last year
• Tiiiger / benchmark_llm_summarization
  ☆39Updated 2 years ago
• kaistAI / factual-knowledge-acquisition
  ☆19Updated last month
• cambridgeltl / PairS
  Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
  ☆47Updated 5 months ago