Alternatives and similar repositories for drbench

Users that are interested in drbench are comparing it to the libraries listed below

• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆199Updated 6 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• jaketae / ensemble-transformers
  Ensembling Hugging Face transformers made easy
  ☆61Updated 2 years ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆162Updated 2 weeks ago
• McGill-NLP / instruct-qa
  Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"
  ☆86Updated last year
• amazon-science / mintaka
  Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)
  ☆117Updated 3 years ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆189Updated 5 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆136Updated last year
• guy-dar / embedding-space
  ☆56Updated 2 years ago
• jsrozner / decrypt
  Repository for paper Decrypting Cryptic Crosswords
  ☆10Updated 3 years ago
• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆218Updated last year
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆53Updated 4 months ago
• facebookresearch / ResponsibleNLP
  Repository for research in the field of Responsible NLP at Meta.
  ☆204Updated 7 months ago
• google-research / t5x_retrieval
  ☆101Updated 3 years ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆298Updated 6 months ago
• google-research-datasets / Attributed-QA
  We believe the ability of an LLM to attribute the text that it generates is likely to be crucial for both system developers and users in …
  ☆54Updated 2 years ago
• ZihanWangKi / GoalEx
  Implementation of the Paper "Goal-Driven Explainable Clustering via Language Descriptions"
  ☆40Updated 2 years ago
• sayakpaul / count-tokens-hf-datasets
  This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…
  ☆27Updated 3 years ago
• MoritzLaurer / zeroshot-classifier
  Notebooks for training universal 0-shot classifiers on many different tasks
  ☆137Updated 11 months ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆46Updated 9 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆96Updated 2 years ago
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆99Updated 2 years ago
• unicamp-dl / ExaRanker
  ☆29Updated last year
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆105Updated 2 years ago
• g8a9 / ferret
  A python package for benchmarking interpretability techniques on Transformers.
  ☆214Updated last year
• SALT-NLP / demonstrated-feedback
  ☆129Updated last year
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆29Updated 6 months ago
• neulab / ragged
  Retrieval Augmented Generation Generalized Evaluation Dataset
  ☆59Updated 5 months ago
• kayoyin / interpret-lm
  Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)
  ☆62Updated 3 years ago