Alternatives and similar repositories for dynabench

Users that are interested in dynabench are comparing it to the libraries listed below

• liujch1998 / infini-gram
  ☆59Updated 3 weeks ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 6 months ago
• leogao2 / lm_dataformat
  ☆79Updated last year
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated last year
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆25Updated 8 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 8 months ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆39Updated 2 years ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• epfl-dlab / GPTurk
  ☆29Updated last year
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆46Updated 3 years ago
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆33Updated last year
• stanfordnlp / ColBERT-QA
  Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)
  ☆41Updated 4 years ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆43Updated last year
• salesforce / simplification
  ☆22Updated 6 months ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated 2 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆58Updated 2 years ago
• srush / transformers-bet
  ☆12Updated 3 years ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• EleutherAI / openwebtext2
  ☆90Updated 3 years ago
• openfeedback / superhf
  Open-source Human Feedback Library
  ☆11Updated last year
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆33Updated last year
• google-deepmind / streamingqa
  ☆48Updated last year
• samblouir / birdie
  ☆13Updated 2 months ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated last year
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 6 months ago
• lucy3 / whos_filtered
  ☆14Updated 10 months ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆27Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago