Alternatives and similar repositories for dynabench

Users that are interested in dynabench are comparing it to the libraries listed below

• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆21Updated 2 years ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• huggingface / model_card
  ☆30Updated 4 years ago
• lucy3 / whos_filtered
  ☆14Updated last year
• srush / transformers-bet
  ☆12Updated 3 years ago
• rajammanabrolu / Q-BERT
  Agents that build knowledge graphs and explore textual worlds by asking questions
  ☆79Updated 2 years ago
• nyu-mll / pretraining-learning-curves
  The repository for the paper "When Do You Need Billions of Words of Pretraining Data?"
  ☆21Updated 5 years ago
• modal-labs / stopwatch
  A tool for benchmarking LLMs on Modal
  ☆45Updated 5 months ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated 2 years ago
• epfl-dlab / GPTurk
  ☆29Updated 2 years ago
• facebookresearch / text_characterization_toolkit
  A library for computing diverse text characteristics and using them to analyze data sets and models with ease.
  ☆41Updated 3 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 3 years ago
• allenai / c4-documentation
  ☆32Updated 4 years ago
• microsoft / GRTr
  Generative Retrieval Transformer
  ☆29Updated 2 years ago
• EleutherAI / openwebtext2
  ☆93Updated 3 years ago
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆49Updated 3 years ago
• huggingface / adversarialnlp
  A generic library for crafting adversarial NLP examples - WIP
  ☆41Updated 7 years ago
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆35Updated last year
• machelreid / editpro
  Learning to Model Editing Processes
  ☆26Updated 5 months ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆35Updated 2 years ago
• asyml / stave
  An extensible framework for building visualization and annotation tools to enable better interaction with NLP and Artificial Intelligence…
  ☆49Updated 2 years ago
• mlcommons / dynabench
  ☆27Updated last month
• Kaleidophon / token2index
  A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …
  ☆51Updated last year
• stanfordnlp / ColBERT-QA
  Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)
  ☆40Updated 4 years ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆26Updated last year
• leogao2 / lm_dataformat
  ☆78Updated 2 years ago
• liujch1998 / infini-gram
  ☆94Updated this week
• google-research-datasets / Disfl-QA
  A Benchmark Dataset for Understanding Disfluencies in Question Answering
  ☆64Updated 4 years ago
• nlp-uoregon / famie
  FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction
  ☆24Updated 3 years ago