Alternatives and similar repositories for dynabench

Users that are interested in dynabench are comparing it to the libraries listed below

• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• huggingface / model_card
  ☆30Updated 3 years ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• rajammanabrolu / Q-BERT
  Agents that build knowledge graphs and explore textual worlds by asking questions
  ☆79Updated 2 years ago
• darrow-labs / LegalLens
  ☆10Updated last year
• salesforce / TaiChi
  Open source library for few shot NLP
  ☆79Updated 2 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆58Updated 2 years ago
• matwerner / fast-wmd
  ☆16Updated 2 years ago
• stanfordnlp / ColBERT-QA
  Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)
  ☆41Updated 4 years ago
• nyu-mll / pretraining-learning-curves
  The repository for the paper "When Do You Need Billions of Words of Pretraining Data?"
  ☆21Updated 4 years ago
• huggingface / adversarialnlp
  A generic library for crafting adversarial NLP examples - WIP
  ☆41Updated 6 years ago
• liujch1998 / infini-gram
  ☆63Updated 3 weeks ago
• mlcommons / dynabench
  ☆24Updated last week
• facebookresearch / text_characterization_toolkit
  A library for computing diverse text characteristics and using them to analyze data sets and models with ease.
  ☆40Updated 3 years ago
• orevaahia / magnet-tokenization
  ☆13Updated 8 months ago
• asyml / stave
  An extensible framework for building visualization and annotation tools to enable better interaction with NLP and Artificial Intelligence…
  ☆49Updated 2 years ago
• Kaleidophon / token2index
  A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and …
  ☆51Updated 8 months ago
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆33Updated last year
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆47Updated 3 years ago
• spyysalo / wiki-bert-pipeline
  Generate BERT vocabularies and pretraining examples from Wikipedias
  ☆17Updated 5 years ago
• EleutherAI / semantic-memorization
  ☆44Updated 9 months ago
• cimeister / typical-sampling
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
  ☆81Updated 3 years ago
• twitter-research / lmsoc
  Code for reproducing our paper: LMSOC: An Approach for Socially Sensitive Pretraining
  ☆13Updated 3 years ago
• epfl-dlab / GPTurk
  ☆29Updated 2 years ago
• allenai / c4-documentation
  ☆28Updated 4 years ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated last year
• microsoft / GRTr
  Generative Retrieval Transformer
  ☆28Updated 2 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• lucy3 / whos_filtered
  ☆14Updated 11 months ago
• srush / transformers-bet
  ☆12Updated 3 years ago