Alternatives and similar repositories for dynabench:

Users that are interested in dynabench are comparing it to the libraries listed below

• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆18Updated 4 months ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆33Updated 3 years ago
• interview-eval / interview-eval
  Interview-based evaluation of LLMs
  ☆15Updated last month
• darrow-labs / LegalLens
  ☆8Updated 7 months ago
• epfl-dlab / GPTurk
  ☆29Updated last year
• srush / transformers-bet
  ☆12Updated 2 years ago
• microsoft / GRTr
  Generative Retrieval Transformer
  ☆28Updated last year
• castorini / LiT5
  ☆17Updated 6 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 3 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 3 weeks ago
• UKPLab / incorporating-relevance
  Code for "Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking" (https://arxiv.org/abs/2…
  ☆13Updated last year
• facebookresearch / concurrentqa
  This repo contains data and code for the paper "Reasoning over Public and Private Data in Retrieval-Based Systems."
  ☆47Updated 7 months ago
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆32Updated 8 months ago
• lucy3 / whos_filtered
  ☆14Updated 4 months ago
• likenneth / persona_drift
  Measuring and Controlling Persona Drift in Language Model Dialogs
  ☆16Updated 11 months ago
• MilaNLProc / language-invariant-properties
  ☆22Updated 2 years ago
• huggingface / model_card
  ☆30Updated 3 years ago
• Avmb / inverse_scaling_prize_code_identifier_swap
  Submission to the inverse scaling prize
  ☆23Updated last year
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆17Updated 2 years ago
• jaehunjung1 / cascaded-selective-evaluation
  ☆13Updated 6 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• trisongz / pylines
  Simplifying parsing of large jsonline files in NLP Workflows
  ☆12Updated 3 years ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆34Updated last year
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 2 years ago
• EleutherAI / best-download
  URL downloader supporting checkpointing and continuous checksumming.
  ☆19Updated last year
• epfml / Bi-Sent2Vec
  Robust Cross-lingual Embeddings from Parallel Sentences
  ☆21Updated 4 years ago
• facebookresearch / DataEfficientNLG
  NLG Best Practices for Data-Efficient Modeling How to Train Production-Ready Models with Little Data
  ☆10Updated 3 years ago
• facebookresearch / dynalab
  The Python library with command line tools to interact with Dynabench(https://dynabench.org/), such as uploading models.
  ☆55Updated 2 years ago