Alternatives and similar repositories for dynabench

Users that are interested in dynabench are comparing it to the libraries listed below

• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆33Updated last year
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆25Updated 6 months ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 4 months ago
• salesforce / simplification
  ☆22Updated 4 months ago
• UKPLab / eacl2024-lagonn
  Source code and data for Like a Good Nearest Neighbor
  ☆29Updated 4 months ago
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆33Updated 11 months ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• EleutherAI / semantic-memorization
  ☆44Updated 6 months ago
• r-three / common-pile
  Code for collecting, processing, and preparing datasets for the Common Pile
  ☆27Updated this week
• liujch1998 / infini-gram
  ☆49Updated 2 weeks ago
• IBM / ensemble-instruct
  codebase release for EMNLP2023 paper publication
  ☆19Updated last month
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆46Updated last year
• MurtyShikhar / LanguagePatching
  Code for our EMNLP '22 paper "Fixing Model Bugs with Natural Language Patches"
  ☆19Updated 2 years ago
• leogao2 / lm_dataformat
  ☆78Updated last year
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• arXiv / zzzArchived_arxiv-fulltext
  arXiv plain text extraction
  ☆41Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• LauraRuis / do-pigs-fly
  ☆19Updated last year
• ariecattan / SciCo
  Code for the paper SciCo: Hierarchical Cross-Document Coreference for Scientific Concepts (AKBC 2021). https://openreview.net/forum?id=OF…
  ☆29Updated 3 years ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆27Updated last year
• allenai / dream
  ☆24Updated 9 months ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• benpry / chain-of-thought-metaphor
  This repo contains code for the paper "Psychologically-informed chain-of-thought prompts for metaphor understanding in large language mod…
  ☆14Updated 2 years ago
• cicl-iscl / CyberWallE-propaganda-detection
  Code for "CyberWallE at SemEval-2020 Task 11: An Analysis of Feature Engineering for Ensemble Models for Propaganda Detection" (V. Blasch…
  ☆9Updated 4 years ago
• UniversalNER / UniversalNER
  ☆27Updated 3 months ago
• huggingface / gaia
  Hugging Face and Pyserini interoperability
  ☆20Updated 2 years ago
• stephantul / unitoken
  Tokenization across languages. Useful as preprocessing for subword tokenization.
  ☆22Updated 2 years ago
• bigscience-workshop / metadata
  Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.
  ☆31Updated last year