Alternatives and similar repositories for dynabench

Users that are interested in dynabench are comparing it to the libraries listed below

• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆27Updated last year
• stanfordnlp / ColBERT-QA
  Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)
  ☆40Updated 4 years ago
• leogao2 / lm_dataformat
  ☆78Updated 2 years ago
• EleutherAI / semantic-memorization
  ☆44Updated last year
• liujch1998 / infini-gram
  ☆96Updated 2 weeks ago
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆35Updated last year
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated 2 years ago
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated last year
• mega002 / lm-debugger
  The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.
  ☆182Updated 3 years ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆20Updated last year
• EleutherAI / openwebtext2
  ☆94Updated 3 years ago
• CarperAI / InstructGPT
  For experiments involving instruct gpt. Currently used for documenting open research questions.
  ☆71Updated 3 years ago
• salesforce / AuditNLG
  AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
  ☆103Updated last year
• google-deepmind / streamingqa
  ☆49Updated 2 years ago
• facebookresearch / dynabench
  Dynamic Adversarial Benchmarking platform
  ☆26Updated 3 years ago
• MurtyShikhar / LanguagePatching
  Code for our EMNLP '22 paper "Fixing Model Bugs with Natural Language Patches"
  ☆19Updated 3 years ago
• ekinakyurek / google-research
  Google Research
  ☆46Updated 3 years ago
• tomerwolgithub / question-decomposition-to-sql
  Weakly Supervised Text-to-SQL Parsing through Question Decomposition
  ☆23Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆49Updated 2 years ago
• huggingface / disaggregators
  🤗 Disaggregators: Curated data labelers for in-depth analysis.
  ☆67Updated 3 years ago
• huggingface / gaia
  Hugging Face and Pyserini interoperability
  ☆19Updated 2 years ago
• CarperAI / CodeReviewSE
  Stuff related to scraping the Code Review StackExchange
  ☆12Updated 3 years ago
• salesforce / simplification
  ☆23Updated last year
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆48Updated 2 years ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated 2 years ago
• guy-dar / embedding-space
  ☆57Updated 2 years ago
• huggingface / that_is_good_data
  ☆65Updated 2 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 3 years ago