Alternatives and similar repositories for dynabench

Users that are interested in dynabench are comparing it to the libraries listed below

• leogao2 / lm_dataformat
  ☆78Updated 2 years ago
• stanfordnlp / ColBERT-QA
  Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)
  ☆40Updated 4 years ago
• google-deepmind / streamingqa
  ☆49Updated 2 years ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆34Updated 4 years ago
• salesforce / AuditNLG
  AuditNLG: Auditing Generative AI Language Modeling for Trustworthiness
  ☆103Updated last year
• liujch1998 / infini-gram
  ☆94Updated last week
• mega002 / lm-debugger
  The official code of LM-Debugger, an interactive tool for inspection and intervention in transformer-based language models.
  ☆181Updated 3 years ago
• EleutherAI / semantic-memorization
  ☆44Updated last year
• bigcode-project / bigcode-inference-benchmark
  ☆19Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• guy-dar / embedding-space
  ☆56Updated 2 years ago
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆49Updated 2 years ago
• CarperAI / CodeReviewSE
  Stuff related to scraping the Code Review StackExchange
  ☆12Updated 3 years ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆27Updated last year
• IBM / ensemble-instruct
  codebase release for EMNLP2023 paper publication
  ☆19Updated 4 months ago
• EleutherAI / openwebtext2
  ☆94Updated 3 years ago
• zphang / minimal-opt
  ☆67Updated 3 years ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated 2 years ago
• CarperAI / InstructGPT
  For experiments involving instruct gpt. Currently used for documenting open research questions.
  ☆71Updated 3 years ago
• benlipkin / probsem
  Probabilistic LLM evaluations. [CogSci2023; ACL2023]
  ☆73Updated last year
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 3 years ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆20Updated last year
• tomerwolgithub / question-decomposition-to-sql
  Weakly Supervised Text-to-SQL Parsing through Question Decomposition
  ☆23Updated 2 years ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated 2 years ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆49Updated 2 years ago
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆33Updated last year
• salesforce / simplification
  ☆23Updated last year
• hadasah / btm
  ☆77Updated last year
• huggingface / gaia
  Hugging Face and Pyserini interoperability
  ☆19Updated 2 years ago
• openfeedback / superhf
  Open-source Human Feedback Library
  ☆11Updated 2 years ago