Alternatives and similar repositories for evaluation-pipeline-2024

Users that are interested in evaluation-pipeline-2024 are comparing it to the libraries listed below

• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆76Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆94Updated 3 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆70Updated last year
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆66Updated 2 years ago
• kernelmachine / demix-data
  Benchmark API for Multidomain Language Modeling
  ☆25Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• yanaiela / pararel
  ☆45Updated last year
• lukemelas / mtob
  ☆37Updated last year
• qkaren / COLD_decoding
  ☆108Updated 3 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• machelreid / m2d2
  M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
  ☆54Updated 2 years ago
• EleutherAI / knowledge-neurons
  A library for finding knowledge neurons in pretrained transformer models.
  ☆158Updated 3 years ago
• McGill-NLP / polytropon
  ☆54Updated 2 years ago
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• INK-USC / CrossFit
  Code for paper "CrossFit : A Few-shot Learning Challenge for Cross-task Generalization in NLP" (https://arxiv.org/abs/2104.08835)
  ☆112Updated 3 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆77Updated 2 years ago
• jkallini / mission-impossible-language-models
  Code repository for the paper "Mission: Impossible Language Models."
  ☆52Updated 3 months ago
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆58Updated last year
• nouhadziri / faith-and-fate
  ☆34Updated last year
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• belindal / state-probes
  Code for the paper "Implicit Representations of Meaning in Neural Language Models"
  ☆54Updated 2 years ago
• tommccoy1 / embers-of-autoregression
  ☆29Updated 7 months ago
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆78Updated last year
• najoungkim / COGS
  ☆61Updated 2 years ago
• nicola-decao / KnowledgeEditor
  Code for Editing Factual Knowledge in Language Models
  ☆139Updated 3 years ago
• timoschick / self-debiasing
  This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".
  ☆88Updated 3 years ago
• hsajjad / Interpretability-Tutorial-NAACL2021
  ☆24Updated 4 years ago
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆42Updated 2 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago