Alternatives and similar repositories for evaluation-pipeline-2024:

Users that are interested in evaluation-pipeline-2024 are comparing it to the libraries listed below

• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆65Updated 2 years ago
• lukemelas / mtob
  ☆31Updated 9 months ago
• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆75Updated last year
• peterwestuw / surface-form-competition
  ☆58Updated 2 years ago
• cpllab / syntactic-generalization
  Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"
  ☆26Updated 3 years ago
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• keyonvafa / sequential-rationales
  Rationales for Sequential Predictions
  ☆40Updated 3 years ago
• peterbhase / LAS-NL-Explanations
  Code for paper "Leakage-Adjusted Simulatability: Can Models Generate Non-Trivial Explanations of Their Behavior in Natural Language?"
  ☆21Updated 4 years ago
• google-deepmind / streamingqa
  ☆45Updated last year
• mt-upc / transformer-contributions
  Measuring the Mixing of Contextual Information in the Transformer
  ☆28Updated last year
• yanaiela / amnesic_probing
  ☆39Updated 3 years ago
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆57Updated 9 months ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• machelreid / m2d2
  M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
  ☆55Updated 2 years ago
• kernelmachine / demix-data
  Benchmark API for Multidomain Language Modeling
  ☆24Updated 2 years ago
• ekinakyurek / lexical
  Paper: Lexicon Learning for Few-Shot Neural Sequence Modeling
  ☆16Updated 3 years ago
• jzbjyb / lm-calibration
  ☆34Updated 3 years ago
• najoungkim / COGS
  ☆59Updated 2 years ago
• krishnap25 / mauve-experiments
  ☆37Updated 10 months ago
• belindal / state-probes
  Code for the paper "Implicit Representations of Meaning in Neural Language Models"
  ☆53Updated 2 years ago
• allenai / tailor
  ☆31Updated last year
• hsajjad / Interpretability-Tutorial-NAACL2021
  ☆24Updated 3 years ago
• tommccoy1 / embers-of-autoregression
  ☆27Updated 2 months ago
• deep-spin / hallucinations-in-nmt
  ☆19Updated last year
• lil-lab / bandit-qa
  Code for the paper "Simulating Bandit Learning from User Feedback for Extractive Question Answering".
  ☆18Updated 2 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• mohsenfayyaz / GlobEnc
  [NAACL 2022] GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers
  ☆21Updated last year
• shauli-ravfogel / nullspace_projection
  ☆89Updated 2 years ago
• tanyuqian / ctc-gen-eval
  EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation
  ☆96Updated 2 years ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆90Updated 3 years ago