babylm / evaluation-pipeline-2023
Evaluation pipeline for the BabyLM Challenge 2023.
☆72Updated last year
Related projects ⓘ
Alternatives and complementary repositories for evaluation-pipeline-2023
- ☆73Updated last year
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆55Updated 2 years ago
- ☆71Updated 6 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆19Updated 8 months ago
- DEMix Layers for Modular Language Modeling☆53Updated 3 years ago
- ☆11Updated 5 months ago
- Code for Zero-Shot Tokenizer Transfer☆117Updated last month
- ☆95Updated last year
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆70Updated 8 months ago
- ☆46Updated last week
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆92Updated last year
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 2 years ago
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆136Updated last year
- A Multilingual Replicable Instruction-Following Model☆94Updated last year
- Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22☆64Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆44Updated last year
- The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".☆32Updated 3 years ago
- The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".☆68Updated 10 months ago
- Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding☆18Updated 2 years ago
- Efficient Transformers with Dynamic Token Pooling☆55Updated last year
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆127Updated 6 months ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆56Updated 5 months ago
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆35Updated last year
- ☆93Updated last year
- ☆38Updated 7 months ago
- ☆67Updated 2 years ago
- The original Backpack Language Model implementation, a fork of FlashAttention☆64Updated last year
- A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.☆70Updated 3 months ago
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"☆56Updated last year