cambridgeltl / composable-sft
A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.
☆71Updated 6 months ago
Alternatives and similar repositories for composable-sft:
Users that are interested in composable-sft are comparing it to the libraries listed below
- Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"☆30Updated 2 years ago
- ☆55Updated 2 years ago
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆70Updated 11 months ago
- EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling☆31Updated 3 years ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆40Updated last year
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 2 years ago
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆55Updated 2 years ago
- ☆33Updated 3 years ago
- ☆28Updated last year
- This repositary hosts my experiments for the project, I did with OffNote Labs.☆11Updated 3 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- ☆29Updated 7 months ago
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆26Updated 3 years ago
- ☆24Updated 2 years ago
- ☆65Updated last year
- Benchmark API for Multidomain Language Modeling☆24Updated 2 years ago
- Apps built using Inspired Cognition's Critique.☆58Updated last year
- ☆45Updated last year
- DEMix Layers for Modular Language Modeling☆53Updated 3 years ago
- Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)☆62Updated 2 years ago
- Code for paper "CrossFit : A Few-shot Learning Challenge for Cross-task Generalization in NLP" (https://arxiv.org/abs/2104.08835)☆109Updated 2 years ago
- ☆44Updated last year
- PyTorch reimplementation of REALM and ORQA☆22Updated 3 years ago
- Automatic metrics for GEM tasks☆64Updated 2 years ago
- ☆58Updated 2 years ago
- Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"☆47Updated 2 years ago
- ☆44Updated last year
- ☆96Updated 2 years ago
- Measuring the Mixing of Contextual Information in the Transformer☆28Updated last year
- Code and datasets for the EMNLP 2020 paper "Calibration of Pre-trained Transformers"☆57Updated last year