kernelmachine / demix
DEMix Layers for Modular Language Modeling
☆53Updated 3 years ago
Alternatives and similar repositories for demix:
Users that are interested in demix are comparing it to the libraries listed below
- ☆52Updated last year
- Benchmark API for Multidomain Language Modeling☆24Updated 2 years ago
- ☆22Updated 2 years ago
- ☆11Updated 7 months ago
- Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding☆18Updated 2 years ago
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆35Updated 2 years ago
- TBC☆26Updated 2 years ago
- The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".☆70Updated last year
- ☆58Updated 2 years ago
- ☆33Updated 3 years ago
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆74Updated last year
- Automatic metrics for GEM tasks☆63Updated 2 years ago
- Benchmarking Generalization to New Tasks from Natural Language Instructions☆26Updated 3 years ago
- ☆42Updated 11 months ago
- PyTorch reimplementation of REALM and ORQA☆22Updated 2 years ago
- ☆75Updated last year
- ☆35Updated 8 months ago
- [EMNLP 2022] Code and data for "Controllable Dialogue Simulation with In-Context Learning"☆34Updated last year
- Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"☆43Updated 2 years ago
- ReCross: Unsupervised Cross-Task Generalization via Retrieval Augmentation☆24Updated 2 years ago
- EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling☆31Updated 3 years ago
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆55Updated 2 years ago
- ☆42Updated 4 years ago
- Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"☆53Updated last year
- ☆22Updated last year
- Adding new tasks to T0 without catastrophic forgetting☆32Updated 2 years ago
- Staged Training for Transformer Language Models☆31Updated 2 years ago
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"☆56Updated 2 years ago
- Code for paper "CrossFit : A Few-shot Learning Challenge for Cross-task Generalization in NLP" (https://arxiv.org/abs/2104.08835)☆107Updated 2 years ago
- The official implemetation of "Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks" (NAACL 2022).☆43Updated 2 years ago