IDSIA / lmtool-fwpLinks
PyTorch Language Modeling Toolkit for Fast Weight Programmers
☆19Updated 8 months ago
Alternatives and similar repositories for lmtool-fwp
Users that are interested in lmtool-fwp are comparing it to the libraries listed below
Sorting:
- The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…☆67Updated 3 years ago
- The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".☆34Updated 8 months ago
- ☆40Updated 4 years ago
- ☆22Updated 3 years ago
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Updated 3 years ago
- ☆22Updated 4 years ago
- Implementation of the GBST block from the Charformer paper, in Pytorch☆118Updated 4 years ago
- Evaluation pipeline for the BabyLM Challenge 2023.☆77Updated 2 years ago
- LTG-Bert☆34Updated 2 years ago
- Code of NAACL 2022 "Efficient Hierarchical Domain Adaptation for Pretrained Language Models" paper.☆32Updated 2 years ago
- ☆16Updated last year
- Suite of 500 procedurally-generated NLP tasks to study language model adaptability☆21Updated 3 years ago
- ☆44Updated 5 years ago
- ☆29Updated 4 years ago
- ☆38Updated 4 years ago
- Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning☆33Updated last year
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- Rationales for Sequential Predictions☆40Updated 3 years ago
- ☆67Updated 3 years ago
- ☆30Updated 3 years ago
- Standalone pre-training recipe with JAX+Flax☆35Updated 2 years ago
- ☆46Updated 3 years ago
- [EMNLP 2021] Code and data for our paper "Visually Grounded Reasoning across Languages and Cultures"☆30Updated 4 years ago
- Implementation of the paper 'Sentence Bottleneck Autoencoders from Transformer Language Models'☆17Updated 3 years ago
- A variant of Transformer-XL where the memory is updated not with a queue, but with attention☆49Updated 5 years ago
- Code for Massive-scale Decoding for Text Generation using Lattices☆44Updated 3 years ago
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 3 years ago
- [NeurIPS 2020] Official Implementation: "SMYRF: Efficient Attention using Asymmetric Clustering".☆50Updated 2 years ago
- Implementation for "Rational Recurrences", Peng et al., EMNLP 2018.☆28Updated 3 years ago
- Implementation of Marge, Pre-training via Paraphrasing, in Pytorch☆76Updated 5 years ago