IDSIA / lmtool-fwp
PyTorch Language Modeling Toolkit for Fast Weight Programmers
☆16Updated last year
Related projects: ⓘ
- The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".☆32Updated 2 years ago
- Implementation of https://arxiv.org/abs/1904.00962☆15Updated 5 years ago
- Few-shot Learning with Auxiliary Data☆26Updated 9 months ago
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Updated last year
- Pretraining summarization models using a corpus of nonsense☆13Updated 2 years ago
- Datasets for compositional learning☆12Updated 5 years ago
- Exploring Few-Shot Adaptation of Language Models with Tables☆23Updated 2 years ago
- ☆13Updated this week
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆50Updated 2 years ago
- ☆21Updated 3 years ago
- What are the best Systems? New Perspectives on NLP Benchmarking☆13Updated last year
- The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…☆66Updated last year
- ☆13Updated 3 years ago
- Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch☆45Updated 3 years ago
- Standalone pre-training recipe with JAX+Flax☆31Updated last year
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆58Updated 2 years ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆14Updated 3 years ago
- Humans understand novel sentences by composing meanings and roles of core language components. In contrast, neural network models for nat…☆27Updated 4 years ago
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 2 years ago
- Code for the paper "Modelling Latent Translations for Cross-Lingual Transfer"☆17Updated 2 years ago
- This repo contains code to reproduce some of the results presented in the paper "SentenceMIM: A Latent Variable Language Model"☆28Updated 2 years ago
- ☆30Updated 8 months ago
- Adding new tasks to T0 without catastrophic forgetting☆30Updated last year
- Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch☆23Updated 3 years ago
- Code for "Rissanen Data Analysis: Examining Dataset Characteristics via Description Length" by Ethan Perez, Douwe Kiela, and Kyungyhun Ch…☆35Updated 3 years ago
- PyTorch code for the EMNLP 2020 paper "Embedding Words in Non-Vector Space with Unsupervised Graph Learning"☆40Updated 3 years ago
- ☆11Updated 2 years ago
- ☆42Updated 3 years ago
- Suite of 500 procedurally-generated NLP tasks to study language model adaptability☆21Updated 2 years ago
- The InterScript dataset contains interactive user feedback on scripts generated by a T5-XXL model.☆11Updated 2 years ago