Smerity / pytorch-lambLinks
Implementation of https://arxiv.org/abs/1904.00962
☆15Updated 6 years ago
Alternatives and similar repositories for pytorch-lamb
Users that are interested in pytorch-lamb are comparing it to the libraries listed below
Sorting:
- This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …☆55Updated 4 years ago
- ☆64Updated 5 years ago
- A supplementary code for Beyond Vector Spaces: Compact Data Representation as Differentiable Weighted Graphs.☆47Updated 6 years ago
- Training Transformer-XL on 128 GPUs☆141Updated 5 years ago
- LM Pretraining with PyTorch/TPU☆136Updated 6 years ago
- A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.☆86Updated 2 years ago
- Code for Multi-Head Attention: Collaborate Instead of Concatenate☆151Updated 2 years ago
- A 🤗-style implementation of BERT using lambda layers instead of self-attention☆69Updated 5 years ago
- Code repo for "Transformer on a Diet" paper☆31Updated 5 years ago
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 5 years ago
- PyTorch code for meta seq2seq learning☆43Updated 5 years ago
- Transformers without Tears: Improving the Normalization of Self-Attention☆133Updated last year
- a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)☆53Updated 2 years ago
- Boolean Question Answering with multi-task learning and uses large LM embeddings like BERT, RoBERTa☆18Updated 6 years ago
- Cascaded Text Generation with Markov Transformers☆129Updated 2 years ago
- LAnguage Modelling Benchmarks☆138Updated 5 years ago
- ☆12Updated 6 years ago
- ☆40Updated 4 years ago
- Code for the paper "Latent Relation Language Models" at AAAI-20.☆41Updated last month
- Pip-installable differentiable stacks in PyTorch!☆65Updated 5 years ago
- This is a repository with the code for the EMNLP 2020 paper "Information-Theoretic Probing with Minimum Description Length"☆71Updated last year
- Checking the interpretability of attention on text classification models☆49Updated 6 years ago
- Code for EMNLP 2019 paper "Attention is not not Explanation"☆58Updated 4 years ago
- [ACL 2018] Conditional Generators of Words Definitions☆33Updated 7 years ago
- ☆14Updated 6 years ago
- The implementation of "Neural Machine Translation without Embeddings", NAACL 2021☆33Updated 4 years ago
- ☆48Updated 5 years ago
- Code for bidirectional sequence generation (BiSon) for generating from BERT pre-trained models.☆51Updated 5 years ago
- The bAbI question-answering dataset ported into T2T.☆32Updated 6 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆147Updated 4 years ago