google-deepmind / lamb
LAnguage Modelling Benchmarks
☆137Updated 4 years ago
Alternatives and similar repositories for lamb:
Users that are interested in lamb are comparing it to the libraries listed below
- Pytorch implementation of R-Transformer. Some parts of the code are adapted from the implementation of TCN and Transformer.☆226Updated 5 years ago
- A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.☆86Updated last year
- An LSTM in PyTorch with best practices (weight dropout, forget bias, etc.) built-in. Fully compatible with PyTorch LSTM.☆132Updated 5 years ago
- ☆213Updated 4 years ago
- Cascaded Text Generation with Markov Transformers☆129Updated last year
- Minimal RNN classifier with self-attention in Pytorch☆150Updated 3 years ago
- Code for Multi-Head Attention: Collaborate Instead of Concatenate☆152Updated last year
- Implementation of the "Poincare Glove: Hyperbolic word embeddings" paper☆85Updated 4 years ago
- Checking the interpretability of attention on text classification models☆47Updated 5 years ago
- Code for NIPS 2018 paper 'Frequency-Agnostic Word Representation'☆117Updated 5 years ago
- ☆83Updated 5 years ago
- ☆47Updated 5 years ago
- Implementation of Universal Transformer in Pytorch☆258Updated 6 years ago
- Latent Alignment and Variational Attention☆326Updated 6 years ago
- Two-Layer Hierarchical Softmax Implementation for PyTorch☆69Updated 4 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆93Updated 5 years ago
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆126Updated 3 years ago
- Non-Monotonic Sequential Text Generation (ICML 2019)☆72Updated 5 years ago
- Bayesian Deep Active Learning for Natural Language Processing Tasks☆147Updated 6 years ago
- PyTorch DataLoader for seq2seq☆84Updated 5 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆106Updated 2 years ago
- PyTorch implementations of LSTM Variants (Dropout + Layer Norm)☆136Updated 3 years ago
- Tensorflow Implementation of Variational Attention for Sequence to Sequence Models (COLING 2018)☆69Updated 4 years ago
- Sparse and structured neural attention mechanisms☆222Updated 4 years ago
- DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding☆26Updated 6 years ago
- Neural Module Network for Reasoning over Text, ICLR 2020☆121Updated 4 years ago
- ☆119Updated 5 years ago
- Generative Flow based Sequence-to-Sequence Toolkit written in Python.☆243Updated 5 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆158Updated 5 years ago
- ☆96Updated 4 years ago