google-deepmind / lambLinks
LAnguage Modelling Benchmarks
☆137Updated 5 years ago
Alternatives and similar repositories for lamb
Users that are interested in lamb are comparing it to the libraries listed below
Sorting:
- ☆218Updated 4 years ago
- Implementation of Universal Transformer in Pytorch☆260Updated 6 years ago
- An LSTM in PyTorch with best practices (weight dropout, forget bias, etc.) built-in. Fully compatible with PyTorch LSTM.☆133Updated 5 years ago
- Latent Alignment and Variational Attention☆327Updated 6 years ago
- Pytorch implementation of R-Transformer. Some parts of the code are adapted from the implementation of TCN and Transformer.☆230Updated 5 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆158Updated 5 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆95Updated 5 years ago
- Cascaded Text Generation with Markov Transformers☆129Updated 2 years ago
- A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.☆85Updated last year
- Source code for the NAACL 2019 paper "SEQ^3: Differentiable Sequence-to-Sequence-to-Sequence Autoencoder for Unsupervised Abstractive Sen…☆124Updated 2 years ago
- ☆83Updated 5 years ago
- Encoding position with the word embeddings.☆83Updated 7 years ago
- Checking the interpretability of attention on text classification models☆48Updated 5 years ago
- Fork of huggingface/pytorch-pretrained-BERT for BERT on STILTs☆107Updated 2 years ago
- Code for Multi-Head Attention: Collaborate Instead of Concatenate☆151Updated last year
- Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)☆226Updated 4 years ago
- PyTorch implementations of LSTM Variants (Dropout + Layer Norm)☆136Updated 4 years ago
- ☆176Updated 4 years ago
- Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning☆311Updated 4 years ago
- Tensorflow Implementation of Variational Attention for Sequence to Sequence Models (COLING 2018)☆70Updated 4 years ago
- Multiple Different Natural Language Processing Tasks in a Single Deep Model☆48Updated 6 years ago
- Bayesian Deep Active Learning for Natural Language Processing Tasks☆147Updated 6 years ago
- The Annotated Encoder Decoder with Attention☆166Updated 4 years ago
- NeurIPS 2019 - Learning Data Manipulation for Augmentation and Weighting☆109Updated 4 years ago
- An implementation of DeepMind's Relational Recurrent Neural Networks (NeurIPS 2018) in PyTorch.☆245Updated 6 years ago
- Two-Layer Hierarchical Softmax Implementation for PyTorch☆69Updated 4 years ago
- ☆47Updated 6 years ago
- PyTorch implementation of latent space reinforcement learning for E2E dialog published at NAACL 2019. It is released by Tiancheng Zhao (…☆144Updated 5 years ago
- Minimal RNN classifier with self-attention in Pytorch☆150Updated 3 years ago
- A smoother activation function (undergrad code)☆110Updated 4 years ago