Smerity / pytorch-lambLinks
Implementation of https://arxiv.org/abs/1904.00962
☆15Updated 5 years ago
Alternatives and similar repositories for pytorch-lamb
Users that are interested in pytorch-lamb are comparing it to the libraries listed below
Sorting:
- ☆64Updated 5 years ago
- This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …☆55Updated 4 years ago
- Training Transformer-XL on 128 GPUs☆140Updated 5 years ago
- Code repo for "Transformer on a Diet" paper☆31Updated 5 years ago
- A 🤗-style implementation of BERT using lambda layers instead of self-attention☆69Updated 4 years ago
- A supplementary code for Beyond Vector Spaces: Compact Data Representation as Differentiable Weighted Graphs.☆47Updated 5 years ago
- PyTorch code for meta seq2seq learning☆43Updated 5 years ago
- ☆14Updated 6 years ago
- Code for Multi-Head Attention: Collaborate Instead of Concatenate☆152Updated 2 years ago
- Factorization of the neural parameter space for zero-shot multi-lingual and multi-task transfer☆39Updated 4 years ago
- PyTorch implementation of the NIPS'17 paper Training Deep Networks without Learning Rates Through Coin Betting.☆37Updated 7 years ago
- LM Pretraining with PyTorch/TPU☆135Updated 5 years ago
- Cascaded Text Generation with Markov Transformers☆129Updated 2 years ago
- An assignment on creating a minimalist neural network toolkit for CS11-747☆64Updated last year
- Pip-installable differentiable stacks in PyTorch!☆65Updated 4 years ago
- LAnguage Modelling Benchmarks☆138Updated 5 years ago
- Boolean Question Answering with multi-task learning and uses large LM embeddings like BERT, RoBERTa☆18Updated 5 years ago
- Checking the interpretability of attention on text classification models☆49Updated 6 years ago
- A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.☆85Updated 2 years ago
- ☆24Updated 3 months ago
- ☆41Updated 4 years ago
- ☆61Updated 2 years ago
- learning to search in pytorch☆110Updated 5 years ago
- This is a repository with the code for the EMNLP 2020 paper "Information-Theoretic Probing with Minimum Description Length"☆71Updated 11 months ago
- An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain☆34Updated 4 years ago
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines☆136Updated last year
- ☆24Updated 5 years ago
- Pre-training of Language Models for Language Understanding☆83Updated 5 years ago
- Open source implementation of SeaRNN (ICLR 2018, https://openreview.net/forum?id=HkUR_y-RZ)☆48Updated 7 years ago
- ☆62Updated 3 years ago