akurniawan / pytorch-transformerLinks
Implementation of "Attention is All You Need" paper
☆33Updated last year
Alternatives and similar repositories for pytorch-transformer
Users that are interested in pytorch-transformer are comparing it to the libraries listed below
Sorting:
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆62Updated 6 years ago
- Adaptive Softmax implementation for PyTorch☆81Updated 6 years ago
- A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.☆86Updated 2 years ago
- Sequence to Sequence Models in PyTorch☆44Updated last year
- Encoding position with the word embeddings.☆84Updated 7 years ago
- ☆47Updated 6 years ago
- PyTorch DataLoader for seq2seq☆85Updated 6 years ago
- PyTorch Language Model for 1-Billion Word (LM1B / GBW) Dataset☆123Updated 6 years ago
- ☆53Updated 5 years ago
- a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)☆53Updated 3 years ago
- Quasi-RNN for language modeling☆57Updated 8 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆95Updated 5 years ago
- Adaptive embedding and softmax☆17Updated 3 years ago
- Code for ACL 2019 oral paper - Learning Compressed Sentence Representations for On-Device Text Processing.☆44Updated 5 years ago
- MT Tutorial for the JSALT 2019 Summer School☆48Updated 6 years ago
- Implementation of the retriever distillation procedure as outlined in the paper "Distilling Knowledge from Reader to Retriever"☆32Updated 4 years ago
- ☆42Updated 7 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆159Updated 6 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 6 years ago
- Reference Implementation for WSDM 2018 Paper "Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering"☆68Updated 7 years ago
- Unsupervised neural machine translation; weight sharing; GAN☆94Updated 7 years ago
- Python package for understanding the difficulty of text classification datasets. (in CoNNL 2018)☆64Updated 4 years ago
- Two-Layer Hierarchical Softmax Implementation for PyTorch☆70Updated 4 years ago
- CapsNet for NLP☆66Updated 6 years ago
- PyTorch implementation of Transformer-based Neural Machine Translation☆78Updated 2 years ago
- Re-implementation of Bi-Directional Block Self-Attention for Fast and Memory-Efficient Sequence Modeling (T. Shen et al., ICLR 2018) on P…☆42Updated 7 years ago
- A pytorch implementation of "Latent Variable Dialogue Models and their Diversity"☆18Updated 8 years ago
- GPU-accelerated PyTorch implementation of Zero-shot User Intent Detection via Capsule Neural Networks☆16Updated 6 years ago
- Re-implement "QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension"☆120Updated 7 years ago
- Transformer-XL with checkpoint loader☆68Updated 3 years ago