yzh119 / BPTLinks
Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"
☆128Updated 4 years ago
Alternatives and similar repositories for BPT
Users that are interested in BPT are comparing it to the libraries listed below
Sorting:
- Source code for "Efficient Training of BERT by Progressively Stacking"☆113Updated 6 years ago
- Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"☆148Updated 6 years ago
- Code for ACL2020 "Jointly Masked Sequence-to-Sequence Model for Non-Autoregressive Neural Machine Translation"☆39Updated 5 years ago
- ☆83Updated 5 years ago
- Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…☆252Updated 3 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 4 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆172Updated 5 years ago
- A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.☆85Updated 2 years ago
- ☆219Updated 5 years ago
- DisCo Transformer for Non-autoregressive MT☆77Updated 3 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆118Updated 4 years ago
- A dual learning toolkit developed by Microsoft Research☆71Updated 2 years ago
- Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"☆89Updated 4 years ago
- Implementation of the paper Tree Transformer☆214Updated 5 years ago
- ☆97Updated 5 years ago
- Checking the interpretability of attention on text classification models☆49Updated 6 years ago
- ☆119Updated 6 years ago
- Cascaded Text Generation with Markov Transformers☆129Updated 2 years ago
- Neutron: A pytorch based implementation of Transformer and its variants.☆64Updated 2 years ago
- Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.☆54Updated 2 years ago
- Unicoder model for understanding and generation.☆91Updated last year
- Non-Monotonic Sequential Text Generation (ICML 2019)☆72Updated 6 years ago
- a Pytorch implementation of the Reformer Network (https://openreview.net/pdf?id=rkgNKkHtvB)☆53Updated 2 years ago
- ☆94Updated 5 years ago
- The implementation of multi-branch attentive Transformer (MAT).☆33Updated 5 years ago
- Non-autoregressive Neural Machine Translation (not a full version)☆71Updated 2 years ago
- Visualization for simple attention and Google's multi-head attention.☆68Updated 7 years ago
- Source code to reproduce the results in the ACL 2019 paper "Syntactically Supervised Transformers for Faster Neural Machine Translation"☆81Updated 2 years ago
- ☆32Updated 3 years ago
- Re-implement "QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension"☆120Updated 6 years ago