zhuohan123 / macaron-netLinks
Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"
☆148Updated 6 years ago
Alternatives and similar repositories for macaron-net
Users that are interested in macaron-net are comparing it to the libraries listed below
Sorting:
- Source code for "Efficient Training of BERT by Progressively Stacking"☆113Updated 6 years ago
- Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"☆89Updated 4 years ago
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆128Updated 4 years ago
- Cascaded Text Generation with Markov Transformers☆129Updated 2 years ago
- A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.☆85Updated 2 years ago
- ☆119Updated 6 years ago
- Generative Flow based Sequence-to-Sequence Toolkit written in Python.☆245Updated 5 years ago
- Code for "Understanding and Improving Layer Normalization"☆46Updated 5 years ago
- Implementation of Stochastic Beam Search using Fairseq☆105Updated 6 years ago
- Adaptive Softmax implementation for PyTorch☆81Updated 6 years ago
- Implementation of Universal Transformer in Pytorch☆261Updated 6 years ago
- Variational Transformers for Diverse Response Generation☆81Updated last year
- ☆10Updated 5 years ago
- A dual learning toolkit developed by Microsoft Research☆71Updated 2 years ago
- Non-autoregressive Neural Machine Translation (not a full version)☆71Updated 2 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆172Updated 5 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆22Updated 2 years ago
- DisCo Transformer for Non-autoregressive MT☆77Updated 3 years ago
- Code for "A Multi-Task Approach for Disentangling Syntax and Semantics in Sentence Representations" (NAACL 2019)☆67Updated 4 years ago
- This code repository presents the pytorch implementation of the paper “Implicit Deep Latent Variable Models for Text Generation”(EMNLP 20…☆55Updated 3 years ago
- Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…☆251Updated 3 years ago
- PyTorch Implementation of "Non-Autoregressive Neural Machine Translation"☆271Updated 3 years ago
- Language Model Baselines for PyTorch☆41Updated 5 years ago
- LaNMT: Latent-variable Non-autoregressive Neural Machine Translation with Deterministic Inference☆80Updated 3 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 4 years ago
- ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation☆25Updated 4 years ago
- ☆219Updated 5 years ago
- ☆32Updated 3 years ago
- Code for Multi-Head Attention: Collaborate Instead of Concatenate☆151Updated 2 years ago
- Implementation of Dual Learning NMT on PyTorch☆163Updated 7 years ago