jack57lee / Diversify-MHALinks
EMNLP 2018: Multi-Head Attention with Disagreement Regularization; NAACL 2019: Information Aggregation for Multi-Head Attention with Routing-by-Agreement
☆21Updated 5 years ago
Alternatives and similar repositories for Diversify-MHA
Users that are interested in Diversify-MHA are comparing it to the libraries listed below
Sorting:
- ☆84Updated 6 years ago
- Code for "Understanding and Improving Layer Normalization"☆46Updated 6 years ago
- Efficient Neural Interaction Functions Search for Collaborative Filtering☆18Updated 5 years ago
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆128Updated 4 years ago
- 基于Transformer的单模型、多尺度的VAE模型☆58Updated 4 years ago
- Source code for "Efficient Training of BERT by Progressively Stacking"☆113Updated 6 years ago
- A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"☆73Updated 3 years ago
- Leveraging Local and Global Patterns for Self-Attention Networks☆12Updated 6 years ago
- ☆50Updated 2 years ago
- PyTorch implementation of the paper "Hyperbolic Interaction Model For Hierarchical Multi-Label Classification"☆49Updated 6 years ago
- A dual learning toolkit developed by Microsoft Research☆73Updated 2 years ago
- Reproduce the results of paper "Compressing Word Embeddings via Deep Compositional Code Learning" accepted ICLR 2018☆24Updated 7 years ago
- The implementation of multi-branch attentive Transformer (MAT).☆33Updated 5 years ago
- Implementation of SetRank in SIGIR 2020☆50Updated 5 years ago
- ☆64Updated 5 years ago
- ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation☆70Updated 5 years ago
- Sampled Softmax Implementation for PyTorch☆44Updated 7 years ago
- Label Embedding Network☆92Updated 7 years ago
- The code of Encoding Word Order in Complex-valued Embedding☆42Updated 6 years ago
- Repository for ACL 2019 paper☆74Updated 6 years ago
- Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"☆147Updated 6 years ago
- Code for ACL'19 "Few-Shot Representation Learning for Out-Of-Vocabulary Words"☆55Updated 5 years ago
- Code for the article "Automatic Temperature Control for Neural Machine Translation" (EMNLP 2018)☆14Updated 6 years ago
- A Toolkit for Training, Tracking, Saving Models and Syncing Results☆62Updated 5 years ago
- This repo provides the code for the ACL 2020 paper "Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEnco…☆57Updated 5 years ago
- PyTorch implementation for the paper Classification from Positive, Unlabeled and Biased Negative Data.☆19Updated 2 years ago
- ☆94Updated 5 years ago
- Implementation of Densely Connected Attention Propagation for Reading Comprehension (NIPS 2018)☆69Updated 6 years ago
- Code for ACL2020 "Jointly Masked Sequence-to-Sequence Model for Non-Autoregressive Neural Machine Translation"☆39Updated 5 years ago
- Distilling BERT using natural language generation.☆39Updated 2 years ago