jack57lee / Diversify-MHALinks
EMNLP 2018: Multi-Head Attention with Disagreement Regularization; NAACL 2019: Information Aggregation for Multi-Head Attention with Routing-by-Agreement
☆21Updated 4 years ago
Alternatives and similar repositories for Diversify-MHA
Users that are interested in Diversify-MHA are comparing it to the libraries listed below
Sorting:
- Code for "Understanding and Improving Layer Normalization"☆46Updated 5 years ago
- ☆83Updated 5 years ago
- Efficient Neural Interaction Functions Search for Collaborative Filtering☆18Updated 5 years ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆63Updated 2 years ago
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆128Updated 4 years ago
- Source code for "Efficient Training of BERT by Progressively Stacking"☆113Updated 6 years ago
- Implementation of SetRank in SIGIR 2020☆50Updated 5 years ago
- Reproduce the results of paper "Compressing Word Embeddings via Deep Compositional Code Learning" accepted ICLR 2018☆24Updated 7 years ago
- The implementation of multi-branch attentive Transformer (MAT).☆33Updated 5 years ago
- 基于Transformer的单模型、多尺度的VAE模型☆57Updated 4 years ago
- A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"☆73Updated 2 years ago
- PyTorch implementation for the paper Classification from Positive, Unlabeled and Biased Negative Data.☆19Updated last year
- Sampled Softmax Implementation for PyTorch☆44Updated 7 years ago
- ☆50Updated 2 years ago
- Visualization for simple attention and Google's multi-head attention.☆68Updated 7 years ago
- Code for ACL'19 "Few-Shot Representation Learning for Out-Of-Vocabulary Words"☆55Updated 5 years ago
- A dual learning toolkit developed by Microsoft Research☆71Updated 2 years ago
- A Toolkit for Training, Tracking, Saving Models and Syncing Results☆62Updated 5 years ago
- Leveraging Local and Global Patterns for Self-Attention Networks☆12Updated 6 years ago
- Curriculum Learning related papers and materials☆54Updated 4 years ago
- Code for paper "Continual and Multi-Task Architecture Search (ACL 2019)"☆41Updated 6 years ago
- The implementation of Meta-LSTM in "Meta Multi-Task Learning for Sequence Modeling." AAAI-18☆33Updated 7 years ago
- PyTorch implementation of the paper "Hyperbolic Interaction Model For Hierarchical Multi-Label Classification"☆47Updated 5 years ago
- Code for EMNLP 2020 paper CoDIR☆41Updated 2 years ago
- Code and dataset for "Transfer Learning Between Related Tasks Using Expected Label Proportions"☆16Updated 5 years ago
- Discrete Optimization for Unsupervised Sentence Summarization with Word-Level Extraction☆20Updated 3 years ago
- Partial Codes and datasets for NeurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"☆19Updated 5 years ago
- Unsupervised Learning of Transferable Relational Graphs☆69Updated 6 years ago
- ☆94Updated 5 years ago
- Code for the article "Automatic Temperature Control for Neural Machine Translation" (EMNLP 2018)☆14Updated 6 years ago