jack57lee / Diversify-MHALinks
EMNLP 2018: Multi-Head Attention with Disagreement Regularization; NAACL 2019: Information Aggregation for Multi-Head Attention with Routing-by-Agreement
☆21Updated 5 years ago
Alternatives and similar repositories for Diversify-MHA
Users that are interested in Diversify-MHA are comparing it to the libraries listed below
Sorting:
- Code for "Understanding and Improving Layer Normalization"☆46Updated 5 years ago
- Leveraging Local and Global Patterns for Self-Attention Networks☆12Updated 6 years ago
- ☆84Updated 6 years ago
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆128Updated 4 years ago
- Visualization for simple attention and Google's multi-head attention.☆68Updated 7 years ago
- Efficient Neural Interaction Functions Search for Collaborative Filtering☆18Updated 5 years ago
- PyTorch implementation of the paper "Hyperbolic Interaction Model For Hierarchical Multi-Label Classification"☆48Updated 6 years ago
- 基于Transformer的单模型、多尺度的VAE模型☆57Updated 4 years ago
- Implementation of SetRank in SIGIR 2020☆50Updated 5 years ago
- Code for the article "Automatic Temperature Control for Neural Machine Translation" (EMNLP 2018)☆14Updated 6 years ago
- Source code for "Efficient Training of BERT by Progressively Stacking"☆113Updated 6 years ago
- Tensorflow Implementation of Variational Attention for Sequence to Sequence Models (COLING 2018)☆71Updated 5 years ago
- The implementation of Meta-LSTM in "Meta Multi-Task Learning for Sequence Modeling." AAAI-18☆33Updated 7 years ago
- ☆50Updated 2 years ago
- PyTorch implementation for the paper Classification from Positive, Unlabeled and Biased Negative Data.☆19Updated last year
- Sampled Softmax Implementation for PyTorch☆44Updated 7 years ago
- A Toolkit for Training, Tracking, Saving Models and Syncing Results☆62Updated 5 years ago
- A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"☆73Updated 2 years ago
- A dual learning toolkit developed by Microsoft Research☆72Updated 2 years ago
- Code for ACL'19 "Few-Shot Representation Learning for Out-Of-Vocabulary Words"☆55Updated 5 years ago
- Code for Interpretable Adversarial Perturbation in Input Embedding Space for Text, IJCAI 2018.☆42Updated 5 years ago
- Encoding position with the word embeddings.☆84Updated 7 years ago
- Repository for ACL 2019 paper☆73Updated 6 years ago
- ☆94Updated 5 years ago
- statnlp-neural☆32Updated 6 years ago
- This repo provides the code for the ACL 2020 paper "Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEnco…☆55Updated 4 years ago
- Implementation of Densely Connected Attention Propagation for Reading Comprehension (NIPS 2018)☆69Updated 6 years ago
- Partial Codes and datasets for NeurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"☆20Updated 6 years ago
- Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"☆148Updated 6 years ago
- Label Embedding Network☆92Updated 7 years ago