jack57lee / Diversify-MHALinks
EMNLP 2018: Multi-Head Attention with Disagreement Regularization; NAACL 2019: Information Aggregation for Multi-Head Attention with Routing-by-Agreement
☆21Updated 5 years ago
Alternatives and similar repositories for Diversify-MHA
Users that are interested in Diversify-MHA are comparing it to the libraries listed below
Sorting:
- Efficient Neural Interaction Functions Search for Collaborative Filtering☆18Updated 5 years ago
- Code for "Understanding and Improving Layer Normalization"☆46Updated 6 years ago
- ☆84Updated 6 years ago
- Source code for "Efficient Training of BERT by Progressively Stacking"☆113Updated 6 years ago
- Leveraging Local and Global Patterns for Self-Attention Networks☆12Updated 6 years ago
- Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"☆127Updated 4 years ago
- Implementation of SetRank in SIGIR 2020☆50Updated 5 years ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆64Updated 3 years ago
- Code for Learning K-way D-dimensional Discrete Codes For Compact Embedding Representations☆29Updated 7 years ago
- Partial Codes and datasets for NeurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"☆20Updated 6 years ago
- Reproduce the results of paper "Compressing Word Embeddings via Deep Compositional Code Learning" accepted ICLR 2018☆24Updated 7 years ago
- Sampled Softmax Implementation for PyTorch☆44Updated 7 years ago
- Code for ACL'19 "Few-Shot Representation Learning for Out-Of-Vocabulary Words"☆55Updated 5 years ago
- Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"☆147Updated 6 years ago
- Code for the article "Automatic Temperature Control for Neural Machine Translation" (EMNLP 2018)☆14Updated 6 years ago
- ☆50Updated 2 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆95Updated 5 years ago
- The implementation of Meta-LSTM in "Meta Multi-Task Learning for Sequence Modeling." AAAI-18☆33Updated 7 years ago
- 基于Transformer的单模型、多尺度的VAE模型☆58Updated 4 years ago
- LAMB Optimizer for Large Batch Training (TensorFlow version)☆121Updated 6 years ago
- Code for EMNLP 2020 paper CoDIR☆41Updated 3 years ago
- Distilling BERT using natural language generation.☆39Updated 2 years ago
- PyTorch implementation of the paper "Hyperbolic Interaction Model For Hierarchical Multi-Label Classification"☆49Updated 6 years ago
- Ouroboros: On Accelerating Training of Transformer-Based Language Models☆10Updated 6 years ago
- Discrete Optimization for Unsupervised Sentence Summarization with Word-Level Extraction☆20Updated 3 years ago
- Unsupervised Learning of Transferable Relational Graphs☆69Updated 6 years ago
- ☆94Updated 5 years ago
- PyTorch implementation for the paper Classification from Positive, Unlabeled and Biased Negative Data.☆19Updated 2 years ago
- This repo provides the code for the ACL 2020 paper "Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEnco…☆57Updated 5 years ago
- A dual learning toolkit developed by Microsoft Research☆73Updated 2 years ago