Alternatives and similar repositories for Diversify-MHA

Users that are interested in Diversify-MHA are comparing it to the libraries listed below

• FreedomIntelligence / complex-order
  ☆83Updated 5 years ago
• lancopku / AdaNorm
  Code for "Understanding and Improving Layer Normalization"
  ☆46Updated 5 years ago
• yzh119 / BPT
  Source code of paper "BP-Transformer: Modelling Long-Range Context via Binary Partitioning"
  ☆128Updated 4 years ago
• quanmingyao / SIF
  Efficient Neural Interaction Functions Search for Collaborative Filtering
  ☆18Updated 5 years ago
• bojone / univae
  基于Transformer的单模型、多尺度的VAE模型
  ☆57Updated 4 years ago
• pl8787 / SetRank
  Implementation of SetRank in SIGIR 2020
  ☆50Updated 5 years ago
• vanzytay / QuaternionTransformers
  Repository for ACL 2019 paper
  ☆72Updated 6 years ago
• lancopku / SACT
  Code for the article "Automatic Temperature Control for Neural Machine Translation" (EMNLP 2018)
  ☆14Updated 6 years ago
• msobroza / compositional_code_learning
  Reproduce the results of paper "Compressing Word Embeddings via Deep Compositional Code Learning" accepted ICLR 2018
  ☆24Updated 7 years ago
• gonglinyuan / StackingBERT
  Source code for "Efficient Training of BERT by Progressively Stacking"
  ☆112Updated 6 years ago
• lxk00 / BERT-EMD
  ☆50Updated 2 years ago
• LittleChenCc / Meta_LSTM
  The implementation of Meta-LSTM in "Meta Multi-Task Learning for Sequence Modeling." AAAI-18
  ☆33Updated 7 years ago
• leimao / Sampled-Softmax-PyTorch
  Sampled Softmax Implementation for PyTorch
  ☆44Updated 7 years ago
• bcol23 / HyperIM
  PyTorch implementation of the paper "Hyperbolic Interaction Model For Hierarchical Multi-Label Classification"
  ☆47Updated 5 years ago
• RayeRen / multilingual-kd-pytorch
  ICLR2019, Multilingual Neural Machine Translation with Knowledge Distillation
  ☆70Updated 4 years ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆73Updated 2 years ago
• scewiner / Leveraging
  Leveraging Local and Global Patterns for Self-Attention Networks
  ☆12Updated 6 years ago
• szhangtju / The-compression-of-Transformer
  ☆64Updated 4 years ago
• lancopku / Prime
  A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.
  ☆85Updated 2 years ago
• acbull / HiCE
  Code for ACL'19 "Few-Shot Representation Learning for Out-Of-Vocabulary Words"
  ☆55Updated 5 years ago
• jgpavez / Working-Memory-Networks
  Code to reproduce the paper Working Memory Networks
  ☆26Updated 7 years ago
• zhaocq-nlp / Attention-Visualization
  Visualization for simple attention and Google's multi-head attention.
  ☆68Updated 7 years ago
• HA-Transformer / MAT
  The implementation of multi-branch attentive Transformer (MAT).
  ☆33Updated 4 years ago
• kaushalshetty / Positional-Encoding
  Encoding position with the word embeddings.
  ☆83Updated 7 years ago
• wuliwei9278 / SSE
  Partial Codes and datasets for NeurIPS'19 "Stochastic Shared Embeddings: Data-driven Regularization of Embedding Layers"
  ☆19Updated 5 years ago
• zhuohan123 / macaron-net
  Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"
  ☆148Updated 6 years ago
• lancopku / label-embedding-network
  Label Embedding Network
  ☆92Updated 7 years ago
• microsoft / DualLearning
  A dual learning toolkit developed by Microsoft Research
  ☆71Updated 2 years ago
• chentingpc / dpq_embedding_compression
  Differentiable Product Quantization for End-to-End Embedding Compression.
  ☆62Updated 2 years ago
• kimiyoung / glomo
  Unsupervised Learning of Transferable Relational Graphs
  ☆69Updated 6 years ago