Alternatives and similar repositories for normalized-attention

Users that are interested in normalized-attention are comparing it to the libraries listed below

• giannisdaras / smyrf
  [NeurIPS 2020] Official Implementation: "SMYRF: Efficient Attention using Asymmetric Clustering".
  ☆50Updated last year
• facebookresearch / Permutation-Equivariant-Seq2Seq
  Humans understand novel sentences by composing meanings and roles of core language components. In contrast, neural network models for nat…
  ☆27Updated 5 years ago
• ofirpress / PartialShuffle
  ☆14Updated 6 years ago
• seraphlabs-ca / MIM
  Code for "MIM: Mutual Information Machine" paper.
  ☆16Updated 2 years ago
• Holmeswww / PPOGAN
  ☆24Updated last year
• yzh119 / segtree-transformer-v0
  Code for SegTree Transformer (ICLR-RLGM 2019).
  ☆27Updated 5 years ago
• MultiPath / Efficient-Neural-Machine-Translation
  PhD thesis (updating) of Jiatao Gu from HKU
  ☆19Updated 6 years ago
• bzhangGo / lrn
  Source code for "A Lightweight Recurrent Network for Sequence Modeling"
  ☆26Updated 2 years ago
• lucidrains / distilled-retriever-pytorch
  Implementation of the retriever distillation procedure as outlined in the paper "Distilling Knowledge from Reader to Retriever"
  ☆32Updated 4 years ago
• tbachlechner / ReZero-examples
  PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"
  ☆61Updated 11 months ago
• LCS2-IIITD / TransEvolve
  ☆11Updated 3 years ago
• antofuller / configaformers
  A python library for highly configurable transformers - easing model architecture search and experimentation.
  ☆49Updated 3 years ago
• ermongroup / BiasAndGeneralization
  ☆26Updated 6 years ago
• bartwojcik / lossgrad
  Implementation of the LOSSGRAD optimization algorithm
  ☆15Updated 6 years ago
• wouterkool / estimating-gradients-without-replacement
  Estimating Gradients for Discrete Random Variables by Sampling without Replacement
  ☆40Updated 5 years ago
• salesforce / NeuralBayes
  ☆24Updated 2 months ago
• msobroza / SparsemaxPytorch
  SparseMax activation function implementation (ICML 2016) (PyTorch)
  ☆28Updated 7 years ago
• ARM-gradient / ARSM
  Low-variance and unbiased gradient for backpropagation through categorical random variables, with application in variational auto-encoder…
  ☆17Updated 5 years ago
• harvardnlp / hmm-lm
  ☆41Updated 4 years ago
• c-swm / c-swm
  This repository has moved to: https://github.com/tkipf/c-swm
  ☆27Updated 5 years ago
• aylai / EntailmentProbabilityEmbedding
  Models and code from Learning to Predict Denotational Probabilities For Modeling Entailment
  ☆14Updated 7 years ago
• uralik / beamdream
  ☆28Updated 3 years ago
• RemiLeblond / SeaRNN-open
  Open source implementation of SeaRNN (ICLR 2018, https://openreview.net/forum?id=HkUR_y-RZ)
  ☆48Updated 7 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 2 years ago
• BayesWatch / deficient-efficient
  Successfully training approximations to full-rank matrices for efficiency in deep learning.
  ☆17Updated 4 years ago
• choidami / sst
  ☆49Updated 4 years ago
• zomux / lanmt-ebm
  lanmt ebm
  ☆12Updated 5 years ago
• LIJUNYI95 / SuperAdam
  Official Pytorch Implementation for the paper 'SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients'
  ☆17Updated 3 years ago
• matthewmackay / reversible-rnn
  Code for reversible recurrent neural networks
  ☆39Updated 6 years ago
• deep-spin / lp-sparsemap
  LP-SparseMAP: Differentiable sparse structured prediction in coarse factor graphs
  ☆41Updated last year