Alternatives and similar repositories for attention-mechanisms

Users that are interested in attention-mechanisms are comparing it to the libraries listed below

• CyberZHG / keras-multi-head
  A wrapper layer for stacking layers horizontally
  ☆228Updated 3 years ago
• CyberZHG / keras-self-attention
  Attention mechanism for processing sequential data that considers the context for each timestamp.
  ☆656Updated 3 years ago
• thushv89 / attention_keras
  Keras Layer implementation of Attention for Sequential models
  ☆442Updated 2 years ago
• CyberZHG / keras-transformer
  Transformer implemented in Keras
  ☆369Updated 3 years ago
• monk1337 / Various-Attention-mechanisms
  This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention…
  ☆125Updated 4 years ago
• lsdefine / attention-is-all-you-need-keras
  A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need
  ☆713Updated 4 years ago
• kpot / keras-transformer
  Keras library for building (Universal) Transformers, facilitating BERT and GPT models
  ☆540Updated 5 years ago
• gentaiscool / lstm-attention
  Attention-based bidirectional LSTM for Classification Task (ICASSP)
  ☆116Updated 2 years ago
• artemmavrin / focal-loss
  TensorFlow implementation of focal loss
  ☆191Updated 4 years ago
• zaidalyafeai / AttentioNN
  All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
  ☆234Updated 5 years ago
• b-etienne / Seq2seq-PyTorch
  ☆76Updated 5 years ago
• AlexGidiotis / Document-Classifier-LSTM
  A bidirectional LSTM with attention for multiclass/multilabel text classification.
  ☆173Updated last year
• piEsposito / pytorch-lstm-by-hand
  A small and simple tutorial on how to craft a LSTM nn.Module by hand on PyTorch.
  ☆126Updated 5 years ago
• Choco31415 / Attention_Network_With_Keras
  An example attention network with simple dataset.
  ☆229Updated 6 years ago
• foamliu / Self-Attention-Keras
  自注意力与文本分类
  ☆119Updated 6 years ago
• keitakurita / Better_LSTM_PyTorch
  An LSTM in PyTorch with best practices (weight dropout, forget bias, etc.) built-in. Fully compatible with PyTorch LSTM.
  ☆134Updated 5 years ago
• lilianweng / transformer-tensorflow
  Implementation of Transformer Model in Tensorflow
  ☆476Updated 2 years ago
• DSE-MSU / R-transformer
  Pytorch implementation of R-Transformer. Some parts of the code are adapted from the implementation of TCN and Transformer.
  ☆230Updated 6 years ago
• lzfelix / keras_attention
  An Attention Layer in Keras
  ☆43Updated 6 years ago
• mttk / rnn-classifier
  Minimal RNN classifier with self-attention in Pytorch
  ☆152Updated 3 years ago
• strutive07 / transformer-tensorflow2.0
  transformer in tensorflow 2.0
  ☆63Updated 4 years ago
• nathanhubens / Autoencoders
  Implementation of simple autoencoders networks with Keras
  ☆247Updated 5 years ago
• ningshixian / LSTM_Attention
  attention-based LSTM/Dense implemented by Keras
  ☆300Updated 7 years ago
• pengshuang / CNN-Seq2Seq
  A pytorch implementation of Fairseq Convolutional Sequence to Sequence Learning(Gehring et al. 2017)
  ☆45Updated 6 years ago
• ryancheunggit / Denoise-Transformer-AutoEncoder
  ☆350Updated 4 years ago
• OverLordGoldDragon / keras-adamw
  Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
  ☆168Updated 3 years ago
• Tony607 / Keras_Deep_Clustering
  How to do Unsupervised Clustering with Keras
  ☆240Updated 7 years ago
• fionn-mac / Manhattan-LSTM
  Keras and PyTorch implementations of the MaLSTM model for computing Semantic Similarity.
  ☆28Updated 5 years ago
• yzhao062 / awesome-ensemble-learning
  Ensemble learning related books, papers, videos, and toolboxes
  ☆300Updated 6 years ago
• CyberZHG / keras-layer-normalization
  Layer normalization implemented in Keras
  ☆60Updated 3 years ago