uzaymacar / attention-mechanisms

Related projects ⓘ

Alternatives and complementary repositories for attention-mechanisms

• CyberZHG / keras-multi-head
  A wrapper layer for stacking layers horizontally
  ☆227Updated 2 years ago
• CyberZHG / keras-self-attention
  Attention mechanism for processing sequential data that considers the context for each timestamp.
  ☆656Updated 2 years ago
• thushv89 / attention_keras
  Keras Layer implementation of Attention for Sequential models
  ☆444Updated last year
• monk1337 / Various-Attention-mechanisms
  This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention…
  ☆122Updated 3 years ago
• lsdefine / attention-is-all-you-need-keras
  A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need
  ☆708Updated 3 years ago
• CyberZHG / keras-transformer
  Transformer implemented in Keras
  ☆370Updated 2 years ago
• kpot / keras-transformer
  Keras library for building (Universal) Transformers, facilitating BERT and GPT models
  ☆533Updated 4 years ago
• ningshixian / LSTM_Attention
  attention-based LSTM/Dense implemented by Keras
  ☆294Updated 6 years ago
• Choco31415 / Attention_Network_With_Keras
  An example attention network with simple dataset.
  ☆230Updated 5 years ago
• DSE-MSU / R-transformer
  Pytorch implementation of R-Transformer. Some parts of the code are adapted from the implementation of TCN and Transformer.
  ☆224Updated 5 years ago
• zaidalyafeai / AttentioNN
  All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
  ☆227Updated 4 years ago
• gentaiscool / lstm-attention
  Attention-based bidirectional LSTM for Classification Task (ICASSP)
  ☆108Updated last year
• lilianweng / transformer-tensorflow
  Implementation of Transformer Model in Tensorflow
  ☆455Updated last year
• datalogue / keras-attention
  Visualizing RNNs using the attention mechanism
  ☆747Updated 5 years ago
• pengshuang / CNN-Seq2Seq
  A pytorch implementation of Fairseq Convolutional Sequence to Sequence Learning(Gehring et al. 2017)
  ☆44Updated 5 years ago
• keitakurita / Better_LSTM_PyTorch
  An LSTM in PyTorch with best practices (weight dropout, forget bias, etc.) built-in. Fully compatible with PyTorch LSTM.
  ☆133Updated 4 years ago
• artemmavrin / focal-loss
  TensorFlow implementation of focal loss
  ☆186Updated 3 years ago
• foamliu / Self-Attention-Keras
  自注意力与文本分类
  ☆119Updated 6 years ago
• emadRad / lstm-gru-pytorch
  LSTM and GRU in PyTorch
  ☆251Updated 5 years ago
• haohy / TCAN
  A PyTorch implementation of the TCAN model in "Temporal Convolutional Attention-based Network For Sequence Modeling".
  ☆136Updated last year
• johnsmithm / multi-heads-attention-image-classification
  Multi heads attention for image classification
  ☆80Updated 6 years ago
• keishinkickback / Pytorch-RNN-text-classification
  Word Embedding + LSTM + FC
  ☆159Updated 3 months ago
• zimmerrol / keras-utility-layer-collection
  Collection of custom layers and utility functions for Keras which are missing in the main framework.
  ☆62Updated 4 years ago
• DongjunLee / transformer-tensorflow
  TensorFlow implementation of 'Attention Is All You Need (2017. 6)'
  ☆349Updated 6 years ago
• b-etienne / Seq2seq-PyTorch
  ☆76Updated 4 years ago
• mttk / rnn-classifier
  Minimal RNN classifier with self-attention in Pytorch
  ☆150Updated 2 years ago
• kaka-lin / stock-price-predict
  Implementation of seq2seq with attention in keras
  ☆111Updated 4 years ago
• keitakurita / Practical_NLP_in_PyTorch
  A repository containing tutorials for practical NLP using PyTorch
  ☆530Updated 5 years ago
• nn116003 / self-attention-classification
  document classification using LSTM + self attention
  ☆112Updated 5 years ago
• sunfanyunn / DARNN
  A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction
  ☆111Updated 4 months ago