guillaume-chevalier / Linear-Attention-Recurrent-Neural-Network
A recurrent attention module consisting of an LSTM cell which can query its own past cell states by the means of windowed multi-head attention. The formulas are derived from the BN-LSTM and the Transformer Network. The LARNN cell with attention can be easily used inside a loop on the cell state, just like any other RNN. (LARNN)
☆144Updated 6 years ago
Alternatives and similar repositories for Linear-Attention-Recurrent-Neural-Network:
Users that are interested in Linear-Attention-Recurrent-Neural-Network are comparing it to the libraries listed below
- Dilated RNNs in pytorch☆212Updated 5 years ago
- PyTorch implementations of LSTM Variants (Dropout + Layer Norm)☆136Updated 3 years ago
- Keras implementation of Nested LSTMs☆89Updated 6 years ago
- Implementation of IndRNN in Keras☆67Updated 4 years ago
- [ICLR'19] Trellis Networks for Sequence Modeling☆471Updated 5 years ago
- pytorch implementation of Independently Recurrent Neural Networks https://arxiv.org/abs/1803.04831☆121Updated 6 years ago
- Tensorflow implementation of a Hierarchical and Multiscale RNN, described in https://arxiv.org/abs/1609.01704☆135Updated 7 years ago
- Repository for the ablation study of "Long Short-Term Memory Fully Convolutional Networks for Time Series Classification"☆54Updated 5 years ago
- A tensorflow implementation of GAN ( exactly InfoGAN or Info GAN ) to one dimensional ( 1D ) time series data.☆295Updated 10 months ago
- TensorFlow LSTM-autoencoder implementation☆194Updated 7 years ago
- Keras implementation of LSTM Variational Autoencoder☆228Updated 5 years ago
- Pervasive Attention: 2D Convolutional Networks for Sequence-to-Sequence Prediction☆502Updated 3 years ago
- PTB Language Modelling task with LSTM + Attention layer☆31Updated 6 years ago
- The Annotated Encoder Decoder with Attention☆166Updated 3 years ago
- Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequences (NIPS 2016) - Tensorflow 1.0☆128Updated 6 years ago
- Codebase for the paper LSTM Fully Convolutional Networks for Time Series Classification☆139Updated 5 years ago
- PyTorch implementation of batched bi-RNN encoder and attention-decoder.☆279Updated 6 years ago
- Dual Staged Attention Model for Time Series prediction☆67Updated 7 years ago
- Multi heads attention for image classification☆81Updated 6 years ago
- A simple Tensorflow based library for deep and/or denoising AutoEncoder.☆149Updated 6 years ago
- Collection of custom layers and utility functions for Keras which are missing in the main framework.☆62Updated 4 years ago
- Deep Neural Network Ensembles for Time Series Classification☆111Updated last year
- This repository contains the source for the paper "S-LSTM-GAN: Shared recurrent neural networks with adversarial training"☆88Updated 5 years ago
- Keras implementation of [The unreasonable effectiveness of the forget gate](https://arxiv.org/abs/1804.04849)☆35Updated 5 years ago
- Batch normalized LSTM for tensorflow☆179Updated 8 years ago
- Tensorflow implementation for DilatedRNN☆346Updated 7 years ago
- Time series prediction using dilated causal convolutional neural nets (temporal CNN)☆236Updated 2 years ago
- pytorch neural network attention mechanism☆147Updated 6 years ago
- Implementation of Bayesian Recurrent Neural Networks by Fortunato et. al☆217Updated 6 years ago
- Experiments with beta-VAE to learn disentangled representations from the data☆65Updated 5 years ago