exe1023 / LSTM_LN
lstm with layer normalization
☆19Updated 4 years ago
Alternatives and similar repositories for LSTM_LN:
Users that are interested in LSTM_LN are comparing it to the libraries listed below
- A pytorch implementation of the paper: "Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks"☆80Updated 6 years ago
- PyTorch implementations of LSTM Variants (Dropout + Layer Norm)☆136Updated 3 years ago
- Representation learning for NLP @ JSALT19☆38Updated 4 years ago
- ☆40Updated 6 years ago
- Experiments with binary LSTM using gumbel-sigmoid☆30Updated 4 years ago
- Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation pr…☆45Updated 5 years ago
- ☆24Updated 5 years ago
- Code for "Understanding and Improving Layer Normalization"☆46Updated 5 years ago
- Variational autoencoders: VAE, gaussian mixture VAE (GMVAE), and a basic ladder VAE (LVAE)☆46Updated 4 years ago
- PyTorch Implementations of Dropout Variants☆87Updated 7 years ago
- An implementation of a Variational-Autoencoder using the Gumbel-Softmax reparametrization trick in TensorFlow (tested on r1.5 CPU and GPU…☆72Updated 6 years ago
- custom cuda kernel for {2, 3}d relative attention with pytorch wrapper☆43Updated 4 years ago
- categorical variational autoencoder using the Gumbel-Softmax estimator☆25Updated 6 years ago
- Real-valued non-volume preserving(RealNVP) implementation with PyTorch☆14Updated 5 years ago
- PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆62Updated 8 months ago
- ReGAN: Sequence GAN using RE[INFORCE|LAX|BAR] based PG estimators☆40Updated 6 years ago
- Xuhong Li, Yves Grandvalet, and Franck Davoine. "Explicit Inductive Bias for Transfer Learning with Convolutional Networks." In ICML 2018…☆55Updated 6 years ago
- Pytorch implement WaveNet☆93Updated 6 years ago
- Code for the NeurIPS 2018 paper "On Controllable Sparse Alternatives to Softmax"☆23Updated 5 years ago
- ZForcing Repo☆40Updated 7 years ago
- ☆22Updated 6 years ago
- Pytorch implementation of R-Transformer. Some parts of the code are adapted from the implementation of TCN and Transformer.☆228Updated 5 years ago
- STCN: Stochastic Temporal Convolutional Networks☆69Updated 4 years ago
- PyTorch implementation of a Variational Autoencoder with Gumbel-Softmax Distribution☆208Updated 6 years ago
- a simple implementation of self attention layer that outputs flattened sentence embedding matrix, with the Frobenius norm penalty☆16Updated 6 years ago
- [ICML 2020] code for the flooding regularizer proposed in "Do We Need Zero Training Loss After Achieving Zero Training Error?"☆91Updated 2 years ago
- This is the code for the paper 'Quaternion Recurrent Neural Networks'.☆58Updated 6 years ago
- Code for our paper "Sparse Attentive Backtracking: Sparse Attentive Backtracking: Temporal Credit Assignment Through Reminding" https://p…☆38Updated 6 years ago
- EMNLP 2018: Multi-Head Attention with Disagreement Regularization; NAACL 2019: Information Aggregation for Multi-Head Attention with Rout…☆21Updated 4 years ago
- Variational Information Bottleneck☆16Updated 6 years ago