CyberZHG / keras-layer-normalization
Layer normalization implemented in Keras
☆60Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for keras-layer-normalization
- Collection of custom layers and utility functions for Keras which are missing in the main framework.☆62Updated 4 years ago
- Position embedding layers in Keras☆59Updated 2 years ago
- Transformer-XL with checkpoint loader☆68Updated 2 years ago
- AdamW optimizer for Keras☆114Updated 5 years ago
- Implementation of the Transformer architecture described by Vaswani et al. in "Attention Is All You Need"☆28Updated 5 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆76Updated 5 years ago
- seq2seq attention in keras☆40Updated 5 years ago
- Lookahead mechanism for optimizers in Keras.☆49Updated 3 years ago
- A wrapper layer for stacking layers horizontally☆227Updated 2 years ago
- Ordered Neurons LSTM☆30Updated 2 years ago
- An Attention Layer in Keras☆43Updated 5 years ago
- Learning rate multiplier☆46Updated 3 years ago
- a simple implementation of self attention layer that outputs flattened sentence embedding matrix, with the Frobenius norm penalty☆16Updated 6 years ago
- Implementation of IndRNN in Keras☆67Updated 4 years ago
- AdaBound optimizer in Keras☆57Updated 4 years ago
- Make Torchtext work with Keras.☆18Updated 5 years ago
- Keras implementation of “Gated Linear Unit ”☆23Updated 6 months ago
- RAdam optimizer for keras☆71Updated 5 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆61Updated 5 years ago
- Keras implementation of Nested LSTMs☆90Updated 5 years ago
- Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)☆92Updated 6 years ago
- Implementation of Simple Recurrent Unit in Keras☆89Updated 7 years ago
- Re-implementation of ELMo on Keras☆135Updated last year
- Implementation in Keras of: Snapshot Ensembles: Train 1, get M for free (https://arxiv.org/abs/1704.00109)☆25Updated 6 years ago
- CapsNet for NLP☆68Updated 5 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆93Updated 4 years ago
- code for 3rd place kaggle tensorflow competition☆96Updated 6 years ago
- Adaptive embedding and softmax☆17Updated 2 years ago
- Quasi-RNN for language modeling☆58Updated 7 years ago
- Tensorflow Implementation of Densely Connected Bidirectional LSTM with Applications to Sentence Classification☆48Updated 6 years ago