CyberZHG / keras-layer-normalization
Layer normalization implemented in Keras
☆60Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for keras-layer-normalization
- Position embedding layers in Keras☆59Updated 2 years ago
- Collection of custom layers and utility functions for Keras which are missing in the main framework.☆62Updated 4 years ago
- Implementation of the Transformer architecture described by Vaswani et al. in "Attention Is All You Need"☆28Updated 5 years ago
- AdamW optimizer for Keras☆114Updated 5 years ago
- A wrapper layer for stacking layers horizontally☆227Updated 2 years ago
- Transformer-XL with checkpoint loader☆68Updated 2 years ago
- Keras implementation of “Gated Linear Unit ”☆23Updated 6 months ago
- An Attention Layer in Keras☆43Updated 5 years ago
- Learning rate multiplier☆46Updated 3 years ago
- Lookahead mechanism for optimizers in Keras.☆49Updated 3 years ago
- seq2seq attention in keras☆40Updated 5 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆76Updated 5 years ago
- code for 3rd place kaggle tensorflow competition☆96Updated 6 years ago
- Ordered Neurons LSTM☆30Updated 2 years ago
- Re-implementation of ELMo on Keras☆135Updated last year
- Make Torchtext work with Keras.☆18Updated 5 years ago
- My implementation of "Hierarchical Attention Networks for Document Classification" in Keras☆26Updated 6 years ago
- Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)☆92Updated 6 years ago
- Tensorflow implementation of Semi-supervised Sequence Learning (https://arxiv.org/abs/1511.01432)☆82Updated 2 years ago
- Tensorflow implementation of "A Structured Self-Attentive Sentence Embedding"☆193Updated 3 years ago
- Calculate similarity with embedding☆11Updated 2 years ago
- Adaptive embedding and softmax☆17Updated 2 years ago
- AdaBound optimizer in Keras☆57Updated 4 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆93Updated 4 years ago
- Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch☆61Updated 5 years ago
- Implementation of Simple Recurrent Unit in Keras☆89Updated 7 years ago
- Implement modern LSTM cell by tensorflow and test them by language modeling task for PTB. Highway State Gating, Hypernets, Recurrent High…☆30Updated 6 years ago
- Quasi-RNN for language modeling☆58Updated 7 years ago
- Keras implementation of Nested LSTMs☆90Updated 5 years ago
- RAdam optimizer for keras☆71Updated 5 years ago