CyberZHG / keras-layer-normalization
Layer normalization implemented in Keras
☆60Updated 3 years ago
Alternatives and similar repositories for keras-layer-normalization:
Users that are interested in keras-layer-normalization are comparing it to the libraries listed below
- Position embedding layers in Keras☆58Updated 3 years ago
- Transformer-XL with checkpoint loader☆68Updated 3 years ago
- AdamW optimizer for Keras☆114Updated 5 years ago
- Implementation of the Transformer architecture described by Vaswani et al. in "Attention Is All You Need"☆28Updated 5 years ago
- Collection of custom layers and utility functions for Keras which are missing in the main framework.☆62Updated 4 years ago
- A wrapper layer for stacking layers horizontally☆228Updated 3 years ago
- An Attention Layer in Keras☆43Updated 5 years ago
- Keras implementation of “Gated Linear Unit ”☆23Updated 9 months ago
- Implementation of Simple Recurrent Unit in Keras☆89Updated 7 years ago
- Implementation of IndRNN in Keras☆67Updated 4 years ago
- Ordered Neurons LSTM☆30Updated 3 years ago
- seq2seq attention in keras☆40Updated 6 years ago
- Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)☆91Updated 6 years ago
- Tensorflow implementation of Semi-supervised Sequence Learning (https://arxiv.org/abs/1511.01432)☆81Updated 2 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆76Updated 5 years ago
- attention block for keras Functional Model with only tensorflow backend☆26Updated 5 years ago
- Learning rate multiplier☆46Updated 3 years ago
- Re-implementation of ELMo on Keras☆134Updated last year
- Implementation of CRF layer in Keras.☆74Updated 7 years ago
- My implementation of "Hierarchical Attention Networks for Document Classification" in Keras☆26Updated 6 years ago
- code for 3rd place kaggle tensorflow competition☆96Updated 6 years ago
- CapsNet for NLP☆67Updated 6 years ago
- Quasi-RNN for language modeling☆57Updated 7 years ago
- AdaBound optimizer in Keras☆56Updated 4 years ago
- Implementation in Keras of: Snapshot Ensembles: Train 1, get M for free (https://arxiv.org/abs/1704.00109)☆25Updated 6 years ago
- Implement modern LSTM cell by tensorflow and test them by language modeling task for PTB. Highway State Gating, Hypernets, Recurrent High…☆30Updated 6 years ago
- Adaptive embedding and softmax☆17Updated 3 years ago
- Lookahead mechanism for optimizers in Keras.☆49Updated 3 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆93Updated 5 years ago
- Augmenting word embeddings with their surrounding context using bidirectional RNN☆60Updated 4 years ago