kpot / keras-transformer
Keras library for building (Universal) Transformers, facilitating BERT and GPT models
☆537Updated 4 years ago
Alternatives and similar repositories for keras-transformer:
Users that are interested in keras-transformer are comparing it to the libraries listed below
- A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need☆712Updated 3 years ago
- Transformer implemented in Keras☆372Updated 3 years ago
- Attention mechanism for processing sequential data that considers the context for each timestamp.☆657Updated 3 years ago
- A wrapper layer for stacking layers horizontally☆228Updated 3 years ago
- Keras implementation of BERT with pre-trained weights☆814Updated 5 years ago
- A simple technique to integrate BERT from tf hub to keras☆258Updated 2 years ago
- Re-implementation of ELMo on Keras☆134Updated 2 years ago
- Keras Layer implementation of Attention for Sequential models☆443Updated 2 years ago
- How to use ELMo embeddings in Keras with Tensorflow Hub☆260Updated 6 years ago
- A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.☆807Updated 2 years ago
- Visualizing RNNs using the attention mechanism☆749Updated 5 years ago
- Implementations for a family of attention mechanisms, suitable for all kinds of natural language processing tasks and compatible with Ten…☆354Updated last year
- Neural Machine Translation with Keras☆532Updated 3 years ago
- 🔡 Token level embeddings from BERT model on mxnet and gluonnlp☆452Updated 5 years ago
- Keras Attention Layer (Luong and Bahdanau scores).☆2,810Updated last year
- TensorFlow implementation of 'Attention Is All You Need (2017. 6)'☆348Updated 6 years ago
- Multilabel classification for Toxic comments challenge using Bert☆311Updated 5 years ago
- Load GPT-2 checkpoint and generate texts☆127Updated 3 years ago
- Implementation of XLNet that can load pretrained checkpoints☆171Updated 3 years ago
- RAdam implemented in Keras & TensorFlow☆325Updated 3 years ago
- Tensorflow implementation of contextualized word representations from bi-directional language models☆1,619Updated 2 years ago
- Deep Reinforcement Learning For Sequence to Sequence Models☆767Updated 2 years ago
- Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Process…☆250Updated 6 years ago
- Document classification with Hierarchical Attention Networks in TensorFlow. WARNING: project is currently unmaintained, issues will proba…☆465Updated 11 months ago
- Layer normalization implemented in Keras☆60Updated 3 years ago
- Framework for building complex recurrent neural networks with Keras☆765Updated 2 years ago
- Sequence to sequence learning using TensorFlow.☆390Updated 6 years ago
- On the Dimensionality of Word Embedding☆328Updated 4 years ago
- A Tensorflow implementation of QANet for machine reading comprehension☆981Updated 6 years ago
- Single Headed Attention RNN - "Stop thinking with your head"☆1,181Updated 3 years ago