suyash / transformerLinks
A Transformer implementation in Keras' Imperative (Subclassing) API for TensorFlow.
☆55Updated 6 years ago
Alternatives and similar repositories for transformer
Users that are interested in transformer are comparing it to the libraries listed below
Sorting:
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆96Updated 6 years ago
- Scripts to train a bidirectional LSTM with knowledge distillation from BERT☆159Updated 6 years ago
- Keras library for building (Universal) Transformers, facilitating BERT and GPT models☆541Updated 5 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 6 years ago
- Load GPT-2 checkpoint and generate texts☆127Updated 4 years ago
- An Attention Layer in Keras☆43Updated 6 years ago
- State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).☆85Updated 2 years ago
- Transformer-XL with checkpoint loader☆68Updated 4 years ago
- A wrapper layer for stacking layers horizontally☆228Updated 4 years ago
- Layer normalization implemented in Keras☆60Updated 4 years ago
- This is where I put all my work in Natural Language Processing☆97Updated 4 years ago
- Transformer implemented in Keras☆369Updated 4 years ago
- Re-implementation of ELMo on Keras☆135Updated 2 years ago
- Implementation of the Transformer architecture described by Vaswani et al. in "Attention Is All You Need"☆28Updated 6 years ago
- Keras wikipedia-based Language Model☆21Updated 7 years ago
- A simple technique to integrate BERT from tf hub to keras☆258Updated 2 years ago
- Sequence to Sequence Models in PyTorch☆44Updated last year
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆169Updated 4 years ago
- LM, ULMFit et al.☆46Updated 6 years ago
- Concatenate word and character embeddings in Keras☆45Updated 4 years ago
- Lookahead mechanism for optimizers in Keras.☆50Updated 4 years ago
- Position embedding layers in Keras☆58Updated 4 years ago
- Keras implementations of three language models: character-level RNN, word-level RNN and Sentence VAE (Bowman, Vilnis et al 2016).☆43Updated 4 years ago
- Text Generation Using A Variational Autoencoder☆110Updated 8 years ago
- A Keras version of Google's BERT model☆35Updated 6 years ago
- Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)☆228Updated 4 years ago
- Google QUEST Q&A Labeling. Improving automated understanding of complex question answer content☆249Updated 4 years ago
- Keras + Universal Sentence Encoder = Transfer Learning for text data☆33Updated 7 years ago
- Implementation of BERT that could load official pre-trained models for feature extraction and prediction on TPU☆17Updated 6 years ago
- How to use ELMo embeddings in Keras with Tensorflow Hub☆260Updated 7 years ago