Alternatives and similar repositories for transformer

Users that are interested in transformer are comparing it to the libraries listed below

• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆95Updated 5 years ago
• kpot / keras-transformer
  Keras library for building (Universal) Transformers, facilitating BERT and GPT models
  ☆540Updated 5 years ago
• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆159Updated 6 years ago
• CyberZHG / keras-gpt-2
  Load GPT-2 checkpoint and generate texts
  ☆127Updated 3 years ago
• legacyai / tf-transformers
  State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).
  ☆85Updated 2 years ago
• zimmerrol / attention-is-all-you-need-keras
  Implementation of the Transformer architecture described by Vaswani et al. in "Attention Is All You Need"
  ☆28Updated 6 years ago
• CyberZHG / keras-multi-head
  A wrapper layer for stacking layers horizontally
  ☆228Updated 3 years ago
• lzfelix / keras_attention
  An Attention Layer in Keras
  ☆43Updated 6 years ago
• iliaschalkidis / ELMo-keras
  Re-implementation of ELMo on Keras
  ☆134Updated 2 years ago
• CyberZHG / keras-transformer
  Transformer implemented in Keras
  ☆370Updated 3 years ago
• OverLordGoldDragon / keras-adamw
  Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
  ☆169Updated 3 years ago
• CyberZHG / keras-transformer-xl
  Transformer-XL with checkpoint loader
  ☆68Updated 3 years ago
• titu1994 / keras-LAMB-Optimizer
  Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"
  ☆75Updated 6 years ago
• ChunML / NLP
  This is where I put all my work in Natural Language Processing
  ☆96Updated 4 years ago
• CyberZHG / keras-layer-normalization
  Layer normalization implemented in Keras
  ☆60Updated 3 years ago
• threelittlemonkeys / seq2seq-pytorch
  Sequence to Sequence Models in PyTorch
  ☆44Updated last year
• HighCWu / keras-bert-tpu
  Implementation of BERT that could load official pre-trained models for feature extraction and prediction on TPU
  ☆17Updated 6 years ago
• pbloem / language-models
  Keras implementations of three language models: character-level RNN, word-level RNN and Sentence VAE (Bowman, Vilnis et al 2016).
  ☆43Updated 4 years ago
• kaushalshetty / Positional-Encoding
  Encoding position with the word embeddings.
  ☆84Updated 7 years ago
• zbloss / TransformerModel
  ☆58Updated 6 years ago
• keitakurita / Better_LSTM_PyTorch
  An LSTM in PyTorch with best practices (weight dropout, forget bias, etc.) built-in. Fully compatible with PyTorch LSTM.
  ☆134Updated 5 years ago
• domyounglee / tf2-reformer
  Reproducing the reformer with tf2
  ☆16Updated 4 years ago
• strongio / keras-bert
  A simple technique to integrate BERT from tf hub to keras
  ☆258Updated 2 years ago
• Kyubyong / nlp_made_easy
  Explains nlp building blocks in a simple manner.
  ☆251Updated 6 years ago
• khumbuai / ulmfit_keras
  Keras wikipedia-based Language Model
  ☆21Updated 7 years ago
• Tony607 / Keras-Text-Transfer-Learning
  Keras + Universal Sentence Encoder = Transfer Learning for text data
  ☆33Updated 7 years ago
• kpe / params-flow
  A TensorFlow Keras coding style for reducing boilerplate code in custom layers and models.
  ☆18Updated 4 years ago
• hsajjad / transformers
  🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.
  ☆68Updated 5 years ago
• roomylee / rnn-text-classification-tf
  Tensorflow Implementation of Recurrent Neural Network (Vanilla, LSTM, GRU) for Text Classification
  ☆118Updated 7 years ago
• CyberZHG / keras-pos-embd
  Position embedding layers in Keras
  ☆58Updated 3 years ago