Alternatives and similar repositories for transformer

Users that are interested in transformer are comparing it to the libraries listed below

• titu1994 / keras-LAMB-Optimizer
  Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"
  ☆75Updated 6 years ago
• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆158Updated 5 years ago
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆95Updated 5 years ago
• CyberZHG / keras-gpt-2
  Load GPT-2 checkpoint and generate texts
  ☆127Updated 3 years ago
• kpot / keras-transformer
  Keras library for building (Universal) Transformers, facilitating BERT and GPT models
  ☆537Updated 5 years ago
• prajjwal1 / language-modelling
  LM, ULMFit et al.
  ☆46Updated 5 years ago
• khumbuai / ulmfit_keras
  Keras wikipedia-based Language Model
  ☆21Updated 6 years ago
• zbloss / TransformerModel
  ☆58Updated 5 years ago
• Kyubyong / lm_finetuning
  Language Model Fine-tuning for Moby Dick
  ☆42Updated 6 years ago
• Tony607 / Keras-Text-Transfer-Learning
  Keras + Universal Sentence Encoder = Transfer Learning for text data
  ☆33Updated 6 years ago
• iliaschalkidis / ELMo-keras
  Re-implementation of ELMo on Keras
  ☆133Updated 2 years ago
• CyberZHG / keras-layer-normalization
  Layer normalization implemented in Keras
  ☆60Updated 3 years ago
• zimmerrol / attention-is-all-you-need-keras
  Implementation of the Transformer architecture described by Vaswani et al. in "Attention Is All You Need"
  ☆28Updated 6 years ago
• CyberZHG / keras-transformer-xl
  Transformer-XL with checkpoint loader
  ☆68Updated 3 years ago
• titu1994 / keras_rectified_adam
  Implementation of Rectified Adam in Keras
  ☆70Updated 5 years ago
• CyberZHG / keras-multi-head
  A wrapper layer for stacking layers horizontally
  ☆228Updated 3 years ago
• CyberZHG / keras-adabound
  AdaBound optimizer in Keras
  ☆56Updated 4 years ago
• OverLordGoldDragon / keras-adamw
  Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
  ☆167Updated 3 years ago
• kaushalshetty / Positional-Encoding
  Encoding position with the word embeddings.
  ☆83Updated 7 years ago
• lyeoni / pretraining-for-language-understanding
  Pre-training of Language Models for Language Understanding
  ☆83Updated 5 years ago
• vinsis / math-and-ml-notes
  Books, papers and links to latest research in ML/AI
  ☆90Updated 11 months ago
• lzfelix / keras_attention
  An Attention Layer in Keras
  ☆43Updated 6 years ago
• ChunML / NLP
  This is where I put all my work in Natural Language Processing
  ☆96Updated 4 years ago
• CyberZHG / keras-lookahead
  Lookahead mechanism for optimizers in Keras.
  ☆50Updated 4 years ago
• zimmerrol / keras-utility-layer-collection
  Collection of custom layers and utility functions for Keras which are missing in the main framework.
  ☆62Updated 5 years ago
• graykode / ALBERT-Pytorch
  Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
  ☆226Updated 4 years ago
• yk / huggingface-nlp-demo
  ☆46Updated 5 years ago
• legacyai / tf-transformers
  State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).
  ☆85Updated 2 years ago
• CyberZHG / keras-transformer
  Transformer implemented in Keras
  ☆371Updated 3 years ago
• bastings / annotated_encoder_decoder
  The Annotated Encoder Decoder with Attention
  ☆166Updated 4 years ago