Alternatives and similar repositories for transformer

Users that are interested in transformer are comparing it to the libraries listed below

• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆95Updated 5 years ago
• kpot / keras-transformer
  Keras library for building (Universal) Transformers, facilitating BERT and GPT models
  ☆541Updated 5 years ago
• CyberZHG / keras-gpt-2
  Load GPT-2 checkpoint and generate texts
  ☆127Updated 3 years ago
• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆159Updated 6 years ago
• titu1994 / keras-LAMB-Optimizer
  Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"
  ☆75Updated 6 years ago
• CyberZHG / keras-transformer
  Transformer implemented in Keras
  ☆369Updated 3 years ago
• CyberZHG / keras-transformer-xl
  Transformer-XL with checkpoint loader
  ☆68Updated 3 years ago
• OverLordGoldDragon / keras-adamw
  Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
  ☆169Updated 3 years ago
• legacyai / tf-transformers
  State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).
  ☆85Updated 2 years ago
• iliaschalkidis / ELMo-keras
  Re-implementation of ELMo on Keras
  ☆135Updated 2 years ago
• CyberZHG / keras-multi-head
  A wrapper layer for stacking layers horizontally
  ☆229Updated 3 years ago
• strongio / keras-bert
  A simple technique to integrate BERT from tf hub to keras
  ☆258Updated 2 years ago
• zbloss / TransformerModel
  ☆58Updated 6 years ago
• lzfelix / keras_attention
  An Attention Layer in Keras
  ☆43Updated 6 years ago
• spring-media / headliner
  🏖 Easy training and deployment of seq2seq models.
  ☆228Updated 4 years ago
• ChunML / NLP
  This is where I put all my work in Natural Language Processing
  ☆96Updated 4 years ago
• hsajjad / transformers
  🤗 Transformers: State-of-the-art Natural Language Processing for TensorFlow 2.0 and PyTorch.
  ☆68Updated 5 years ago
• CyberZHG / keras-lookahead
  Lookahead mechanism for optimizers in Keras.
  ☆50Updated 4 years ago
• ahmedbesbes / character-based-cnn
  Implementation of character based convolutional neural network
  ☆262Updated 4 years ago
• CyberZHG / keras-layer-normalization
  Layer normalization implemented in Keras
  ☆60Updated 3 years ago
• nadavbh12 / Character-Level-Language-Modeling-with-Deeper-Self-Attention-pytorch
  Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch
  ☆62Updated 6 years ago
• khumbuai / ulmfit_keras
  Keras wikipedia-based Language Model
  ☆21Updated 7 years ago
• kamalkraj / ALBERT-TF2.0
  ALBERT model Pretraining and Fine Tuning using TF2.0
  ☆204Updated 2 years ago
• thushv89 / attention_keras
  Keras Layer implementation of Attention for Sequential models
  ☆442Updated 2 years ago
• prajjwal1 / language-modelling
  LM, ULMFit et al.
  ☆46Updated 5 years ago
• gaphex / bert_experimental
  code and supplementary materials for a series of Medium articles about the BERT model
  ☆77Updated 2 years ago
• CyberZHG / keras-adabound
  AdaBound optimizer in Keras
  ☆56Updated 5 years ago
• zimmerrol / attention-is-all-you-need-keras
  Implementation of the Transformer architecture described by Vaswani et al. in "Attention Is All You Need"
  ☆28Updated 6 years ago
• SeanNaren / CORD-19-ANN
  ANN Search through the COVID CORD-19 Dataset using SBERT.
  ☆26Updated 5 years ago
• CyberZHG / keras-radam
  RAdam implemented in Keras & TensorFlow
  ☆325Updated 3 years ago