suyash / transformer

Related projects ⓘ

Alternatives and complementary repositories for transformer

• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆157Updated 5 years ago
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆93Updated 4 years ago
• kpot / keras-transformer
  Keras library for building (Universal) Transformers, facilitating BERT and GPT models
  ☆533Updated 4 years ago
• titu1994 / keras-LAMB-Optimizer
  Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"
  ☆76Updated 5 years ago
• zbloss / TransformerModel
  ☆58Updated 5 years ago
• khumbuai / ulmfit_keras
  Keras wikipedia-based Language Model
  ☆22Updated 6 years ago
• legacyai / tf-transformers
  State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).
  ☆85Updated last year
• CyberZHG / keras-adabound
  AdaBound optimizer in Keras
  ☆56Updated 4 years ago
• CyberZHG / keras-layer-normalization
  Layer normalization implemented in Keras
  ☆60Updated 2 years ago
• prajjwal1 / language-modelling
  LM, ULMFit et al.
  ☆47Updated 4 years ago
• CyberZHG / keras-transformer
  Transformer implemented in Keras
  ☆371Updated 2 years ago
• CyberZHG / keras-gpt-2
  Load GPT-2 checkpoint and generate texts
  ☆128Updated 2 years ago
• iliaschalkidis / ELMo-keras
  Re-implementation of ELMo on Keras
  ☆135Updated last year
• CyberZHG / keras-multi-head
  A wrapper layer for stacking layers horizontally
  ☆227Updated 2 years ago
• lzfelix / keras_attention
  An Attention Layer in Keras
  ☆43Updated 5 years ago
• titu1994 / keras_rectified_adam
  Implementation of Rectified Adam in Keras
  ☆69Updated 5 years ago
• Kyubyong / lm_finetuning
  Language Model Fine-tuning for Moby Dick
  ☆42Updated 5 years ago
• astorfi / sequence-to-sequence-from-scratch
  Sequence to Sequence from Scratch Using Pytorch
  ☆122Updated 5 years ago
• CyberZHG / keras-transformer-xl
  Transformer-XL with checkpoint loader
  ☆68Updated 2 years ago
• Tony607 / Keras-Text-Transfer-Learning
  Keras + Universal Sentence Encoder = Transfer Learning for text data
  ☆34Updated 6 years ago
• HighCWu / keras-bert-tpu
  Implementation of BERT that could load official pre-trained models for feature extraction and prediction on TPU
  ☆17Updated 5 years ago
• CyberZHG / keras-pos-embd
  Position embedding layers in Keras
  ☆59Updated 2 years ago
• yaserkl / BERTvsULMFIT
  Comparing Text Classification results using BERT embedding and ULMFIT embedding
  ☆65Updated 5 years ago
• CyberZHG / keras-lookahead
  Lookahead mechanism for optimizers in Keras.
  ☆49Updated 3 years ago
• wangcongcong123 / ttt
  A package for fine-tuning Transformers with TPUs, written in Tensorflow2.0+
  ☆37Updated 3 years ago
• miroozyx / BERT_with_keras
  A Keras version of Google's BERT model
  ☆33Updated 5 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆132Updated 5 years ago
• zimmerrol / attention-is-all-you-need-keras
  Implementation of the Transformer architecture described by Vaswani et al. in "Attention Is All You Need"
  ☆28Updated 5 years ago
• threelittlemonkeys / seq2seq-pytorch
  Sequence to Sequence Models in PyTorch
  ☆44Updated 3 months ago