CyberZHG / keras-transformerView external linksLinks
Transformer implemented in Keras
☆369Jan 22, 2022Updated 4 years ago
Alternatives and similar repositories for keras-transformer
Users that are interested in keras-transformer are comparing it to the libraries listed below
Sorting:
- Attention mechanism for processing sequential data that considers the context for each timestamp.☆657Jan 22, 2022Updated 4 years ago
- Keras library for building (Universal) Transformers, facilitating BERT and GPT models☆541May 30, 2020Updated 5 years ago
- Transformer-XL with checkpoint loader☆68Jan 22, 2022Updated 4 years ago
- A wrapper layer for stacking layers horizontally☆228Jan 22, 2022Updated 4 years ago
- Implementation of BERT that could load official pre-trained models for feature extraction and prediction☆2,428Jan 22, 2022Updated 4 years ago
- Layer normalization implemented in Keras☆60Jan 22, 2022Updated 4 years ago
- Adaptive embedding and softmax☆17Jan 22, 2022Updated 4 years ago
- Implementation of XLNet that can load pretrained checkpoints☆170Jan 22, 2022Updated 4 years ago
- Load GPT-2 checkpoint and generate texts☆127Jan 22, 2022Updated 4 years ago
- A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need☆713Sep 24, 2021Updated 4 years ago
- Position embedding layers in Keras☆58Jan 22, 2022Updated 4 years ago
- SNAIL Attention Block for Keras.☆17Mar 30, 2020Updated 5 years ago
- A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.☆809Jan 13, 2023Updated 3 years ago
- Gradient accumulation for Keras☆35Jun 27, 2021Updated 4 years ago
- Keras Attention Layer (Luong and Bahdanau scores).☆2,816Nov 17, 2023Updated 2 years ago
- RAdam optimizer for keras☆71Oct 14, 2019Updated 6 years ago
- keras example of seq2seq, auto title☆332Dec 9, 2019Updated 6 years ago
- Keras Layer implementation of Attention for Sequential models☆444Mar 25, 2023Updated 2 years ago
- Learning rate multiplier☆46Jun 22, 2021Updated 4 years ago
- RAdam implemented in Keras & TensorFlow☆325Jan 22, 2022Updated 4 years ago
- Keras implementation of BERT with pre-trained weights☆816Jul 26, 2019Updated 6 years ago
- Calculate similarity with embedding☆11Jan 22, 2022Updated 4 years ago
- lookahead optimizer for keras☆170Oct 14, 2019Updated 6 years ago
- 中文->英文的机器翻译，完全基于kreas-transformer。模型已上传，可直接跑。☆58May 1, 2020Updated 5 years ago
- keras implement of transformers for humans☆5,420Nov 11, 2024Updated last year
- Lookahead mechanism for optimizers in Keras.☆50Jun 24, 2021Updated 4 years ago
- A Lite BERT☆60Oct 28, 2019Updated 6 years ago
- Ordered Neurons LSTM☆30Jan 22, 2022Updated 4 years ago
- Neural Machine Translation with Keras☆530Jul 30, 2021Updated 4 years ago
- Implementation of Rectified Adam in Keras☆70Aug 24, 2019Updated 6 years ago
- Transformer-based models implemented in tensorflow 2.x(using keras).☆76Nov 23, 2021Updated 4 years ago
- Keras implementation of AdaBound☆130Nov 4, 2019Updated 6 years ago
- Graph convolutional layers☆62Jan 22, 2022Updated 4 years ago
- keras implement of dgcnn for reading comprehension☆164Oct 14, 2019Updated 6 years ago
- A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型☆3,986Nov 21, 2022Updated 3 years ago
- A simple implementation of Transformer Encoder in keras. This repository also includes an example of Transformer as a classifier and its …☆16Apr 9, 2019Updated 6 years ago
- 在Keras下微调Bert的一些例子；some examples of bert in keras☆657Oct 24, 2019Updated 6 years ago
- keras implementation of conditional random field☆247Feb 6, 2020Updated 6 years ago
- Text Classification and NLP in Tensorflow☆10Jul 20, 2018Updated 7 years ago