RAdam implemented in Keras & TensorFlow
☆324Jan 22, 2022Updated 4 years ago
Alternatives and similar repositories for keras-radam
Users that are interested in keras-radam are comparing it to the libraries listed below
Sorting:
- Lookahead mechanism for optimizers in Keras.☆50Jun 24, 2021Updated 4 years ago
- Implementation of Rectified Adam in Keras☆70Aug 24, 2019Updated 6 years ago
- On the Variance of the Adaptive Learning Rate and Beyond☆2,549Jul 31, 2021Updated 4 years ago
- lookahead optimizer for keras☆169Oct 14, 2019Updated 6 years ago
- Gradient accumulation for Keras☆35Jun 27, 2021Updated 4 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆169Jan 6, 2022Updated 4 years ago
- Implementation of XLNet that can load pretrained checkpoints☆169Jan 22, 2022Updated 4 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Apr 1, 2020Updated 5 years ago
- Implementation of EfficientNet model. Keras and TensorFlow Keras.☆2,101Jan 24, 2024Updated 2 years ago
- RAdam optimizer for keras☆71Oct 14, 2019Updated 6 years ago
- Keras implementation of NovoGrad☆20Aug 21, 2020Updated 5 years ago
- AdamW optimizer for Keras☆116Aug 9, 2019Updated 6 years ago
- Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase☆1,207Dec 22, 2023Updated 2 years ago
- Transformer-XL with checkpoint loader☆67Jan 22, 2022Updated 4 years ago
- Keras Implementation of MixNets: Mixed Depthwise Convolutions☆40Mar 30, 2020Updated 5 years ago
- Transformer implemented in Keras☆369Jan 22, 2022Updated 4 years ago
- ☆23Jun 27, 2019Updated 6 years ago
- Over9000 optimizer☆424Nov 22, 2022Updated 3 years ago
- Load GPT-2 checkpoint and generate texts☆127Jan 22, 2022Updated 4 years ago
- Useful extra functionality for TensorFlow 2.x maintained by SIG-addons☆1,708Sep 4, 2025Updated 6 months ago
- 📖The Big-&-Extending-Repository-of-Transformers: Pretrained PyTorch models for Google's BERT, OpenAI GPT & GPT-2, Google/CMU Transformer…☆16Jun 9, 2019Updated 6 years ago
- Learning rate multiplier☆46Jun 22, 2021Updated 4 years ago
- Keras Implementation of EfficientNets☆185Mar 17, 2020Updated 5 years ago
- Adaptive embedding and softmax☆17Jan 22, 2022Updated 4 years ago
- Lambda Networks implemented in PyTorch☆13Feb 22, 2021Updated 5 years ago
- Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"☆1,068Aug 9, 2024Updated last year
- This repository provides a class which can be used for the optimization of a tf.keras model. It combines the two optimizers Lookahead and…☆14Oct 26, 2024Updated last year
- Keras implementation of Global Context Attention blocks☆46Apr 29, 2019Updated 6 years ago
- Keras implementation of Cosine Annealing Scheduler☆43Apr 6, 2020Updated 5 years ago
- A Hyperparameter Tuning Library for Keras☆2,918Dec 1, 2025Updated 3 months ago
- ResBlock, DenseBlock and SpatialTransformer layers made with the Keras Layer API and TF2.0.☆16Jan 20, 2022Updated 4 years ago
- Interpretability Methods for tf.keras models with Tensorflow 2.x☆1,036Jun 3, 2024Updated last year
- Keras implementation of Attention Augmented Convolutional Neural Networks☆120Mar 6, 2020Updated 6 years ago
- A Tensorflow 2.0 implementation of TabNet.☆245Apr 27, 2023Updated 2 years ago
- Keras callback function for stochastic weight averaging☆56Jun 11, 2022Updated 3 years ago
- Keras implementation of BERT with pre-trained weights☆815Jul 26, 2019Updated 6 years ago
- Reference models and tools for Cloud TPUs.☆5,268Updated this week
- A Keras+TensorFlow Implementation of the Transformer: Attention Is All You Need☆713Sep 24, 2021Updated 4 years ago
- Implementation of Differential Learning Rate in Keras☆11Jun 4, 2019Updated 6 years ago