RAdam implemented in Keras & TensorFlow
☆324Jan 22, 2022Updated 4 years ago
Alternatives and similar repositories for keras-radam
Users that are interested in keras-radam are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lookahead mechanism for optimizers in Keras.☆50Jun 24, 2021Updated 5 years ago
- Implementation of Rectified Adam in Keras☆70Aug 24, 2019Updated 7 years ago
- On the Variance of the Adaptive Learning Rate and Beyond☆2,548Jul 31, 2021Updated 5 years ago
- lookahead optimizer for keras☆168Oct 14, 2019Updated 6 years ago
- Gradient accumulation for Keras☆35Jun 27, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆168Jan 6, 2022Updated 4 years ago
- Implementation of XLNet that can load pretrained checkpoints☆169Jan 22, 2022Updated 4 years ago
- Implementation of EfficientNet model. Keras and TensorFlow Keras.☆2,098Jan 24, 2024Updated 2 years ago
- AdamW optimizer for Keras☆116Aug 9, 2019Updated 7 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Apr 1, 2020Updated 6 years ago
- RAdam optimizer for keras☆71Oct 14, 2019Updated 6 years ago
- Keras Implementation of MixNets: Mixed Depthwise Convolutions☆40Mar 30, 2020Updated 6 years ago
- Transformer-XL with checkpoint loader☆67Jan 22, 2022Updated 4 years ago
- Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase☆1,203Dec 22, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Keras implementation of NovoGrad☆20Aug 21, 2020Updated 6 years ago
- Useful extra functionality for TensorFlow 2.x maintained by SIG-addons☆1,698Sep 4, 2025Updated last year
- Over9000 optimizer☆424Nov 22, 2022Updated 3 years ago
- 📖The Big-&-Extending-Repository-of-Transformers: Pretrained PyTorch models for Google's BERT, OpenAI GPT & GPT-2, Google/CMU Transformer…☆16Jun 9, 2019Updated 7 years ago
- ☆23Jun 27, 2019Updated 7 years ago
- Adaptive embedding and softmax☆17Jan 22, 2022Updated 4 years ago
- Transformer implemented in Keras☆368Jan 22, 2022Updated 4 years ago
- Learning rate multiplier☆46Jun 22, 2021Updated 5 years ago
- Keras implementation of Cosine Annealing Scheduler☆43Apr 6, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Keras Implementation of EfficientNets☆183Mar 17, 2020Updated 6 years ago
- Load GPT-2 checkpoint and generate texts☆127Jan 22, 2022Updated 4 years ago
- Layer-wise Adaptive Moments optimizer for Batch training☆15Apr 3, 2019Updated 7 years ago
- A Hyperparameter Tuning Library for Keras☆2,922Dec 1, 2025Updated 9 months ago
- wrapping a keras optimizer to implement gradient accumulation☆118Aug 29, 2020Updated 6 years ago
- ResBlock, DenseBlock and SpatialTransformer layers made with the Keras Layer API and TF2.0.☆16Jan 20, 2022Updated 4 years ago
- Lambda Networks implemented in PyTorch☆13Feb 22, 2021Updated 5 years ago
- Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"☆1,069Aug 9, 2024Updated 2 years ago
- Keras callback function for stochastic weight averaging☆56Jun 11, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- keras implementation of AdamW from Fixing Weight Decay Regularization in Adam (https://arxiv.org/abs/1711.05101)☆71Jul 23, 2018Updated 8 years ago
- Official Repository for "Mish: A Self Regularized Non-Monotonic Neural Activation Function" [BMVC 2020]☆1,298Jul 20, 2026Updated 2 months ago
- An implementation of "mixup: Beyond Empirical Risk Minimization"☆285Nov 5, 2017Updated 8 years ago
- Interpretability Methods for tf.keras models with Tensorflow 2.x☆1,035Jun 3, 2024Updated 2 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆120Mar 6, 2020Updated 6 years ago
- Keras implementation of BERT with pre-trained weights☆812Jul 26, 2019Updated 7 years ago
- Keras library for building (Universal) Transformers, facilitating BERT and GPT models☆540May 30, 2020Updated 6 years ago