RAdam implemented in Keras & TensorFlow
☆324Jan 22, 2022Updated 4 years ago
Alternatives and similar repositories for keras-radam
Users that are interested in keras-radam are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lookahead mechanism for optimizers in Keras.☆50Jun 24, 2021Updated 4 years ago
- Implementation of Rectified Adam in Keras☆70Aug 24, 2019Updated 6 years ago
- On the Variance of the Adaptive Learning Rate and Beyond☆2,551Jul 31, 2021Updated 4 years ago
- lookahead optimizer for keras☆169Oct 14, 2019Updated 6 years ago
- Gradient accumulation for Keras☆35Jun 27, 2021Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆169Jan 6, 2022Updated 4 years ago
- Implementation of XLNet that can load pretrained checkpoints☆169Jan 22, 2022Updated 4 years ago
- AdamW optimizer for Keras☆116Aug 9, 2019Updated 6 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Apr 1, 2020Updated 6 years ago
- RAdam optimizer for keras☆71Oct 14, 2019Updated 6 years ago
- Keras Implementation of MixNets: Mixed Depthwise Convolutions☆40Mar 30, 2020Updated 6 years ago
- Transformer-XL with checkpoint loader☆67Jan 22, 2022Updated 4 years ago
- Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase☆1,206Dec 22, 2023Updated 2 years ago
- Keras implementation of NovoGrad☆20Aug 21, 2020Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Useful extra functionality for TensorFlow 2.x maintained by SIG-addons☆1,706Sep 4, 2025Updated 7 months ago
- Over9000 optimizer☆424Nov 22, 2022Updated 3 years ago
- 📖The Big-&-Extending-Repository-of-Transformers: Pretrained PyTorch models for Google's BERT, OpenAI GPT & GPT-2, Google/CMU Transformer…☆16Jun 9, 2019Updated 6 years ago
- ☆23Jun 27, 2019Updated 6 years ago
- Adaptive embedding and softmax☆17Jan 22, 2022Updated 4 years ago
- Transformer implemented in Keras☆368Jan 22, 2022Updated 4 years ago
- Learning rate multiplier☆46Jun 22, 2021Updated 4 years ago
- Keras implementation of Cosine Annealing Scheduler☆43Apr 6, 2020Updated 6 years ago
- This repository provides a class which can be used for the optimization of a tf.keras model. It combines the two optimizers Lookahead and…☆14Oct 26, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Load GPT-2 checkpoint and generate texts☆127Jan 22, 2022Updated 4 years ago
- Layer-wise Adaptive Moments optimizer for Batch training☆15Apr 3, 2019Updated 7 years ago
- A Hyperparameter Tuning Library for Keras☆2,925Dec 1, 2025Updated 4 months ago
- wrapping a keras optimizer to implement gradient accumulation☆119Aug 29, 2020Updated 5 years ago
- ResBlock, DenseBlock and SpatialTransformer layers made with the Keras Layer API and TF2.0.☆16Jan 20, 2022Updated 4 years ago
- Keras callback function for stochastic weight averaging☆56Jun 11, 2022Updated 3 years ago
- Lambda Networks implemented in PyTorch☆13Feb 22, 2021Updated 5 years ago
- Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"☆1,072Aug 9, 2024Updated last year
- A Tensorflow 2.0 implementation of TabNet.☆245Apr 27, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Simple metric learning methods via tf.keras☆19Aug 25, 2020Updated 5 years ago
- Keras implementation of BERT with pre-trained weights☆815Jul 26, 2019Updated 6 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆120Mar 6, 2020Updated 6 years ago
- Interpretability Methods for tf.keras models with Tensorflow 2.x☆1,036Jun 3, 2024Updated last year
- An implementation of "mixup: Beyond Empirical Risk Minimization"☆285Nov 5, 2017Updated 8 years ago
- Official Repository for "Mish: A Self Regularized Non-Monotonic Neural Activation Function" [BMVC 2020]☆1,301Apr 8, 2026Updated last week
- keras implementation of AdamW from Fixing Weight Decay Regularization in Adam (https://arxiv.org/abs/1711.05101)☆71Jul 23, 2018Updated 7 years ago