OverLordGoldDragon / keras-adamw
Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
☆167Updated 3 years ago
Alternatives and similar repositories for keras-adamw:
Users that are interested in keras-adamw are comparing it to the libraries listed below
- Lookahead mechanism for optimizers in Keras.☆49Updated 3 years ago
- RAdam implemented in Keras & TensorFlow☆325Updated 3 years ago
- AdamW optimizer for Keras☆115Updated 5 years ago
- Keras callback function for stochastic weight averaging☆56Updated 2 years ago
- lookahead optimizer for keras☆170Updated 5 years ago
- Keras implementation of AdaBound☆130Updated 5 years ago
- Implementation of Rectified Adam in Keras☆69Updated 5 years ago
- Keras Implementation of EfficientNets☆186Updated 5 years ago
- Learning rate multiplier☆46Updated 3 years ago
- keras implementation of AdamW from Fixing Weight Decay Regularization in Adam (https://arxiv.org/abs/1711.05101)☆70Updated 6 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆121Updated 5 years ago
- Implementation of One-Cycle Learning rate policy (adapted from Fast.ai lib)☆287Updated 4 years ago
- Keras implementation of Cosine Annealing Scheduler☆44Updated 5 years ago
- Plots the change of the loss function of a Keras model when the learning rate is exponentially increasing.☆255Updated 4 years ago
- Robust Bi-Tempered Logistic Loss Based on Bregman Divergences. https://arxiv.org/pdf/1906.03361.pdf☆148Updated 3 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 5 years ago
- Gradient accumulation for Keras☆35Updated 3 years ago
- A Tensorflow 2.0 implementation of TabNet.☆242Updated last year
- AdaBound optimizer in Keras☆56Updated 4 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆212Updated 5 years ago
- Binary and Categorical Focal loss implementation in Keras.☆279Updated 4 months ago
- Metrics for Keras. DEPRECATED since Keras 2.3.0☆164Updated 3 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 5 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 6 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 6 years ago
- Keras callbacks for one-cycle training, cyclic learning rate (CLR) training, and learning rate range test.☆47Updated 5 years ago
- Implements sharpness-aware minimization (https://arxiv.org/abs/2010.01412) in TensorFlow 2.☆60Updated 3 years ago
- (Minimally) implements SimCLR (https://arxiv.org/abs/2002.05709) in TensorFlow 2.☆90Updated 4 years ago
- Snapshot Ensemble in Keras☆308Updated 7 years ago
- DropBlock implemented in Keras☆26Updated 3 years ago