OverLordGoldDragon / keras-adamw
Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
☆167Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for keras-adamw
- AdamW optimizer for Keras☆114Updated 5 years ago
- Lookahead mechanism for optimizers in Keras.☆49Updated 3 years ago
- Keras implementation of AdaBound☆130Updated 5 years ago
- Learning rate multiplier☆46Updated 3 years ago
- RAdam implemented in Keras & TensorFlow☆325Updated 2 years ago
- lookahead optimizer for keras☆170Updated 5 years ago
- Implementation of Rectified Adam in Keras☆69Updated 5 years ago
- Metrics for Keras. DEPRECATED since Keras 2.3.0☆164Updated 2 years ago
- AdaBound optimizer in Keras☆57Updated 4 years ago
- Keras callback function for stochastic weight averaging☆55Updated 2 years ago
- keras implementation of AdamW from Fixing Weight Decay Regularization in Adam (https://arxiv.org/abs/1711.05101)☆70Updated 6 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆160Updated 4 years ago
- Keras implementation of Cosine Annealing Scheduler☆44Updated 4 years ago
- Keras implementation of Attention Augmented Convolutional Neural Networks☆120Updated 4 years ago
- pytorch implement of Lookahead Optimizer☆188Updated 2 years ago
- Implementation of One-Cycle Learning rate policy (adapted from Fast.ai lib)☆285Updated 4 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 5 years ago
- TensorFlow implementation of focal loss☆186Updated 3 years ago
- Robust Bi-Tempered Logistic Loss Based on Bregman Divergences. https://arxiv.org/pdf/1906.03361.pdf☆147Updated 2 years ago
- Over9000 optimizer☆425Updated last year
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆211Updated 5 years ago
- Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs☆116Updated 5 years ago
- Keras Implementation of EfficientNets☆187Updated 4 years ago
- Creates a learning-curve plot for Jupyter/Colab notebooks that is updated in real-time.☆175Updated 2 years ago
- An implementation of DropConnect Layer in Keras☆36Updated 4 years ago
- Gradient accumulation for Keras☆35Updated 3 years ago
- Binary and Categorical Focal loss implementation in Keras.☆278Updated last year
- Simple stochastic weight averaging callback for Keras☆63Updated 3 years ago
- Layer normalization implemented in Keras☆60Updated 2 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 4 years ago