mhmoodlan / cyclic-learning-rateLinks
Cyclic learning rate TensorFlow implementation.
☆66Updated 6 years ago
Alternatives and similar repositories for cyclic-learning-rate
Users that are interested in cyclic-learning-rate are comparing it to the libraries listed below
Sorting:
- lookahead optimizer for keras☆171Updated 6 years ago
- Corrupted labels and label smoothing☆129Updated 8 years ago
- Knowledge Distillation using Tensorflow☆142Updated 6 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 5 years ago
- Using the CLR algorithm for training (https://arxiv.org/abs/1506.01186)☆108Updated 7 years ago
- A lightweight class for saving the best Tensorflow checkpoints.☆103Updated 6 years ago
- Simple Tensorflow implementation of "Adaptive Gradient Methods with Dynamic Bound of Learning Rate" (ICLR 2019)☆150Updated 6 years ago
- Focal Loss of multi-classification in tensorflow☆81Updated 6 years ago
- Experiments with Adam/AdamW/amsgrad☆201Updated 7 years ago
- A machine learning experiment☆180Updated 8 years ago
- AdamW optimizer for Keras☆115Updated 6 years ago
- Keras implementation of AdaBound☆130Updated 6 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆168Updated 3 years ago
- A set of simple examples ported from PyTorch for Tensorflow Eager Execution☆73Updated 7 years ago
- tf.keras + tf.data with Eager Execution☆74Updated 6 years ago
- pytorch implement of Lookahead Optimizer☆195Updated 3 years ago
- EfficientNets snapshot☆90Updated 6 years ago
- wrapping a keras optimizer to implement gradient accumulation☆119Updated 5 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 6 years ago
- Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)☆265Updated 5 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆214Updated 6 years ago
- Learning rate multiplier☆46Updated 4 years ago
- Notebook for my medium article about how to use Dataset API in TensorFlow☆155Updated 7 years ago
- Complementary code for the Targeted Dropout paper☆255Updated 6 years ago
- fast.ai starter kit for Google Landmark Retrieval 2019 challenge☆61Updated 6 years ago
- Lookahead optimizer ("Lookahead Optimizer: k steps forward, 1 step back") for tensorflow☆25Updated 6 years ago
- A script for balancing predictions which helps in achieving high results on Kaggle☆117Updated 6 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 5 years ago
- RAdam optimizer for keras☆71Updated 6 years ago
- A specially designed light version of Fast AutoAugment☆171Updated 5 years ago