mhmoodlan / cyclic-learning-rateLinks
Cyclic learning rate TensorFlow implementation.
☆66Updated 6 years ago
Alternatives and similar repositories for cyclic-learning-rate
Users that are interested in cyclic-learning-rate are comparing it to the libraries listed below
Sorting:
- Corrupted labels and label smoothing☆129Updated 8 years ago
- lookahead optimizer for keras☆171Updated 6 years ago
- Knowledge Distillation using Tensorflow☆141Updated 6 years ago
- Focal Loss of multi-classification in tensorflow☆80Updated 6 years ago
- wrapping a keras optimizer to implement gradient accumulation☆119Updated 5 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 5 years ago
- A lightweight class for saving the best Tensorflow checkpoints.☆103Updated 7 years ago
- AdamW optimizer for Keras☆116Updated 6 years ago
- Simple Tensorflow implementation of "Adaptive Gradient Methods with Dynamic Bound of Learning Rate" (ICLR 2019)☆150Updated 6 years ago
- Using the CLR algorithm for training (https://arxiv.org/abs/1506.01186)☆108Updated 7 years ago
- Notebook for my medium article about how to use Dataset API in TensorFlow☆155Updated 7 years ago
- All Model summary in PyTorch similar to `model.summary()` in Keras☆88Updated 6 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 6 years ago
- EfficientNets snapshot☆91Updated 6 years ago
- A machine learning experiment☆180Updated 8 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆169Updated 4 years ago
- Experiments with Adam/AdamW/amsgrad☆201Updated 7 years ago
- Blog https://medium.com/neuralmachine/knowledge-distillation-dc241d7c2322☆60Updated 7 years ago
- Mixture of experts layers for Keras☆94Updated 7 years ago
- pytorch implement of Lookahead Optimizer☆195Updated 3 years ago
- Octave convolution☆34Updated 3 years ago
- A specially designed light version of Fast AutoAugment☆171Updated 5 years ago
- Complementary code for the Targeted Dropout paper☆255Updated 6 years ago
- RAdam optimizer for keras☆71Updated 6 years ago
- Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)☆265Updated 6 years ago
- An implementation of DropConnect Layer in Keras☆36Updated 6 years ago
- Try to use tf.estimator and tf.data together to train a cnn model.☆77Updated 7 years ago
- ☆169Updated 4 years ago
- An optimizer that trains as fast as Adam and as good as SGD in Tensorflow☆46Updated 6 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆214Updated 6 years ago