CyberZHG / keras-lookahead
Lookahead mechanism for optimizers in Keras.
☆49Updated 3 years ago
Alternatives and similar repositories for keras-lookahead:
Users that are interested in keras-lookahead are comparing it to the libraries listed below
- Learning rate multiplier☆46Updated 3 years ago
- AdamW optimizer for Keras☆114Updated 5 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆167Updated 3 years ago
- RAdam implemented in Keras & TensorFlow☆325Updated 3 years ago
- Gradient accumulation for Keras☆35Updated 3 years ago
- AdaBound optimizer in Keras☆56Updated 4 years ago
- Implementation of Rectified Adam in Keras☆69Updated 5 years ago
- lookahead optimizer for keras☆170Updated 5 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 5 years ago
- Keras implementation of AdaBound☆130Updated 5 years ago
- Keras callback function for stochastic weight averaging☆56Updated 2 years ago
- ☆86Updated last year
- keras implementation of AdamW from Fixing Weight Decay Regularization in Adam (https://arxiv.org/abs/1711.05101)☆70Updated 6 years ago
- Corrupted labels and label smoothing☆128Updated 7 years ago
- RAdam optimizer for keras☆71Updated 5 years ago
- Implementation in Keras of: Snapshot Ensembles: Train 1, get M for free (https://arxiv.org/abs/1704.00109)☆25Updated 6 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 4 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 5 years ago
- Keras implementation of Cosine Annealing Scheduler☆44Updated 4 years ago
- Layer normalization implemented in Keras☆60Updated 3 years ago
- wrapping a keras optimizer to implement gradient accumulation☆119Updated 4 years ago
- Attention based sequence to sequence neural machine translation model built in keras.☆30Updated 6 years ago
- Bag of Tricks for Image Classification with Convolutional Neural Networks in Keras☆63Updated 6 years ago
- An implementation of DropConnect Layer in Keras☆36Updated 5 years ago
- Kaggle | 14th place solution for TGS Salt Identification Challenge☆76Updated 4 years ago
- ☆43Updated 6 years ago
- Code for the CHAMPS Predicting Molecular Properties Kaggle competition☆51Updated 5 years ago
- pytorch implement of Lookahead Optimizer☆189Updated 2 years ago
- A script for balancing predictions which helps in achieving high results on Kaggle☆118Updated 6 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 4 years ago