CyberZHG / keras-adabound
AdaBound optimizer in Keras
☆56Updated 4 years ago
Alternatives and similar repositories for keras-adabound:
Users that are interested in keras-adabound are comparing it to the libraries listed below
- Lookahead mechanism for optimizers in Keras.☆49Updated 3 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 5 years ago
- Keras implementation of AdaBound☆130Updated 5 years ago
- Implementation in Keras of: Snapshot Ensembles: Train 1, get M for free (https://arxiv.org/abs/1704.00109)☆25Updated 6 years ago
- AdamW optimizer for Keras☆114Updated 5 years ago
- Learning rate multiplier☆46Updated 3 years ago
- Layer normalization implemented in Keras☆60Updated 3 years ago
- A pytorch based classification experiments template☆46Updated 3 years ago
- Implementation of Rectified Adam in Keras☆69Updated 5 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆167Updated 3 years ago
- RAdam optimizer for keras☆71Updated 5 years ago
- Adaptive embedding and softmax☆17Updated 3 years ago
- keras implementation of AdamW from Fixing Weight Decay Regularization in Adam (https://arxiv.org/abs/1711.05101)☆70Updated 6 years ago
- Keras implementation of Padam from "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks"☆17Updated 6 years ago
- Corrupted labels and label smoothing☆128Updated 7 years ago
- A Keras inspired training utility for PyTorch☆38Updated 6 years ago
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 4 years ago
- Gradient accumulation for Keras☆35Updated 3 years ago
- ☆86Updated last year
- PyTorch implementation of the NIPS'17 paper Training Deep Networks without Learning Rates Through Coin Betting.☆37Updated 6 years ago
- 17th place solution in "Google Landmark Retrieval Challenge"☆6Updated 5 years ago
- PyTorch Flexible Hash Embeddings☆28Updated 5 years ago
- Preparing continuous features for neural networks with GaussRank☆45Updated 7 years ago
- Transformer-XL with checkpoint loader☆68Updated 3 years ago
- Attention based sequence to sequence neural machine translation model built in keras.☆30Updated 6 years ago
- lookahead optimizer for keras☆170Updated 5 years ago
- Simple Tensorflow implementation of "Adaptive Gradient Methods with Dynamic Bound of Learning Rate" (ICLR 2019)☆150Updated 5 years ago
- An optimizer that trains as fast as Adam and as good as SGD in Tensorflow☆45Updated 5 years ago
- ☆13Updated 7 years ago
- ☆24Updated 6 years ago