kozistr / AdaBound-tensorflow
An optimizer that trains as fast as Adam and as good as SGD in Tensorflow
☆45Updated 5 years ago
Alternatives and similar repositories for AdaBound-tensorflow:
Users that are interested in AdaBound-tensorflow are comparing it to the libraries listed below
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 4 years ago
- Corrupted labels and label smoothing☆128Updated 7 years ago
- MNIST classification using Multi-Layer Perceptron (MLP) with 2 hidden layers. Some weight-initializers and batch-normalization are implem…☆54Updated 8 years ago
- Stochastic Weight Averaging - TensorFlow implementation☆33Updated 5 years ago
- Keras callback function for stochastic weight averaging☆55Updated 2 years ago
- Switch Normalization implementation for Keras 2+☆30Updated 6 years ago
- Keras implementation of AdaBound☆130Updated 5 years ago
- Keras implementation of Padam from "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks"☆17Updated 6 years ago
- Implementation of Rectified Adam in Keras☆69Updated 5 years ago
- RAdam optimizer for keras☆71Updated 5 years ago
- Samples for Multi GPUs in TensorFlow☆83Updated 7 years ago
- tunz's CUDA pytorch operator (MaskedSoftmax)☆75Updated 5 years ago
- Lookahead mechanism for optimizers in Keras.☆49Updated 3 years ago
- Octave convolution☆34Updated 2 years ago
- AdaBound optimizer in Keras☆56Updated 4 years ago
- Implementation in Keras of: Snapshot Ensembles: Train 1, get M for free (https://arxiv.org/abs/1704.00109)☆25Updated 6 years ago
- A specially designed light version of Fast AutoAugment☆172Updated 4 years ago
- All Model summary in PyTorch similar to `model.summary()` in Keras☆87Updated 5 years ago
- keras implementation of AdamW from Fixing Weight Decay Regularization in Adam (https://arxiv.org/abs/1711.05101)☆70Updated 6 years ago
- A TensorFlow implementation of Group Normalization on the task of image classification☆209Updated 6 years ago
- Keras implementation of Octave Convolutions☆53Updated 5 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆212Updated 5 years ago
- Keras implementation of NovoGrad☆20Updated 4 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 5 years ago
- tensorflow implementation of Exploring Randomly Wired Neural Networks for Image Recognition☆31Updated 5 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆76Updated 5 years ago
- AdaBatch: Adaptive Batch Sizes for Training Deep Neural Networks☆41Updated 7 years ago
- Implementation of tools to control and monitor layer rotation in different DL libraries☆40Updated 5 years ago
- lookahead optimizer for keras☆170Updated 5 years ago
- Unsupervised Anomaly Detection via Deep Metric Learning with End-to-End Optimization☆13Updated last year