kozistr / AdaBound-tensorflowLinks
An optimizer that trains as fast as Adam and as good as SGD in Tensorflow
☆45Updated 6 years ago
Alternatives and similar repositories for AdaBound-tensorflow
Users that are interested in AdaBound-tensorflow are comparing it to the libraries listed below
Sorting:
- Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"☆97Updated 5 years ago
- Corrupted labels and label smoothing☆129Updated 7 years ago
- Simple Tensorflow implementation of "On the Convergence of Adam and Beyond" (ICLR 2018)☆104Updated 6 years ago
- Simple Tensorflow implementation of "Adaptive Gradient Methods with Dynamic Bound of Learning Rate" (ICLR 2019)☆150Updated 6 years ago
- tunz's CUDA pytorch operator (MaskedSoftmax)☆75Updated 6 years ago
- A specially designed light version of Fast AutoAugment☆171Updated 5 years ago
- Samples for Multi GPUs in TensorFlow☆83Updated 7 years ago
- Keras implementation of AdaBound☆130Updated 5 years ago
- All Model summary in PyTorch similar to `model.summary()` in Keras☆88Updated 6 years ago
- lookahead optimizer for keras☆171Updated 5 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 6 years ago
- keras implementation of AdamW from Fixing Weight Decay Regularization in Adam (https://arxiv.org/abs/1711.05101)☆71Updated 7 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 6 years ago
- AdamW optimizer for Keras☆115Updated 6 years ago
- PyTorch DataLoader processed in multiple remote computation machines for heavy data processings☆67Updated 5 years ago
- AdaBound optimizer in Keras☆56Updated 5 years ago
- Keras implementation of Global Context Attention blocks☆46Updated 6 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆213Updated 6 years ago
- Stochastic Weight Averaging - TensorFlow implementation☆33Updated 6 years ago
- pytorch implement of Lookahead Optimizer☆194Updated 3 years ago
- MNIST classification using Multi-Layer Perceptron (MLP) with 2 hidden layers. Some weight-initializers and batch-normalization are implem…☆55Updated 8 years ago
- Implementation and experiments for AdamW on Pytorch☆94Updated 5 years ago
- TensorFlow implementations of Wasserstein GAN with Gradient Penalty (WGAN-GP), Least Squares GAN (LSGAN), GANs with the hinge loss.☆44Updated 6 years ago
- Octave convolution☆34Updated 3 years ago
- Implementation in Keras of: Snapshot Ensembles: Train 1, get M for free (https://arxiv.org/abs/1704.00109)☆26Updated 6 years ago
- Compare outputs between layers written in Tensorflow and layers written in Pytorch☆72Updated 7 years ago
- The codes for recent knowledge distillation algorithms and benchmark results via TF2.0 low-level API☆112Updated 3 years ago
- Keras callback function for stochastic weight averaging☆56Updated 3 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆169Updated 3 years ago
- Efficient Neural Architecture search via parameter sharing(ENAS) micro search Tensorflow code for windows user☆115Updated 7 years ago