taki0112 / RAdam-Tensorflow
Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond"
☆97Updated 5 years ago
Alternatives and similar repositories for RAdam-Tensorflow:
Users that are interested in RAdam-Tensorflow are comparing it to the libraries listed below
- Simple Tensorflow implementation of "Adaptive Gradient Methods with Dynamic Bound of Learning Rate" (ICLR 2019)☆150Updated 5 years ago
- Implementation of Rectified Adam in Keras☆69Updated 5 years ago
- Code for paper: "Support Vector Machines, Wasserstein's distance and gradient-penalty GANs maximize a margin"☆178Updated 5 years ago
- Simple Tensorflow implementation of "Partial Convolution based Padding" (partialconv)☆91Updated 6 years ago
- A set of simple examples ported from PyTorch for Tensorflow Eager Execution☆73Updated 6 years ago
- Corrupted labels and label smoothing☆128Updated 7 years ago
- TensorFlow implementations of Wasserstein GAN with Gradient Penalty (WGAN-GP), Least Squares GAN (LSGAN), GANs with the hinge loss.☆44Updated 5 years ago
- Simple Tensorflow implementation of SphereGAN (CVPR 2019 Oral)☆56Updated 5 years ago
- Python way to Read/Write TFRecords☆64Updated 6 years ago
- Simple Tensorflow implementation of "On the Convergence of Adam and Beyond" (ICLR 2018)☆104Updated 6 years ago
- Implementation of tools to control and monitor layer rotation in different DL libraries☆40Updated 5 years ago
- Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"☆75Updated 6 years ago
- Lookahead mechanism for optimizers in Keras.☆49Updated 3 years ago
- Keras implementation of Octave Convolutions☆53Updated 5 years ago
- A simpler version of the self-attention layer from SAGAN, and some image classification results.☆212Updated 5 years ago
- Keras callback function for stochastic weight averaging☆56Updated 2 years ago
- Mish Deep Learning Activation Function for PyTorch / FastAI☆161Updated 5 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 6 years ago
- Compare outputs between layers written in Tensorflow and layers written in Pytorch☆72Updated 6 years ago
- Code for reproducing results of the paper "Layer rotation: a surprisingly powerful indicator of generalization in deep networks?"☆50Updated 5 years ago
- Stochastic Weight Averaging - TensorFlow implementation☆33Updated 6 years ago
- keras implementation of AdamW from Fixing Weight Decay Regularization in Adam (https://arxiv.org/abs/1711.05101)☆70Updated 6 years ago
- An optimizer that trains as fast as Adam and as good as SGD in Tensorflow☆45Updated 5 years ago
- GAN-QP: A Novel GAN Framework without Gradient Vanishing and Lipschitz Constraint☆119Updated 5 years ago
- Simple Tensorflow implementation of "Image-to-Image Translation via Group-wise Deep Whitening-and-Coloring Transformation" (CVPR 2019 Ora…☆56Updated 5 years ago
- AdamW optimizer for Keras☆115Updated 5 years ago
- Switch Normalization implementation for Keras 2+☆30Updated 6 years ago
- Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers☆167Updated 3 years ago
- Using the CLR algorithm for training (https://arxiv.org/abs/1506.01186)☆108Updated 6 years ago
- Simple Tensorflow implementation of RelativisticGAN☆50Updated 6 years ago