Rainymood / Gradient-Descent-The-Ultimate-OptimizerLinks
Paper and code for Gradient Descent: The Ultimate Optimizer
☆24Updated 2 years ago
Alternatives and similar repositories for Gradient-Descent-The-Ultimate-Optimizer
Users that are interested in Gradient-Descent-The-Ultimate-Optimizer are comparing it to the libraries listed below
Sorting:
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆47Updated 6 years ago
 - Partial implementation of ODE-GAN technique from the paper Training Generative Adversarial Networks by Solving Ordinary Differential Equa…☆16Updated 4 years ago
 - Source code for ICLR 2020 paper: "Learning to Guide Random Search"☆40Updated last year
 - The Singular Values of Convolutional Layers☆71Updated 7 years ago
 - Public Codebase for Rethinking Parameter Counting: Effective Dimensionality Revisited☆37Updated 2 years ago
 - Uncertainty Autoencoders, AISTATS 2019☆56Updated 6 years ago
 - Code for our ICLR Trustworthy ML 2020 workshop paper "Improved Image Wasserstein Attacks and Defenses"☆14Updated 5 years ago
 - NeurIPS 2019 Paper Implementation☆12Updated 2 years ago
 - A lightweight library for tensorflow 2.0☆66Updated 5 years ago
 - Ancestral Gumbel-Top-k Sampling☆25Updated 5 years ago
 - ☆45Updated 6 years ago
 - [NeurIPS'19] [PyTorch] Adaptive Regularization in NN☆68Updated 6 years ago
 - Official repository for our ICLR 2021 paper Evaluating the Disentanglement of Deep Generative Models with Manifold Topology☆36Updated 4 years ago
 - Implementation of the LOSSGRAD optimization algorithm☆15Updated 6 years ago
 - A minimal implementation of a VAE with BinConcrete (relaxed Bernoulli) latent distribution in TensorFlow.☆22Updated 5 years ago
 - A runtime shape checker and auto-annotator for tensor programs (pronounced "stanley")☆40Updated 5 years ago
 - PyTorch Impl. of Prediction Optimizer (to stabilize GAN training)☆31Updated 7 years ago
 - ☆12Updated 5 years ago
 - Code base for SRSGD.☆29Updated 5 years ago
 - Implements stochastic line search☆118Updated 2 years ago
 - Code for our paper: "Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers".☆21Updated 3 years ago
 - ☆13Updated 5 years ago
 - Python implementation of projection losses.☆27Updated 5 years ago
 - A clean TensorFlow implementation of Concrete Dropout☆22Updated 7 years ago
 - Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthog…☆17Updated 6 years ago
 - TBA☆77Updated 6 years ago
 - Repository with code for paper "Inhibited Softmax for Uncertainty Estimation in Neural Networks"☆25Updated 6 years ago
 - ☆50Updated 5 years ago
 - Padé Activation Units: End-to-end Learning of Activation Functions in Deep Neural Network☆63Updated 4 years ago
 - Lua implementation of Entropy-SGD☆81Updated 7 years ago