Adaptive gradient descent without descent
☆54Oct 12, 2021Updated 4 years ago
Alternatives and similar repositories for adaptive_GD
Users that are interested in adaptive_GD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)☆14Oct 20, 2023Updated 2 years ago
- Companion codes for the paper "Decentralized Frank-Wolfe Algorithm for Convex and Non-convex Problems", accepted by IEEE TAC☆12Oct 3, 2017Updated 8 years ago
- Proximal gradient algorithm for convex optimization, using a diagonal +/- rank-1 norm☆22Dec 27, 2024Updated last year
- Benchmarking optimization methods on convex problems.☆36Aug 8, 2025Updated last year
- Unconstrained optimization algorithms in python, line search and trust region methods☆18Dec 19, 2018Updated 7 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Official code for "Stochastic Localization via Iterative Posterior Sampling"☆13May 2, 2025Updated last year
- Frank-Wolfe算法和梯度投影法MATLAB实现☆15May 2, 2022Updated 4 years ago
- Anderson accelerated Douglas-Rachford splitting☆30Dec 11, 2020Updated 5 years ago
- PyTorch implementation of LARS (Layer-wise Adaptive Rate Scaling)☆20May 11, 2019Updated 7 years ago
- Optimization using Stochastic quasi-Newton methods☆42Feb 3, 2017Updated 9 years ago
- ☆37Feb 4, 2022Updated 4 years ago
- This repo contains the code used for NeurIPS 2019 paper "Asymmetric Valleys: Beyond Sharp and Flat Local Minima".☆14Oct 25, 2019Updated 6 years ago
- Matlab code for Chebyshev interpolation, including Smolyak algorithm☆17Dec 9, 2014Updated 11 years ago
- Code for ICML 2019 paper on "Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family Approximations"☆19Jan 2, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆34Jan 25, 2024Updated 2 years ago
- ☆10Aug 18, 2016Updated 10 years ago
- Prototype for a Category Theory-based GNN Library☆15Apr 20, 2022Updated 4 years ago
- Python-based Derivative-Free Optimizer for Least-Squares☆48Jul 22, 2026Updated 2 months ago
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆13May 31, 2023Updated 3 years ago
- FastAST - A fast primal-dual interior point method for line spectral estimation via atomic norm soft thresholding.☆31Jan 27, 2023Updated 3 years ago
- A collection of stochastic proximal gradient methods for composite non-convex problems.☆24Jun 17, 2020Updated 6 years ago
- Code for the paper "Robustness Certificates for Sparse Adversarial Attacks by Randomized Ablation" by Alexander Levine and Soheil Feizi.☆10Aug 22, 2022Updated 4 years ago
- Coordinate Descent Fuzzy Twin Support Vector Machine for Classification☆11Jan 13, 2018Updated 8 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Source code for "Taming GANs with Lookahead–Minmax", ICLR 2021.☆15Mar 28, 2021Updated 5 years ago
- Matlab/Octave toolbox for nonconvex optimization☆51Jun 23, 2016Updated 10 years ago
- Variational Factorization Machines☆17Dec 20, 2016Updated 9 years ago
- Implementation of Spectral Leakage and Rethinking the Kernel Size in CNNs in Pytorch☆14Feb 3, 2021Updated 5 years ago
- AdaX: Adaptive Gradient Descent with Exponential Long Term Momery☆34May 8, 2020Updated 6 years ago
- JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"☆19Jun 10, 2023Updated 3 years ago
- The performance of turbo equalizers in both ISI channel and multipath fading channel is evaluated☆12Nov 24, 2020Updated 5 years ago
- A quick test of SIREN on out-of-sample tasks☆13Jul 4, 2020Updated 6 years ago
- Nonlinear SVGD for Learning Diversified Mixture Models☆13Jan 23, 2019Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Python trust-region subproblem solvers for nonlinear optimization☆30Aug 21, 2026Updated last month
- ☆11Jul 27, 2018Updated 8 years ago
- Implementations of the algorithms described in the paper: On the Convergence Theory for Hessian-Free Bilevel Algorithms.☆11Nov 1, 2024Updated last year
- Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization☆181Nov 21, 2021Updated 4 years ago
- Matlab code for my paper "Copula Variational Bayes inference via information geometry", submitted to IEEE Trans. on information theory, 2…☆56Dec 21, 2018Updated 7 years ago
- ☆28Sep 3, 2019Updated 7 years ago
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆29Dec 22, 2020Updated 5 years ago