Adaptive gradient descent without descent
☆54Oct 12, 2021Updated 5 years ago
Alternatives and similar repositories for adaptive_GD
Users that are interested in adaptive_GD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Benchmarking optimization methods on convex problems.☆36Aug 8, 2025Updated last year
- The code for the article ''Alternating Direction Method of Multipliers Based on ℓ2,0-Norm for Multiple Measurement Vector Problem''☆13Jul 18, 2025Updated last year
- Proximal Newton OPTimizer☆23Mar 12, 2015Updated 11 years ago
- Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)☆14Oct 20, 2023Updated 3 years ago
- MATLAB MEX implementation of SVRG-SBB algorithms☆12Nov 28, 2017Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Companion codes for the paper "Decentralized Frank-Wolfe Algorithm for Convex and Non-convex Problems", accepted by IEEE TAC☆12Oct 3, 2017Updated 9 years ago
- Train SN-GAN with AdaBelief☆11Aug 11, 2021Updated 5 years ago
- Proximal gradient algorithm for convex optimization, using a diagonal +/- rank-1 norm☆22Dec 27, 2024Updated last year
- Unconstrained optimization algorithms in python, line search and trust region methods☆18Dec 19, 2018Updated 7 years ago
- Code for the paper "Understanding the Role of Momentum in Stochastic Gradient Methods"☆14Oct 27, 2019Updated 7 years ago
- ☆11Jun 2, 2021Updated 5 years ago
- The Newton-Muon optimizer☆35Jun 5, 2026Updated 5 months ago
- ☆24Jun 1, 2025Updated last year
- Frank-Wolfe算法和梯度投影法MATLAB实现☆15May 2, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Powered Stochastic Gradient Descent Methods for AcceleratedNonconvex Optimization☆22Jul 26, 2020Updated 6 years ago
- source for Stochastic Conjugate Gradient Algorithm with Variance Reduction☆10Nov 22, 2017Updated 8 years ago
- Nonconvex Regularized Robust Regression via I-LAMM Algorithm☆13May 9, 2022Updated 4 years ago
- ☆10Jun 16, 2020Updated 6 years ago
- PyTorch implementation of LARS (Layer-wise Adaptive Rate Scaling)☆20May 11, 2019Updated 7 years ago
- ☆37Feb 4, 2022Updated 4 years ago
- This repo contains the code used for NeurIPS 2019 paper "Asymmetric Valleys: Beyond Sharp and Flat Local Minima".☆14Oct 25, 2019Updated 7 years ago
- Code for Manifold VB☆10Apr 25, 2023Updated 3 years ago
- An Image Reconstructor that applies fast proximal gradient method (FISTA) to the wavelet transform of an image using L1 and Total Variati…☆11Sep 25, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The MATLAB source code☆15Dec 2, 2019Updated 6 years ago
- ☆11Updated this week
- 安卓跨Activity/Fragment/Service间即时传递数据，基于安卓MVVM，支持分屏&文档模式，支持自动释放☆11Jun 15, 2022Updated 4 years ago
- L4: Practical loss-based stepsize adaptation for PyTorch☆18May 7, 2021Updated 5 years ago
- BFO (Brute-Force Optimizer), a Matlab package to solve unconstrained or bound-constrained optimization in continuous and/or discrete and/…☆18Jul 10, 2022Updated 4 years ago
- Benchmarking Optimizers for LLM Pretraining. NeurIPS 2026, EurIPS 2025☆61May 3, 2026Updated 6 months ago
- Hypergradient descent☆148May 31, 2024Updated 2 years ago
- A Survey on Nonconvex Regularization Based Sparse and Low-Rank Recovery in Signal Processing, Statistics, and Machine Learning☆38Dec 19, 2019Updated 6 years ago
- A tensorflow implementation of the NIPS 2018 paper "Variational Inference with Tail-adaptive f-Divergence"☆20Jan 11, 2019Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Uniform sampling under linear equality and inequality constraints☆10Mar 16, 2020Updated 6 years ago
- Repository for the paper "BONE: a unifying framework for Bayesian online learning in non-stationary environments"☆23Apr 9, 2026Updated 6 months ago
- Code for ICML 2019 paper on "Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family Approximations"☆19Jan 2, 2021Updated 5 years ago
- Matlab code for Chebyshev interpolation, including Smolyak algorithm☆17Dec 9, 2014Updated 11 years ago
- Application and framework for executing and testing numerical optimization methods. State of the art algorithms such as l-bfgs, cg_descen…☆38Apr 1, 2020Updated 6 years ago
- ☆10Aug 18, 2016Updated 10 years ago
- ☆34Jan 25, 2024Updated 2 years ago