Adaptive gradient descent without descent
☆53Oct 12, 2021Updated 4 years ago
Alternatives and similar repositories for adaptive_GD
Users that are interested in adaptive_GD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)☆14Oct 20, 2023Updated 2 years ago
- Companion codes for the paper "Decentralized Frank-Wolfe Algorithm for Convex and Non-convex Problems", accepted by IEEE TAC☆12Oct 3, 2017Updated 8 years ago
- MATLAB MEX implementation of SVRG-SBB algorithms☆12Nov 28, 2017Updated 8 years ago
- Proximal gradient algorithm for convex optimization, using a diagonal +/- rank-1 norm☆22Dec 27, 2024Updated last year
- Benchmarking optimization methods on convex problems.☆36Aug 8, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Nonconvex Regularized Robust Regression via I-LAMM Algorithm☆13May 9, 2022Updated 4 years ago
- Frank-Wolfe算法和梯度投影法MATLAB实现☆15May 2, 2022Updated 4 years ago
- Code for Non-convex Learning via Replica Exchange Stochastic Gradient MCMC, ICML 2020.☆26Dec 3, 2020Updated 5 years ago
- PyTorch implementation of LARS (Layer-wise Adaptive Rate Scaling)☆20May 11, 2019Updated 7 years ago
- ☆10Jun 16, 2020Updated 6 years ago
- ☆37Feb 4, 2022Updated 4 years ago
- MATLAB implementations of a variety of machine learning/signal processing algorithms.☆11Aug 24, 2016Updated 10 years ago
- ☆11Apr 8, 2016Updated 10 years ago
- Code for ICML 2019 paper on "Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family Approximations"☆19Jan 2, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A tensorflow implementation of the NIPS 2018 paper "Variational Inference with Tail-adaptive f-Divergence"☆20Jan 11, 2019Updated 7 years ago
- 最优化方法、凸优化课程作业代码☆18Jan 31, 2020Updated 6 years ago
- Fast algorithms for sparse principal component analysis☆18Aug 5, 2016Updated 10 years ago
- SBL matlab code☆26Nov 20, 2019Updated 6 years ago
- Code to accompany: https://arxiv.org/abs/2001.08349☆11Jul 6, 2023Updated 3 years ago
- basic implementation of a bunch of optimization algorithms☆13Jul 7, 2017Updated 9 years ago
- Repository containing seminars from 2020 Machine Learning course☆14Aug 3, 2022Updated 4 years ago
- Prototype for a Category Theory-based GNN Library☆15Apr 20, 2022Updated 4 years ago
- Python-based Derivative-Free Optimizer for Least-Squares☆48Jul 22, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆10Jul 6, 2021Updated 5 years ago
- A collection of stochastic proximal gradient methods for composite non-convex problems.☆24Jun 17, 2020Updated 6 years ago
- Source code for "Taming GANs with Lookahead–Minmax", ICLR 2021.☆15Mar 28, 2021Updated 5 years ago
- Matlab/Octave toolbox for nonconvex optimization☆51Jun 23, 2016Updated 10 years ago
- Variational Factorization Machines☆17Dec 20, 2016Updated 9 years ago
- The MATLAB code below implements the second-order SPSA (simultaneous perturbation stochastic approximation) and second-order SG (stochast…☆13Nov 27, 2020Updated 5 years ago
- AdaX: Adaptive Gradient Descent with Exponential Long Term Momery☆34May 8, 2020Updated 6 years ago
- JAX implementation of "Fine-Tuning Language Models with Just Forward Passes"☆19Jun 10, 2023Updated 3 years ago
- The performance of turbo equalizers in both ISI channel and multipath fading channel is evaluated☆12Nov 24, 2020Updated 5 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Nonlinear SVGD for Learning Diversified Mixture Models☆13Jan 23, 2019Updated 7 years ago
- Python trust-region subproblem solvers for nonlinear optimization☆30Aug 21, 2026Updated 2 weeks ago
- Implementations of the algorithms described in the paper: On the Convergence Theory for Hessian-Free Bilevel Algorithms.☆11Nov 1, 2024Updated last year
- Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization☆181Nov 21, 2021Updated 4 years ago
- ☆28Sep 3, 2019Updated 7 years ago
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆29Dec 22, 2020Updated 5 years ago
- Experiments with Super-Universal Newton method.☆13Aug 12, 2022Updated 4 years ago