zoq / Awesome-Optimizer
Collect optimizer related papers, data, repositories
☆82Updated this week
Related projects ⓘ
Alternatives and complementary repositories for Awesome-Optimizer
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆76Updated 5 months ago
- Neural Tangent Kernel Papers☆94Updated 8 months ago
- Distributed K-FAC Preconditioner for PyTorch☆80Updated this week
- ☆59Updated 3 years ago
- Benchmarking optimization methods on convex problems.☆28Updated 8 months ago
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆36Updated last year
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆58Updated last year
- summer school materials☆45Updated last year
- Sparsity support for PyTorch☆31Updated last year
- A thoroughly investigated survey for tensorial neural networks.☆109Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆42Updated 6 months ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆24Updated 2 weeks ago
- ☆33Updated last year
- Python & Matlab code for the figures from the book "Learning Theory from First Principles" by Francis Bach☆36Updated 8 months ago
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆89Updated 7 months ago
- Riemannian Optimization Using JAX☆45Updated last year
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆55Updated 3 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆128Updated 5 years ago
- This repository contains PyTorch implementations of various random feature maps for dot product kernels.☆18Updated 4 months ago
- [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.☆57Updated last year
- Second-Order Neural ODE Optimizer, NeurIPS 2021 spotlight☆52Updated 3 years ago
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆207Updated last month
- code associated with paper "Sparse Bayesian Optimization"☆25Updated last year
- Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations☆20Updated last year
- Source code of "What can linearized neural networks actually say about generalization?☆18Updated 3 years ago
- [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…☆17Updated last year
- ☆67Updated 5 years ago
- Official implementation for the paper "Controlled Sparsity via Constrained Optimization"☆10Updated 2 years ago
- code to show F-Principle in the DNN training☆59Updated 2 years ago
- [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation☆12Updated last year