zoq / Awesome-OptimizerLinks
Collect optimizer related papers, data, repositories
☆97Updated 10 months ago
Alternatives and similar repositories for Awesome-Optimizer
Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below
Sorting:
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆113Updated 2 years ago
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆63Updated 2 years ago
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆81Updated last year
- 😎 A curated list of tensor decomposition resources for model compression.☆81Updated 3 weeks ago
- Distributed K-FAC preconditioner for PyTorch☆90Updated last week
- summer school materials☆46Updated 2 years ago
- Neural Tangent Kernel Papers☆117Updated 8 months ago
- ☆215Updated 10 months ago
- About A collection of AWESOME things about information geometry Topics☆166Updated last year
- Create animations for the optimization trajectory of neural nets☆159Updated last year
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆108Updated last year
- Parameter-Free Optimizers for Pytorch☆130Updated last year
- optimizer & lr scheduler & loss function collections in PyTorch☆361Updated this week
- Library for Jacobian descent with PyTorch. It enables the optimization of neural networks with multiple losses (e.g. multi-task learning)…☆271Updated this week
- ☆40Updated last month
- ☆36Updated 10 months ago
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆58Updated 3 years ago
- Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]☆67Updated last year
- ☆70Updated 10 months ago
- Code for papers Linear Algebra with Transformers (TMLR) and What is my Math Transformer Doing? (AI for Maths Workshop, Neurips 2022)☆75Updated last year
- ☆145Updated 4 months ago
- Omnigrok: Grokking Beyond Algorithmic Data☆62Updated 2 years ago
- ☆233Updated 7 months ago
- Implementation of LPLR algorithm for matrix compression☆31Updated last year
- ☆33Updated last year
- Sparsity support for PyTorch☆37Updated 6 months ago
- Optimal Transport in the Big Data Era☆110Updated 11 months ago
- Official implementation for the paper "Controlled Sparsity via Constrained Optimization"☆11Updated 3 years ago
- A State-Space Model with Rational Transfer Function Representation.☆81Updated last year
- FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores☆329Updated 9 months ago