zoq / Awesome-OptimizerLinks
Collect optimizer related papers, data, repositories
☆98Updated last year
Alternatives and similar repositories for Awesome-Optimizer
Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below
Sorting:
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆114Updated 2 years ago
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆81Updated last year
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆63Updated 2 years ago
- optimizer & lr scheduler & loss function collections in PyTorch☆370Updated 3 weeks ago
- Distributed K-FAC preconditioner for PyTorch☆91Updated this week
- Neural Tangent Kernel Papers☆119Updated 10 months ago
- ☆33Updated last year
- ☆223Updated 11 months ago
- 😎 A curated list of tensor decomposition resources for model compression.☆87Updated last week
- Create animations for the optimization trajectory of neural nets☆161Updated last year
- ☆72Updated 11 months ago
- Implementations of various linear RNN layers using pytorch and triton☆54Updated 2 years ago
- ☆61Updated last year
- ☆147Updated 5 months ago
- Parameter-Free Optimizers for Pytorch☆130Updated last year
- A State-Space Model with Rational Transfer Function Representation.☆83Updated last year
- Lightning-like training API for JAX with Flax☆44Updated 11 months ago
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated last year
- summer school materials☆46Updated 2 years ago
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆108Updated last year
- Optimal Transport in the Big Data Era☆112Updated last year
- Omnigrok: Grokking Beyond Algorithmic Data☆62Updated 2 years ago
- ☆47Updated last month
- Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/☆28Updated last year
- Code for papers Linear Algebra with Transformers (TMLR) and What is my Math Transformer Doing? (AI for Maths Workshop, Neurips 2022)☆76Updated last year
- [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)☆23Updated last year
- About A collection of AWESOME things about information geometry Topics☆171Updated last year
- [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…☆17Updated 2 years ago
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆127Updated 2 years ago
- Scalable Convex Neural Networks☆24Updated 6 months ago