zoq / Awesome-OptimizerLinks
Collect optimizer related papers, data, repositories
☆98Updated last year
Alternatives and similar repositories for Awesome-Optimizer
Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below
Sorting:
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆114Updated 2 years ago
- Distributed K-FAC preconditioner for PyTorch☆93Updated this week
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆81Updated last year
- Neural Tangent Kernel Papers☆120Updated 11 months ago
- Lightning-like training API for JAX with Flax☆44Updated last year
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆108Updated last year
- Implementations of various linear RNN layers using pytorch and triton☆54Updated 2 years ago
- Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024☆124Updated last year
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆63Updated 2 years ago
- optimizer & lr scheduler & loss function collections in PyTorch☆377Updated 2 weeks ago
- ☆229Updated last year
- ☆33Updated last year
- Create animations for the optimization trajectory of neural nets☆161Updated last year
- About A collection of AWESOME things about information geometry Topics☆172Updated last year
- ☆62Updated last year
- Fast training of unitary deep network layers from low-rank updates☆29Updated 3 years ago
- Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)☆61Updated 3 months ago
- ☆148Updated 6 months ago
- Code for papers Linear Algebra with Transformers (TMLR) and What is my Math Transformer Doing? (AI for Maths Workshop, Neurips 2022)☆76Updated last year
- Omnigrok: Grokking Beyond Algorithmic Data☆62Updated 2 years ago
- 😎 A curated list of tensor decomposition resources for model compression.☆88Updated this week
- A thoroughly investigated survey for tensorial neural networks.☆141Updated 11 months ago
- Pytorch code for experiments on Linear Transformers☆24Updated last year
- Mutual information estimators and benchmark☆55Updated 3 months ago
- Agustinus' very opiniated publication-ready plotting library☆70Updated 7 months ago
- summer school materials☆46Updated 2 years ago
- Official PyTorch implementation of NeuralSVD (ICML 2024)☆20Updated last year
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆38Updated 2 years ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆67Updated last year
- A State-Space Model with Rational Transfer Function Representation.☆83Updated last year