zoq / Awesome-OptimizerLinks
Collect optimizer related papers, data, repositories
☆99Updated last year
Alternatives and similar repositories for Awesome-Optimizer
Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below
Sorting:
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆114Updated 2 years ago
- Distributed K-FAC preconditioner for PyTorch☆93Updated 2 weeks ago
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆63Updated 2 years ago
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆82Updated last year
- ☆148Updated 7 months ago
- Create animations for the optimization trajectory of neural nets☆161Updated last year
- Pytorch code for experiments on Linear Transformers☆25Updated 2 years ago
- summer school materials☆46Updated 2 years ago
- ☆73Updated last year
- optimizer & lr scheduler & loss function collections in PyTorch☆382Updated last week
- Parameter-Free Optimizers for Pytorch☆130Updated last year
- Lightning-like training API for JAX with Flax☆45Updated last year
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆108Updated last year
- Neural Tangent Kernel Papers☆120Updated 11 months ago
- About A collection of AWESOME things about information geometry Topics☆175Updated last year
- ☆234Updated last year
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆191Updated last year
- Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)☆14Updated 2 years ago
- A general-purpose, deep learning-first library for constrained optimization in PyTorch☆152Updated last month
- [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…☆17Updated 2 years ago
- Deep Learning & Information Bottleneck☆63Updated 2 years ago
- Omnigrok: Grokking Beyond Algorithmic Data☆62Updated 2 years ago
- Agustinus' very opiniated publication-ready plotting library☆70Updated 8 months ago
- Mutual information estimators and benchmark☆56Updated 3 months ago
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆38Updated 2 years ago
- Code for papers Linear Algebra with Transformers (TMLR) and What is my Math Transformer Doing? (AI for Maths Workshop, Neurips 2022)☆76Updated last year
- Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024☆125Updated last year
- ☆233Updated 11 months ago
- ☆33Updated last year
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆127Updated 2 years ago