zoq / Awesome-Optimizer
Collect optimizer related papers, data, repositories
☆89Updated 5 months ago
Alternatives and similar repositories for Awesome-Optimizer:
Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below
- Distributed K-FAC preconditioner for PyTorch☆85Updated this week
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆77Updated 10 months ago
- Neural Tangent Kernel Papers☆109Updated 3 months ago
- ☆32Updated 7 months ago
- code associated with paper "Sparse Bayesian Optimization"☆26Updated last year
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆60Updated last year
- ☆16Updated 7 months ago
- Parameter-Free Optimizers for Pytorch☆126Updated last year
- ☆67Updated 5 months ago
- Benchmarking optimization methods on convex problems.☆32Updated last year
- This repository contains PyTorch implementations of various random feature maps for dot product kernels.☆21Updated 9 months ago
- Deep Learning & Information Bottleneck☆60Updated last year
- Sparsity support for PyTorch☆34Updated last month
- ☆52Updated 7 months ago
- Lightning-like training API for JAX with Flax☆38Updated 4 months ago
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆36Updated last year
- Code for 'Periodic Activation Functions Induce Stationarity' (NeurIPS 2021)☆18Updated 3 years ago
- Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/☆23Updated 11 months ago
- Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]☆66Updated 7 months ago
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆213Updated 2 weeks ago
- Official code for our NeurIPS 2024 paper "einspace: Searching for Neural Architectures from Fundamental Operations"☆28Updated 6 months ago
- summer school materials☆44Updated last year
- Mutual information estimators and benchmark☆49Updated 3 months ago
- Agustinus' very opiniated publication-ready plotting library☆64Updated 3 months ago
- Omnigrok: Grokking Beyond Algorithmic Data☆56Updated 2 years ago
- Create animations for the optimization trajectory of neural nets☆153Updated last year
- Awesome list for Neural Network Optimization methods.☆79Updated 2 months ago
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆100Updated last year
- 😎 A curated list of tensor decomposition resources for model compression.☆63Updated last week
- [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…☆17Updated last year