zoq / Awesome-Optimizer
Collect optimizer related papers, data, repositories
☆87Updated 3 months ago
Alternatives and similar repositories for Awesome-Optimizer:
Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below
- Distributed K-FAC Preconditioner for PyTorch☆85Updated last week
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆76Updated 8 months ago
- summer school materials☆44Updated last year
- Deep Learning & Information Bottleneck☆56Updated last year
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆97Updated 10 months ago
- Neural Tangent Kernel Papers☆105Updated last month
- ☆63Updated 2 months ago
- Lightning-like training API for JAX with Flax☆38Updated 2 months ago
- Pytorch code for experiments on Linear Transformers☆18Updated last year
- ☆29Updated 4 months ago
- ☆16Updated 5 months ago
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆108Updated last year
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆58Updated last year
- ☆12Updated 3 years ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆49Updated 9 months ago
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆36Updated last year
- ☆35Updated 2 months ago
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆56Updated 3 years ago
- ☆52Updated 4 months ago
- Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)☆53Updated 3 months ago
- Parameter-Free Optimizers for Pytorch☆113Updated 9 months ago
- Pytorch-like dataloaders for JAX.☆75Updated 4 months ago
- a curated list of bayesian optimization tutorials, papers, softwares☆28Updated 3 years ago
- Simple (and cheap!) neural network uncertainty estimation☆61Updated last week
- Sparsity support for PyTorch☆33Updated last week
- This repository contains PyTorch implementations of various random feature maps for dot product kernels.☆19Updated 7 months ago
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆211Updated this week
- 😎 A curated list of tensor decomposition resources for model compression.☆43Updated this week
- Parallelizing non-linear sequential models over the sequence length☆50Updated last month
- Agustinus' very opiniated publication-ready plotting library☆61Updated 2 weeks ago