zoq / Awesome-OptimizerLinks
Collect optimizer related papers, data, repositories
☆99Updated 11 months ago
Alternatives and similar repositories for Awesome-Optimizer
Users that are interested in Awesome-Optimizer are comparing it to the libraries listed below
Sorting:
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆113Updated 2 years ago
- Neural Tangent Kernel Papers☆118Updated 9 months ago
- Distributed K-FAC preconditioner for PyTorch☆91Updated last week
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆63Updated 2 years ago
- ☆220Updated 10 months ago
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆81Updated last year
- Lightning-like training API for JAX with Flax☆44Updated 10 months ago
- summer school materials☆46Updated 2 years ago
- Code for papers Linear Algebra with Transformers (TMLR) and What is my Math Transformer Doing? (AI for Maths Workshop, Neurips 2022)☆76Updated last year
- Implementation of the transformer proposed in "Building Blocks for a Complex-Valued Transformer Architecture"☆84Updated 2 years ago
- Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024☆122Updated 11 months ago
- Parameter-Free Optimizers for Pytorch☆131Updated last year
- Create animations for the optimization trajectory of neural nets☆159Updated last year
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆108Updated last year
- ☆147Updated 4 months ago
- Optimal Transport in the Big Data Era☆112Updated 11 months ago
- FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores☆329Updated 10 months ago
- Deep Learning & Information Bottleneck☆61Updated 2 years ago
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆37Updated 2 years ago
- Mutual information estimators and benchmark☆53Updated last month
- optimizer & lr scheduler & loss function collections in PyTorch☆368Updated this week
- Omnigrok: Grokking Beyond Algorithmic Data☆62Updated 2 years ago
- ☆58Updated last year
- Implementations of various linear RNN layers using pytorch and triton☆54Updated 2 years ago
- A State-Space Model with Rational Transfer Function Representation.☆82Updated last year
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆190Updated 10 months ago
- ☆33Updated last year
- Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/☆26Updated last year
- This repository contains PyTorch implementations of various random feature maps for dot product kernels.☆22Updated last year
- A general-purpose, deep learning-first library for constrained optimization in PyTorch☆145Updated 4 months ago