kach / gradient-descent-the-ultimate-optimizer
Code for our NeurIPS 2022 paper
☆367Updated 2 years ago
Alternatives and similar repositories for gradient-descent-the-ultimate-optimizer:
Users that are interested in gradient-descent-the-ultimate-optimizer are comparing it to the libraries listed below
- Named tensors with first-class dimensions for PyTorch☆320Updated last year
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆578Updated 3 months ago
- A library to inspect and extract intermediate layers of PyTorch models.☆472Updated 2 years ago
- This library would form a permanent home for reusable components for deep probabilistic programming. The library would form and harness a…☆306Updated last month
- Laplace approximations for Deep Learning.☆500Updated 2 months ago
- functorch is JAX-like composable function transforms for PyTorch.☆1,422Updated this week
- TensorDict is a pytorch dedicated tensor container.☆911Updated this week
- Optimal transport tools implemented with the JAX framework, to solve large scale matching problems of any flavor.☆579Updated last week
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆251Updated 2 years ago
- Implementation of https://srush.github.io/annotated-s4☆490Updated 2 years ago
- Betty: an automatic differentiation library for generalized meta-learning and multilevel optimization☆338Updated 9 months ago
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆475Updated 2 years ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆258Updated last year
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆435Updated 7 months ago
- Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"☆477Updated 2 years ago
- ☆224Updated 2 months ago
- Pretrained deep learning models for Jax/Flax: StyleGAN2, GPT2, VGG, ResNet, etc.☆249Updated last month
- Normalizing flows in PyTorch☆377Updated last week
- ☆289Updated 3 months ago
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆207Updated last year
- VQVAEs, GumbelSoftmaxes and friends☆559Updated 3 years ago
- Compositional Linear Algebra☆473Updated 3 weeks ago
- Annotated version of the Mamba paper☆483Updated last year
- Constrained optimization toolkit for PyTorch☆673Updated 3 years ago
- Automatic gradient descent☆207Updated last year
- TorchOpt is an efficient library for differentiable optimization built upon PyTorch.☆580Updated 2 weeks ago
- Fast, differentiable sorting and ranking in PyTorch☆808Updated last year
- Easy Hypernetworks in Pytorch and Jax☆100Updated 2 years ago
- Unofficial JAX implementations of deep learning research papers☆155Updated 2 years ago
- Run PyTorch in JAX. 🤝☆236Updated 2 months ago