kach / gradient-descent-the-ultimate-optimizer
Code for our NeurIPS 2022 paper
☆366Updated 2 years ago
Alternatives and similar repositories for gradient-descent-the-ultimate-optimizer:
Users that are interested in gradient-descent-the-ultimate-optimizer are comparing it to the libraries listed below
- A library to inspect and extract intermediate layers of PyTorch models.☆471Updated 2 years ago
- Named tensors with first-class dimensions for PyTorch☆321Updated last year
- Tensors, for human consumption☆1,183Updated 3 months ago
- ☆764Updated last month
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆251Updated 2 years ago
- Laplace approximations for Deep Learning.☆496Updated 2 weeks ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆257Updated last year
- This library would form a permanent home for reusable components for deep probabilistic programming. The library would form and harness a…☆305Updated 2 months ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆572Updated last month
- Compositional Linear Algebra☆462Updated 2 weeks ago
- For optimization algorithm research and development.☆491Updated this week
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆474Updated 2 years ago
- Load tensorboard event logs as pandas DataFrames for scientific plotting; Supports both PyTorch and TensorFlow☆191Updated 6 months ago
- Constrained optimization toolkit for PyTorch☆666Updated 2 years ago
- Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"☆370Updated last year
- TensorDict is a pytorch dedicated tensor container.☆879Updated this week
- Optimal transport tools implemented with the JAX framework, to get differentiable, parallel and jit-able computations.☆567Updated this week
- Betty: an automatic differentiation library for generalized meta-learning and multilevel optimization☆337Updated 7 months ago
- A parallel ODE solver for PyTorch☆248Updated 4 months ago
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆433Updated 5 months ago
- Fast, differentiable sorting and ranking in PyTorch☆792Updated last year
- functorch is JAX-like composable function transforms for PyTorch.☆1,410Updated this week
- VQVAEs, GumbelSoftmaxes and friends☆553Updated 3 years ago
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.☆1,417Updated 6 months ago
- Implementation of https://srush.github.io/annotated-s4☆483Updated 2 years ago
- Pretrained deep learning models for Jax/Flax: StyleGAN2, GPT2, VGG, ResNet, etc.☆246Updated last year
- A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.☆702Updated 9 months ago
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆204Updated last year
- Fast Differentiable Sorting and Ranking☆587Updated last year
- Universal Tensor Operations in Einstein-Inspired Notation for Python.☆354Updated last week