TorchJD / torchjdLinks
Library for Jacobian descent with PyTorch. It enables the optimization of neural networks with multiple losses (e.g. multi-task learning).
☆251Updated this week
Alternatives and similar repositories for torchjd
Users that are interested in torchjd are comparing it to the libraries listed below
Sorting:
- ☆197Updated 7 months ago
- TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…☆118Updated 4 months ago
- optimizer & lr scheduler & loss function collections in PyTorch☆310Updated last week
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds☆263Updated 4 months ago
- Efficient optimizers☆234Updated last week
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆426Updated 7 months ago
- ☆150Updated 11 months ago
- The AdEMAMix Optimizer: Better, Faster, Older.☆183Updated 10 months ago
- Universal Tensor Operations in Einstein-Inspired Notation for Python.☆385Updated 3 months ago
- Code for our NeurIPS 2022 paper☆369Updated 2 years ago
- D-Adaptation for SGD, Adam and AdaGrad☆523Updated 5 months ago
- For optimization algorithm research and development.☆521Updated this week
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆388Updated last week
- Parameter-Free Optimizers for Pytorch☆130Updated last year
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆179Updated last month
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆99Updated last year
- 🧱 Modula software package☆204Updated 3 months ago
- Load tensorboard event logs as pandas DataFrames for scientific plotting; Supports both PyTorch and TensorFlow☆199Updated 11 months ago
- ☆111Updated last month
- Laplace approximations for Deep Learning.☆514Updated 2 months ago
- Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"☆482Updated 2 years ago
- TensorDict is a pytorch dedicated tensor container.☆942Updated this week
- ☆295Updated 6 months ago
- An implementation of PSGD Kron second-order optimizer for PyTorch☆92Updated 3 months ago
- Easy Hypernetworks in Pytorch and Jax☆103Updated 2 years ago
- Modern Fixed Point Systems using Pytorch☆100Updated last year
- Annotated version of the Mamba paper☆486Updated last year
- When it comes to optimizers, it's always better to be safe than sorry☆302Updated 3 months ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆332Updated last week
- A general-purpose, deep learning-first library for constrained optimization in PyTorch☆130Updated last month