TorchJD / torchjdLinks
Library for Jacobian descent with PyTorch. It enables the optimization of neural networks with multiple losses (e.g. multi-task learning).
☆246Updated this week
Alternatives and similar repositories for torchjd
Users that are interested in torchjd are comparing it to the libraries listed below
Sorting:
- ☆190Updated 6 months ago
- Efficient optimizers☆220Updated last week
- TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…☆117Updated 4 months ago
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds☆252Updated 3 months ago
- The AdEMAMix Optimizer: Better, Faster, Older.☆183Updated 9 months ago
- 🧱 Modula software package☆200Updated 3 months ago
- Modern Fixed Point Systems using Pytorch☆94Updated last year
- ☆150Updated 10 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆177Updated 2 weeks ago
- Parameter-Free Optimizers for Pytorch☆130Updated last year
- ☆292Updated 5 months ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆426Updated 6 months ago
- ☆36Updated last year
- Create animations for the optimization trajectory of neural nets☆156Updated last year
- FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores☆319Updated 6 months ago
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆63Updated last year
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆97Updated last year
- A repository for log-time feedforward networks☆222Updated last year
- An implementation of PSGD Kron second-order optimizer for PyTorch☆91Updated 2 months ago
- A general-purpose, deep learning-first library for constrained optimization in PyTorch☆125Updated 2 weeks ago
- ☆163Updated 2 years ago
- Code for our NeurIPS 2022 paper☆368Updated 2 years ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆233Updated 5 months ago
- PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)☆40Updated 2 months ago
- Normalizing flows in PyTorch☆391Updated 3 weeks ago
- Simple (and cheap!) neural network uncertainty estimation☆66Updated last month
- ☆104Updated 2 weeks ago
- Official JAX implementation of xLSTM including fast and efficient training and inference code. 7B model available at https://huggingface.…☆94Updated 5 months ago
- Unofficial JAX implementations of deep learning research papers☆156Updated 3 years ago