TorchJD / torchjdLinks
Library for Jacobian descent with PyTorch. It enables the optimization of neural networks with multiple losses (e.g. multi-task learning).
☆278Updated this week
Alternatives and similar repositories for torchjd
Users that are interested in torchjd are comparing it to the libraries listed below
Sorting:
- ☆223Updated 11 months ago
- Efficient optimizers☆275Updated last week
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds☆326Updated last week
- TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…☆121Updated 9 months ago
- optimizer & lr scheduler & loss function collections in PyTorch☆370Updated 3 weeks ago
- Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"☆427Updated 11 months ago
- Code for our NeurIPS 2022 paper☆369Updated 2 years ago
- The AdEMAMix Optimizer: Better, Faster, Older.☆186Updated last year
- Reliable, minimal and scalable library for pretraining foundation and world models☆90Updated this week
- Modern Fixed Point Systems using Pytorch☆122Updated 2 years ago
- ☆119Updated 5 months ago
- Parameter-Free Optimizers for Pytorch☆130Updated last year
- A simple implimentation of Bayesian Flow Networks (BFN)☆240Updated last year
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆188Updated last month
- D-Adaptation for SGD, Adam and AdaGrad☆525Updated 10 months ago
- ☆150Updated last year
- 🧱 Modula software package☆303Updated 3 months ago
- Universal Notation for Tensor Operations in Python.☆447Updated 7 months ago
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆117Updated 2 months ago
- Easy Hypernetworks in Pytorch and Jax☆105Updated 2 years ago
- An implementation of PSGD Kron second-order optimizer for PyTorch☆97Updated 3 months ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆123Updated last year
- Official JAX implementation of xLSTM including fast and efficient training and inference code. 7B model available at https://huggingface.…☆104Updated 10 months ago
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆401Updated this week
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆35Updated 3 years ago
- Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"☆497Updated 2 years ago
- A general-purpose, deep learning-first library for constrained optimization in PyTorch☆146Updated last week
- For optimization algorithm research and development.☆547Updated this week
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆378Updated last week
- Implementation of the proposed minGRU in Pytorch☆308Updated 8 months ago