Alternatives and similar repositories for torchjd:

Users that are interested in torchjd are comparing it to the libraries listed below

• HomebrewML / HeavyBall
  Efficient optimizers
  ☆169Updated this week
• nikhilvyas / SOAP
  ☆159Updated 2 months ago
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆205Updated this week
• iShohei220 / adopt
  Official Implementation of "ADOPT: Modified Adam Can Converge with Any β2 with the Optimal Rate"
  ☆417Updated 2 months ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆76Updated 2 months ago
• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆178Updated 5 months ago
• BlackHC / neural_net_checklist
  ☆149Updated 6 months ago
• facebookresearch / dadaptation
  D-Adaptation for SGD, Adam and AdaGrad
  ☆513Updated 3 weeks ago
• epistoteles / TensorHue
  TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…
  ☆115Updated this week
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆491Updated this week
• modula-systems / modula
  🧱 Modula software package
  ☆146Updated this week
• kyleliang919 / C-Optim
  When it comes to optimizers, it's always better to be safe than sorry
  ☆179Updated 3 weeks ago
• KellerJordan / Muon
  Muon optimizer: +~30% sample efficiency with <3% wallclock overhead
  ☆254Updated last week
• kozistr / pytorch_optimizer
  optimizer & lr scheduler & loss function collections in PyTorch
  ☆270Updated this week
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆83Updated last week
• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆73Updated 6 months ago
• ctlllll / SGConv
  ☆163Updated 2 years ago
• shyamsn97 / hyper-nn
  Easy Hypernetworks in Pytorch and Jax
  ☆97Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆52Updated 4 months ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆122Updated last year
• optimizedlearning / mechanic
  ☆36Updated last year
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆120Updated 6 months ago
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆85Updated last year
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆279Updated last week
• kach / gradient-descent-the-ultimate-optimizer
  Code for our NeurIPS 2022 paper
  ☆366Updated 2 years ago
• NVlabs / GatedDeltaNet
  [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule
  ☆131Updated last week
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆171Updated 6 months ago
• lucidrains / adam-atan2-pytorch
  Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch
  ☆102Updated 2 months ago
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆219Updated this week