Alternatives and similar repositories for adopt:

Users that are interested in adopt are comparing it to the libraries listed below

• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆178Updated 5 months ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆497Updated this week
• HomebrewML / HeavyBall
  Efficient optimizers
  ☆177Updated last week
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆474Updated last year
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆265Updated 8 months ago
• BlackHC / neural_net_checklist
  ☆149Updated 6 months ago
• zyushun / Adam-mini
  Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793
  ☆388Updated 2 months ago
• TorchJD / torchjd
  Library for Jacobian descent with PyTorch. It enables optimization of neural networks with multiple losses (e.g. multi-task learning).
  ☆209Updated last week
• epistoteles / TensorHue
  TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…
  ☆115Updated last week
• apple / ml-sigma-reparam
  ☆301Updated 8 months ago
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆220Updated this week
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆210Updated this week
• fferflo / einx
  Universal Tensor Operations in Einstein-Inspired Notation for Python.
  ☆358Updated 2 weeks ago
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆112Updated 4 months ago
• pytorch / tensordict
  TensorDict is a pytorch dedicated tensor container.
  ☆889Updated this week
• SynodicMonth / ChebyKAN
  Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.
  ☆363Updated 9 months ago
• nikhilvyas / SOAP
  ☆161Updated 3 months ago
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆281Updated 2 weeks ago
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆84Updated last week
• ironjr / grokfast
  Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"
  ☆543Updated 8 months ago
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆662Updated last week
• lucidrains / hyper-connections
  Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public
  ☆74Updated 2 weeks ago
• lucidrains / nGPT-pytorch
  Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
  ☆273Updated 3 months ago
• HazyResearch / flash-fft-conv
  FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
  ☆300Updated 2 months ago
• pbelcak / fastfeedforward
  A repository for log-time feedforward networks
  ☆220Updated 10 months ago
• samuela / torch2jax
  Run PyTorch in JAX. 🤝
  ☆222Updated 2 weeks ago
• kyleliang919 / C-Optim
  When it comes to optimizers, it's always better to be safe than sorry
  ☆180Updated last week
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆120Updated 7 months ago
• facebookresearch / schedule_free
  Schedule-Free Optimization in PyTorch
  ☆2,104Updated this week