Alternatives and similar repositories for nanograd

Users that are interested in nanograd are comparing it to the libraries listed below

• google-deepmind / nanodo
  ☆283Updated last year
• HenryNdubuaku / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆296Updated last year
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆270Updated last year
• jxbz / agd
  Automatic gradient descent
  ☆215Updated 2 years ago
• DarshanDeshpande / jax-models
  Unofficial JAX implementations of deep learning research papers
  ☆159Updated 3 years ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆97Updated 5 months ago
• cgarciae / nnx
  Neural Networks for JAX
  ☆84Updated last year
• irregular-rhomboid / EAI-Math-Reading-Group
  Resources from the EleutherAI Math Reading Group
  ☆54Updated 8 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆53Updated last year
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆64Updated last year
• Sohl-Dickstein / fractal
  The boundary of neural network trainability is fractal
  ☆217Updated last year
• okarthikb / state-space-models
  ☆28Updated last year
• srush / Autodiff-Puzzles
  ☆457Updated last year
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆321Updated 3 months ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆542Updated last week
• idoh / mamba.np
  A pure NumPy implementation of Mamba.
  ☆223Updated last year
• szmikler / pytorch-symbolic
  Symbolic API for model creation in PyTorch.
  ☆68Updated 7 months ago
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆122Updated last year
• glassroom / heinsen_sequence
  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
  ☆95Updated 11 months ago
• modula-systems / modula
  🧱 Modula software package
  ☆300Updated 2 months ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆291Updated 11 months ago
• cgarciae / einop
  ☆60Updated 3 years ago
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆103Updated 3 months ago
• sgrvinod / chess-transformers
  Teaching transformers to play chess
  ☆141Updated 9 months ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆188Updated 3 weeks ago
• sytelus / pcprep
  Various handy scripts to quickly setup new Linux and Windows sandboxes, containers and WSL.
  ☆40Updated 2 weeks ago
• HomebrewML / HeavyBall
  Efficient optimizers
  ☆276Updated 3 weeks ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated 2 years ago
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• cgarciae / ciclo
  A functional training loops library for JAX
  ☆88Updated last year