Alternatives and similar repositories for Autograd-from-scratch:

Users that are interested in Autograd-from-scratch are comparing it to the libraries listed below

• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆132Updated last year
• kmkolasinski / nano-umap
  Simplified implementation of UMAP like dimensionality reduction algorithm
  ☆47Updated 4 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆59Updated last year
• juraam / snake-diffusion
  Implementation snake game based on Diffusion model
  ☆88Updated 2 months ago
• pranftw / neograd
  A deep learning framework created from scratch with Python and NumPy
  ☆236Updated 2 years ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆90Updated 11 months ago
• bclarkson-code / Tricycle
  Autograd to GPT-2 completely from scratch
  ☆112Updated 2 weeks ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆198Updated 10 months ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• idoh / mamba.np
  A pure NumPy implementation of Mamba.
  ☆220Updated 8 months ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆477Updated last year
• BlackHC / neural_net_checklist
  ☆149Updated 7 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆167Updated this week
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆151Updated 5 months ago
• HMUNACHI / nanodl
  A Jax-based library for designing and training transformer models from scratch.
  ☆282Updated 6 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆377Updated last month
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆282Updated 3 months ago
• JUSTSUJAY / ML-Research-Papers
  ☆103Updated 7 months ago
• hkproj / triton-flash-attention
  ☆138Updated 2 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆146Updated 9 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆87Updated last year
• thevasudevgupta / gpt-triton
  Triton implementation of GPT/LLAMA
  ☆16Updated 7 months ago
• 10-zin / cpp-micrograd
  A c/c++ implementation of micrograd: a tiny autograd engine with neural net on top.
  ☆65Updated last year
• JINO-ROHIT / advanced_ml
  ☆38Updated 2 weeks ago
• UmerHA / quanting-notes
  I learn about and explain quantization
  ☆26Updated 11 months ago
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆61Updated 10 months ago
• che-shr-cat / JAX-in-Action
  Notebooks for the "JAX in Action" book
  ☆134Updated 9 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆98Updated 3 months ago
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆115Updated 10 months ago
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆18Updated 11 months ago