Alternatives and similar repositories for Autograd-from-scratch

Users that are interested in Autograd-from-scratch are comparing it to the libraries listed below

• pranftw / neograd
  A deep learning framework created from scratch with Python and NumPy
  ☆235Updated 2 years ago
• idoh / mamba.np
  A pure NumPy implementation of Mamba.
  ☆223Updated 10 months ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆287Updated 5 months ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆94Updated last week
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆61Updated last year
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆197Updated last year
• HHU-MMBS / RepresentationLearning_SS2023
  Representation Learning MSc course Summer Semester 2023
  ☆80Updated last year
• 10-zin / cpp-micrograd
  A c/c++ implementation of micrograd: a tiny autograd engine with neural net on top.
  ☆68Updated last year
• bclarkson-code / Tricycle
  Autograd to GPT-2 completely from scratch
  ☆113Updated last month
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆78Updated 5 months ago
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆192Updated 9 years ago
• HMUNACHI / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆287Updated 9 months ago
• UmerHA / quanting-notes
  I learn about and explain quantization
  ☆26Updated last year
• srush / Autodiff-Puzzles
  ☆433Updated 7 months ago
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆64Updated last year
• JUSTSUJAY / ML-Research-Papers
  ☆103Updated 9 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆91Updated last year
• orobix / quadra
  Quadra: Effortless and reproducible deep learning workflows with configuration files.
  ☆49Updated 2 weeks ago
• srush / pytorch-lecture
  Introductory lecture on Pytorch
  ☆17Updated 3 years ago
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆117Updated last year
• HMUNACHI / cuda-tutorials
  CUDA tutorials for Maths & ML tutorials with examples, covers multi-gpus, fused attention, winograd convolution, reinforcement learning.
  ☆183Updated last month
• hkproj / multi-latent-attention
  ☆35Updated last week
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆482Updated last year
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆51Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆105Updated 4 months ago
• kabir2505 / tiny-mixtral
  ☆39Updated last month
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆433Updated 9 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆184Updated last week
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆151Updated last year