Alternatives and similar repositories for Autograd-from-scratch

Users that are interested in Autograd-from-scratch are comparing it to the libraries listed below

• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated last year
• pranftw / neograd
  A deep learning framework created from scratch with Python and NumPy
  ☆236Updated 2 years ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆198Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆60Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆92Updated last year
• HMUNACHI / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆287Updated 8 months ago
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆64Updated last year
• HHU-MMBS / RepresentationLearning_SS2023
  Representation Learning MSc course Summer Semester 2023
  ☆79Updated last year
• KhawajaAbaid / micrograd_c
  Andrej Kapathy's micrograd implemented in c
  ☆28Updated 9 months ago
• 10-zin / cpp-micrograd
  A c/c++ implementation of micrograd: a tiny autograd engine with neural net on top.
  ☆67Updated last year
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆51Updated last year
• srush / Autodiff-Puzzles
  ☆431Updated 6 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆180Updated this week
• JUSTSUJAY / ML-Research-Papers
  ☆103Updated 8 months ago
• angry-kratos / Simple_Llama3_from_scratch
  ☆31Updated 10 months ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆287Updated 5 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated last year
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆483Updated last year
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆174Updated 9 months ago
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆275Updated 11 months ago
• UmerHA / quanting-notes
  I learn about and explain quantization
  ☆26Updated last year
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆65Updated 3 weeks ago
• idoh / mamba.np
  A pure NumPy implementation of Mamba.
  ☆222Updated 10 months ago
• bclarkson-code / Tricycle
  Autograd to GPT-2 completely from scratch
  ☆113Updated 3 weeks ago
• HMUNACHI / cuda-tutorials
  CUDA tutorials for Maths & ML tutorials with examples, covers multi-gpus, fused attention, winograd convolution, reinforcement learning.
  ☆182Updated last month
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆19Updated last year
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆30Updated last month
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 6 months ago
• bhosmer / mm
  ☆130Updated 6 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆78Updated 5 months ago