Alternatives and similar repositories for Autograd-from-scratch

Users that are interested in Autograd-from-scratch are comparing it to the libraries listed below

• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated 2 years ago
• pranftw / neograd
  A deep learning framework created from scratch with Python and NumPy
  ☆237Updated 2 years ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆95Updated 5 months ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆64Updated last year
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆195Updated last year
• HenryNdubuaku / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆295Updated last year
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆291Updated 10 months ago
• che-shr-cat / Deep_Learning_with_JAX
  Notebooks for the "Deep Learning with JAX" book
  ☆157Updated 4 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆194Updated 4 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• kmkolasinski / nano-umap
  Simplified implementation of UMAP like dimensionality reduction algorithm
  ☆53Updated 11 months ago
• idoh / mamba.np
  A pure NumPy implementation of Mamba.
  ☆223Updated last year
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆52Updated last year
• KhawajaAbaid / micrograd_c
  Andrej Kapathy's micrograd implemented in c
  ☆30Updated last year
• AnswerDotAI / minai
  A miniture AI training framework for PyTorch
  ☆42Updated 8 months ago
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆199Updated 9 years ago
• sradc / pretraining-BERT
  Pre-train BERT from scratch, with HuggingFace. Accompanies the blog post: sidsite.com/posts/bert-from-scratch
  ☆43Updated 5 months ago
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆26Updated last year
• JUSTSUJAY / ML-Research-Papers
  ☆107Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 10 months ago
• tensara / tensara
  Competitive GPU kernel optimization platform.
  ☆113Updated this week
• dpressel / mint
  MinT: Minimal Transformer Library and Tutorials
  ☆258Updated 3 years ago
• bclarkson-code / Tricycle
  Autograd to GPT-2 completely from scratch
  ☆125Updated 2 months ago
• AI-Hypercomputer / RecML
  ☆211Updated this week
• UmerHA / quanting-notes
  I learn about and explain quantization
  ☆26Updated last year
• juraam / snake-diffusion
  Implementation snake game based on Diffusion model
  ☆91Updated 9 months ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆543Updated last week
• srush / Autodiff-Puzzles
  ☆456Updated last year
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆63Updated 4 months ago
• tensorops / TransformerX
  Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ✅, Pytorch 🔜, and Jax 🔜)
  ☆53Updated last year