Alternatives and similar repositories for Autograd-from-scratch

Users that are interested in Autograd-from-scratch are comparing it to the libraries listed below

• pranftw / neograd
  A deep learning framework created from scratch with Python and NumPy
  ☆238Updated 3 years ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆138Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆66Updated 2 years ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆298Updated last year
• kmkolasinski / nano-umap
  Simplified implementation of UMAP like dimensionality reduction algorithm
  ☆53Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆99Updated 7 months ago
• bclarkson-code / Tricycle
  Autograd to GPT-2 completely from scratch
  ☆126Updated 5 months ago
• che-shr-cat / Deep_Learning_with_JAX
  Notebooks for the "Deep Learning with JAX" book
  ☆167Updated 7 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated last year
• sradc / pretraining-BERT
  Pre-train BERT from scratch, with HuggingFace. Accompanies the blog post: sidsite.com/posts/bert-from-scratch
  ☆43Updated 8 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆53Updated last year
• idoh / mamba.np
  A pure NumPy implementation of Mamba.
  ☆222Updated last year
• HenryNdubuaku / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆298Updated last year
• JUSTSUJAY / ML-Research-Papers
  ☆108Updated last year
• nebuly-ai / exploring-AI-optimization
  Curated list of awesome material on optimization techniques to make artificial intelligence faster and more efficient 🚀
  ☆119Updated 2 years ago
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• tensorops / TransformerX
  Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow ✅, Pytorch 🔜, and Jax 🔜)
  ☆53Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• srush / pytorch-lecture
  Introductory lecture on Pytorch
  ☆17Updated 3 years ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆195Updated 7 months ago
• AI-Hypercomputer / RecML
  ☆214Updated last week
• orobix / quadra
  Quadra: Effortless and reproducible deep learning workflows with configuration files.
  ☆50Updated this week
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆57Updated 4 months ago
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆63Updated 2 years ago
• sytelus / pcprep
  Various handy scripts to quickly setup new Linux and Windows sandboxes, containers and WSL.
  ☆40Updated this week
• dpressel / mint
  MinT: Minimal Transformer Library and Tutorials
  ☆260Updated 3 years ago
• bhosmer / mm
  ☆138Updated last year
• juraam / snake-diffusion
  Implementation snake game based on Diffusion model
  ☆93Updated last year
• BlackHC / neural_net_checklist
  ☆215Updated last year
• cloneofsimo / min-fsdp
  ☆92Updated last year