Alternatives and similar repositories for Autograd-from-scratch

Users that are interested in Autograd-from-scratch are comparing it to the libraries listed below

• pranftw / neograd
  A deep learning framework created from scratch with Python and NumPy
  ☆237Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆62Updated last year
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated 2 years ago
• HenryNdubuaku / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆290Updated 11 months ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆95Updated 2 months ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆288Updated 8 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆50Updated last year
• kmkolasinski / nano-umap
  Simplified implementation of UMAP like dimensionality reduction algorithm
  ☆50Updated 8 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆197Updated last year
• che-shr-cat / Deep_Learning_with_JAX
  Notebooks for the "Deep Learning with JAX" book
  ☆152Updated 2 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆188Updated 2 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• idoh / mamba.np
  A pure NumPy implementation of Mamba.
  ☆223Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 7 months ago
• nebuly-ai / exploring-AI-optimization
  Curated list of awesome material on optimization techniques to make artificial intelligence faster and more efficient 🚀
  ☆118Updated last year
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• AnswerDotAI / minai
  A miniture AI training framework for PyTorch
  ☆41Updated 6 months ago
• hkproj / multi-latent-attention
  ☆43Updated 2 months ago
• warner-benjamin / fastxtend
  Train fastai models faster (and other useful tools)
  ☆70Updated 2 months ago
• JINO-ROHIT / advanced_ml
  ☆59Updated last week
• Atcold / NYU-AISP24
  NYU Artificial Intelligence Spring 2024
  ☆59Updated 9 months ago
• srush / Autodiff-Puzzles
  ☆442Updated 9 months ago
• sradc / pretraining-BERT
  Pre-train BERT from scratch, with HuggingFace. Accompanies the blog post: sidsite.com/posts/bert-from-scratch
  ☆43Updated 2 months ago
• sytelus / pcprep
  Various handy scripts to quickly setup new Linux and Windows sandboxes, containers and WSL.
  ☆40Updated 3 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆162Updated last year
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆64Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated 10 months ago
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆128Updated 2 years ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆524Updated this week
• JUSTSUJAY / ML-Research-Papers
  ☆105Updated 11 months ago