Alternatives and similar repositories for Autograd-from-scratch

Users that are interested in Autograd-from-scratch are comparing it to the libraries listed below

• pranftw / neograd
  A deep learning framework created from scratch with Python and NumPy
  ☆237Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆63Updated last year
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆137Updated 2 years ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆197Updated last year
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆51Updated last year
• idoh / mamba.np
  A pure NumPy implementation of Mamba.
  ☆224Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆191Updated 2 months ago
• kmkolasinski / nano-umap
  Simplified implementation of UMAP like dimensionality reduction algorithm
  ☆50Updated 9 months ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆95Updated 3 months ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆288Updated 8 months ago
• HenryNdubuaku / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆290Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 8 months ago
• sunildkumar / lora_from_scratch
  Implements Low-Rank Adaptation(LoRA) Finetuning from scratch
  ☆79Updated 2 years ago
• hkproj / multi-latent-attention
  ☆43Updated 3 months ago
• AnswerDotAI / fastkmeans
  ☆68Updated last month
• angry-kratos / Simple_Llama3_from_scratch
  ☆30Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆124Updated 7 months ago
• sgrvinod / chess-transformers
  Teaching transformers to play chess
  ☆138Updated 7 months ago
• sradc / pretraining-BERT
  Pre-train BERT from scratch, with HuggingFace. Accompanies the blog post: sidsite.com/posts/bert-from-scratch
  ☆43Updated 3 months ago
• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆331Updated last year
• bclarkson-code / Tricycle
  Autograd to GPT-2 completely from scratch
  ☆116Updated 2 weeks ago
• che-shr-cat / Deep_Learning_with_JAX
  Notebooks for the "Deep Learning with JAX" book
  ☆153Updated 2 months ago
• AI-Hypercomputer / RecML
  ☆206Updated this week
• JUSTSUJAY / ML-Research-Papers
  ☆105Updated last year
• gpu-mode / profiling-cuda-in-torch
  ☆163Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆121Updated last year
• kabir2505 / tiny-mixtral
  ☆44Updated 3 months ago
• naklecha / llm-inference-optimizations-explained
  in this repository, i'm going to implement increasingly complex llm inference optimizations
  ☆66Updated 3 months ago
• rasbt / pycon2024
  Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
  ☆247Updated last year