Alternatives and similar repositories for Autograd-from-scratch:

Users that are interested in Autograd-from-scratch are comparing it to the libraries listed below

• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆132Updated last year
• pranftw / neograd
  A deep learning framework created from scratch with Python and NumPy
  ☆236Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆58Updated last year
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated 8 months ago
• HMUNACHI / nanodl
  A Jax-based library for designing and training transformer models from scratch.
  ☆280Updated 5 months ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆89Updated 9 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated 3 weeks ago
• kmkolasinski / nano-umap
  Simplified implementation of UMAP like dimensionality reduction algorithm
  ☆44Updated 2 months ago
• UmerHA / quanting-notes
  I learn about and explain quantization
  ☆26Updated 9 months ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆281Updated last month
• thevasudevgupta / gpt-triton
  Triton implementation of GPT/LLAMA
  ☆16Updated 5 months ago
• idoh / mamba.np
  A pure NumPy implementation of Mamba.
  ☆219Updated 6 months ago
• bclarkson-code / Tricycle
  Autograd to GPT-2 completely from scratch
  ☆108Updated last week
• che-shr-cat / JAX-in-Action
  Notebooks for the "JAX in Action" book
  ☆129Updated 7 months ago
• srush / pytorch-lecture
  Introductory lecture on Pytorch
  ☆15Updated 2 years ago
• srush / Autodiff-Puzzles
  ☆413Updated 3 months ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆175Updated this week
• AnswerDotAI / minai
  A miniture AI training framework for PyTorch
  ☆39Updated this week
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆119Updated 6 months ago
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆61Updated last year
• natolambert / rlhf-book
  Textbook on reinforcement learning from human feedback
  ☆154Updated this week
• juraam / snake-diffusion
  Implementation snake game based on Diffusion model
  ☆83Updated 3 weeks ago
• orobix / quadra
  Quadra: Effortless and reproducible deep learning workflows with configuration files.
  ☆47Updated this week
• HHU-MMBS / RepresentationLearning_SS2023
  Representation Learning MSc course Summer Semester 2023
  ☆73Updated last year
• huggingface / picotron_tutorial
  ☆121Updated this week
• TheMody / No-learning-rates-needed-Introducing-SALSA-Stable-Armijo-Line-Search-Adaptation
  SaLSa Optimizer implementation (No learning rates needed)
  ☆28Updated 2 months ago
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆123Updated last year
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆95Updated last month
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆50Updated 9 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆343Updated last week