Alternatives and similar repositories for micrograd

Users that are interested in micrograd are comparing it to the libraries listed below

• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆568Updated last year
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆449Updated last year
• EurekaLabsAI / ngram
  The n-gram Language Model
  ☆1,446Updated last year
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆649Updated last year
• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,432Updated last year
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆199Updated 9 years ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆818Updated 2 months ago
• MarioSieg / magnetron
  (WIP) A small but powerful, homemade PyTorch from scratch.
  ☆643Updated this week
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆136Updated 11 months ago
• smolorg / smolgrad
  small auto-grad engine inspired from Karpathy's micrograd and PyTorch
  ☆275Updated 10 months ago
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆1,856Updated last month
• Maharshi-Pandya / cudacodes
  Learnings and programs related to CUDA
  ☆420Updated 3 months ago
• KellerJordan / modded-nanogpt
  NanoGPT (124M) in 3 minutes
  ☆3,176Updated 3 months ago
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆172Updated last year
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆421Updated 7 months ago
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆916Updated 5 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆500Updated this week
• policy-gradient / GRPO-Zero
  Implementing DeepSeek R1's GRPO algorithm from scratch
  ☆1,609Updated 5 months ago
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆293Updated 2 months ago
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆166Updated 3 months ago
• dzyim / ilya-sutskever-recommended-reading
  It is said that, Ilya Sutskever gave John Carmack this reading list of ~ 30 research papers on deep learning.
  ☆859Updated last year
• karpathy / calorie
  nice and effective super simple calorie counter web app
  ☆100Updated last year
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆856Updated 7 months ago
• Quentin-Anthony / nanoMPI
  Simple MPI implementation for prototyping or learning
  ☆284Updated 2 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆197Updated 7 months ago
• Quentin-Anthony / torch-profiling-tutorial
  ☆509Updated 2 months ago
• karpathy / transformers
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
  ☆140Updated 3 years ago
• 1y33 / 100Days
  GPU Kernels
  ☆201Updated 5 months ago
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆914Updated 8 months ago
• arpitingle / gpu-alpha
  High Quality Resources on GPU Programming/Architecture
  ☆589Updated last year