Alternatives and similar repositories for micrograd

Users that are interested in micrograd are comparing it to the libraries listed below

• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆559Updated last year
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆442Updated last year
• EurekaLabsAI / ngram
  The n-gram Language Model
  ☆1,439Updated last year
• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,424Updated last year
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆649Updated last year
• ulrichstern / cuda-convnet
  Alex Krizhevsky's original code from Google Code
  ☆196Updated 9 years ago
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆1,701Updated last week
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆137Updated 9 months ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆813Updated last month
• MarioSieg / magnetron
  (WIP) A small but powerful, homemade PyTorch from scratch.
  ☆635Updated this week
• KellerJordan / modded-nanogpt
  NanoGPT (124M) in 3 minutes
  ☆3,074Updated last month
• mesozoic-egg / tinygrad-notes
  Tutorials on tinygrad
  ☆406Updated last month
• Laz4rz / GPT-2
  Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
  ☆172Updated last year
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆267Updated 3 weeks ago
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆907Updated 4 months ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆393Updated 5 months ago
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆164Updated 2 months ago
• policy-gradient / GRPO-Zero
  Implementing DeepSeek R1's GRPO algorithm from scratch
  ☆1,548Updated 4 months ago
• Maharshi-Pandya / cudacodes
  Learnings and programs related to CUDA
  ☆416Updated 2 months ago
• PrimeIntellect-ai / prime-rl
  Decentralized RL Training at Scale
  ☆546Updated this week
• Quentin-Anthony / nanoMPI
  Simple MPI implementation for prototyping or learning
  ☆279Updated 3 weeks ago
• smolorg / smolgrad
  small auto-grad engine inspired from Karpathy's micrograd and PyTorch
  ☆276Updated 9 months ago
• rwitten / HighPerfLLMs2024
  ☆530Updated last year
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆470Updated 6 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆181Updated 5 months ago
• tinygrad / teenygrad
  If tinygrad wasn't small enough for you...
  ☆736Updated last year
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆1,094Updated last year
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,972Updated 9 months ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆156Updated last year
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆880Updated 7 months ago