Alternatives and similar repositories for makemore

Users that are interested in makemore are comparing it to the libraries listed below

• karpathy / micrograd
  A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API
  ☆14,546Updated last year
• karpathy / ng-video-lecture
  ☆4,513Updated 2 years ago
• karpathy / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆4,719Updated last year
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆10,293Updated last year
• karpathy / cryptos
  Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes
  ☆1,859Updated 4 years ago
• karpathy / nn-zero-to-hero
  Neural Networks: Zero to Hero
  ☆20,161Updated last year
• karpathy / lecun1989-repro
  Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …
  ☆710Updated 2 years ago
• KellerJordan / modded-nanogpt
  NanoGPT (124M) in 2 minutes
  ☆4,589Updated last week
• karpathy / nanoGPT
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆52,642Updated 2 months ago
• karpathy / llm.c
  LLM training in simple, raw C/CUDA
  ☆28,763Updated 7 months ago
• karpathy / randomfun
  Notebooks and various random fun
  ☆1,144Updated 2 years ago
• srush / Tensor-Puzzles
  Solve puzzles. Improve your pytorch.
  ☆3,912Updated last year
• meta-pytorch / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆6,180Updated 5 months ago
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆19,146Updated last year
• karpathy / minGPT
  A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
  ☆23,451Updated last year
• hkproj / pytorch-transformer
  Attention is all you need implementation
  ☆1,156Updated last year
• huggingface / picotron
  Minimalistic 4D-parallelism distributed training framework for education purpose
  ☆2,058Updated 5 months ago
• jacobhilton / deep_learning_curriculum
  Language model alignment-focused deep learning curriculum
  ☆1,531Updated last year
• jaymody / picoGPT
  An unnecessarily tiny implementation of GPT-2 in NumPy.
  ☆3,443Updated 2 years ago
• karpathy / transformers
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
  ☆175Updated 3 years ago
• policy-gradient / GRPO-Zero
  Implementing DeepSeek R1's GRPO algorithm from scratch
  ☆1,759Updated 9 months ago
• tysam-code / hlb-CIFAR10
  Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)
  ☆1,299Updated last year
• naklecha / llama3-from-scratch
  llama3 implementation one matrix multiplication at a time
  ☆15,241Updated last year
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆1,151Updated 2 years ago
• openai / transformer-debugger
  ☆4,112Updated last year
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,092Updated 7 months ago
• tinygrad / teenygrad
  If tinygrad wasn't small enough for you...
  ☆774Updated last year
• minitorch / minitorch
  The full minitorch student suite.
  ☆2,292Updated last year
• TransformerLensOrg / TransformerLens
  A library for mechanistic interpretability of GPT-style language models
  ☆3,049Updated this week
• lucidrains / x-transformers
  A concise but complete full-attention transformer with a set of promising experimental features from various papers
  ☆5,795Updated last month