karpathy / makemore
An autoregressive character-level language model for making more things
☆3,005Updated 10 months ago
Alternatives and similar repositories for makemore:
Users that are interested in makemore are comparing it to the libraries listed below
- A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API☆11,623Updated 8 months ago
- ☆3,917Updated last year
- Neural Networks: Zero to Hero☆13,584Updated 7 months ago
- Video+code lecture on building nanoGPT from scratch☆4,041Updated 8 months ago
- Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes☆1,711Updated 3 years ago
- The n-gram Language Model☆1,412Updated 8 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆40,626Updated 4 months ago
- NanoGPT (124M) in 3 minutes☆2,479Updated 2 weeks ago
- nanoGPT style version of Llama 3.1☆1,352Updated 8 months ago
- The Autograd Engine☆595Updated 7 months ago
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆9,564Updated 9 months ago
- Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …☆631Updated last year
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆21,717Updated 8 months ago
- arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors …☆1,265Updated last year
- Language model alignment-focused deep learning curriculum☆1,365Updated 7 months ago
- The full minitorch student suite.☆2,047Updated 7 months ago
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆5,916Updated this week
- The Multilayer Perceptron Language Model☆544Updated 8 months ago
- LLM training in simple, raw C/CUDA☆26,288Updated 6 months ago
- Cramming the training of a (BERT-type) language model into limited compute.☆1,327Updated 10 months ago
- If tinygrad wasn't small enough for you...☆710Updated last year
- Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)☆1,251Updated 3 months ago
- An unnecessarily tiny implementation of GPT-2 in NumPy.☆3,343Updated last year
- ☆4,076Updated 10 months ago
- A PyTorch native library for large model training☆3,587Updated this week
- A library for mechanistic interpretability of GPT-style language models☆2,041Updated last week
- The Tensor (or Array)☆429Updated 8 months ago
- Solve puzzles. Improve your pytorch.☆3,518Updated 8 months ago
- A JAX research toolkit for building, editing, and visualizing neural networks.☆1,752Updated this week
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆121Updated 2 years ago