karpathy / makemore
An autoregressive character-level language model for making more things
☆2,828Updated 8 months ago
Alternatives and similar repositories for makemore:
Users that are interested in makemore are comparing it to the libraries listed below
- A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API☆11,194Updated 6 months ago
- Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes☆1,676Updated 3 years ago
- ☆3,776Updated last year
- The n-gram Language Model☆1,386Updated 6 months ago
- Neural Networks: Zero to Hero☆13,229Updated 6 months ago
- Video+code lecture on building nanoGPT from scratch☆3,883Updated 6 months ago
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆9,403Updated 7 months ago
- nanoGPT style version of Llama 3.1☆1,316Updated 6 months ago
- NanoGPT (124M) in 3 minutes☆2,294Updated this week
- A library for mechanistic interpretability of GPT-style language models☆1,868Updated this week
- Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …☆623Updated last year
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆5,790Updated 2 months ago
- Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)☆1,251Updated 2 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆39,429Updated 2 months ago
- ☆4,058Updated 8 months ago
- The Autograd Engine☆573Updated 5 months ago
- arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors …☆1,234Updated last year
- Solve puzzles. Improve your pytorch.☆3,427Updated 7 months ago
- Accessible large language models via k-bit quantization for PyTorch.☆6,697Updated this week
- Puzzles for learning Triton☆1,403Updated 3 months ago
- The Multilayer Perceptron Language Model☆538Updated 6 months ago
- Some ipython notebooks implementing AI algorithms☆1,303Updated 4 months ago
- Language model alignment-focused deep learning curriculum☆1,327Updated 6 months ago
- An unnecessarily tiny implementation of GPT-2 in NumPy.☆3,311Updated last year
- llama3 implementation one matrix multiplication at a time☆14,139Updated 8 months ago
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆21,388Updated 6 months ago
- A JAX research toolkit for building, editing, and visualizing neural networks.☆1,731Updated 2 months ago
- If tinygrad wasn't small enough for you...☆686Updated 11 months ago
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆117Updated 2 years ago
- Inference Llama 2 in one file of pure C☆18,034Updated 6 months ago