An autoregressive character-level language model for making more things
☆3,703Jun 4, 2024Updated last year
Alternatives and similar repositories for makemore
Users that are interested in makemore are comparing it to the libraries listed below
Sorting:
- A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API☆14,944Aug 8, 2024Updated last year
- Neural Networks: Zero to Hero☆20,598Aug 18, 2024Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆54,071Nov 12, 2025Updated 3 months ago
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆10,358Jul 1, 2024Updated last year
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆23,845Aug 15, 2024Updated last year
- ☆4,544Jan 31, 2024Updated 2 years ago
- Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …☆720Feb 3, 2024Updated 2 years ago
- LLM training in simple, raw C/CUDA☆29,054Jun 26, 2025Updated 8 months ago
- LLM101n: Let's build a Storyteller☆36,432Aug 1, 2024Updated last year
- Inference Llama 2 in one file of pure C☆19,232Aug 6, 2024Updated last year
- Video+code lecture on building nanoGPT from scratch☆4,776Aug 13, 2024Updated last year
- Notebooks and various random fun☆1,147Apr 18, 2023Updated 2 years ago
- From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)☆790Oct 30, 2024Updated last year
- You like pytorch? You like micrograd? You love tinygrad! ❤️☆31,523Updated this week
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆17,473Feb 8, 2026Updated last month
- Fast and memory-efficient exact attention☆22,460Updated this week
- arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors …☆1,481Jun 19, 2023Updated 2 years ago
- Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes☆1,867Jun 21, 2021Updated 4 years ago
- LLM inference in C/C++☆97,252Updated this week
- A numeric optimization package for Torch.☆38Aug 19, 2021Updated 4 years ago
- Train transformer language models with reinforcement learning.☆17,523Updated this week
- NanoGPT (124M) in 2 minutes☆4,734Feb 27, 2026Updated last week
- llama3 implementation one matrix multiplication at a time☆15,242May 23, 2024Updated last year
- Accessible large language models via k-bit quantization for PyTorch.☆8,019Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆71,883Updated this week
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆157,462Updated this week
- Tensor library for machine learning☆14,195Feb 27, 2026Updated last week
- Development repository for the Triton language and compiler☆18,573Updated this week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,185Aug 22, 2025Updated 6 months ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,206Mar 1, 2026Updated last week
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more☆34,987Mar 3, 2026Updated last week
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆8,902May 3, 2024Updated last year
- 🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.☆32,923Updated this week
- The agent engineering platform☆128,595Updated this week
- DSPy: The framework for programming—not prompting—language models☆32,519Updated this week
- Solve puzzles. Improve your pytorch.☆3,966Jul 15, 2024Updated last year
- Implement a ChatGPT-like LLM in PyTorch from scratch, step by step☆87,151Updated this week
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆9,415Feb 20, 2026Updated 2 weeks ago
- Unsupervised text tokenizer for Neural Network-based text generation.☆11,677Mar 1, 2026Updated last week