An autoregressive character-level language model for making more things
☆3,681Jun 4, 2024Updated last year
Alternatives and similar repositories for makemore
Users that are interested in makemore are comparing it to the libraries listed below
Sorting:
- A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API☆14,774Aug 8, 2024Updated last year
- Neural Networks: Zero to Hero☆20,397Aug 18, 2024Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆53,743Nov 12, 2025Updated 3 months ago
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆10,329Jul 1, 2024Updated last year
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆23,667Aug 15, 2024Updated last year
- ☆4,534Jan 31, 2024Updated 2 years ago
- Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …☆715Feb 3, 2024Updated 2 years ago
- LLM training in simple, raw C/CUDA☆28,940Jun 26, 2025Updated 8 months ago
- LLM101n: Let's build a Storyteller☆36,357Aug 1, 2024Updated last year
- Inference Llama 2 in one file of pure C☆19,186Aug 6, 2024Updated last year
- Video+code lecture on building nanoGPT from scratch☆4,763Aug 13, 2024Updated last year
- Notebooks and various random fun☆1,146Apr 18, 2023Updated 2 years ago
- From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)☆789Oct 30, 2024Updated last year
- You like pytorch? You like micrograd? You love tinygrad! ❤️☆31,424Updated this week
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆17,384Feb 8, 2026Updated 2 weeks ago
- Fast and memory-efficient exact attention☆22,361Updated this week
- arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors …☆1,480Jun 19, 2023Updated 2 years ago
- Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes☆1,865Jun 21, 2021Updated 4 years ago
- LLM inference in C/C++☆95,726Updated this week
- A numeric optimization package for Torch.☆38Aug 19, 2021Updated 4 years ago
- NanoGPT (124M) in 2 minutes☆4,679Updated this week
- Train transformer language models with reinforcement learning.☆17,460Updated this week
- llama3 implementation one matrix multiplication at a time☆15,243May 23, 2024Updated last year
- Accessible large language models via k-bit quantization for PyTorch.☆7,997Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆71,234Updated this week
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆157,071Updated this week
- Tensor library for machine learning☆14,152Updated this week
- Development repository for the Triton language and compiler☆18,460Feb 22, 2026Updated last week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,184Aug 22, 2025Updated 6 months ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,182Feb 22, 2026Updated last week
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more☆34,940Updated this week
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆8,891May 3, 2024Updated last year
- 🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.☆32,873Updated this week
- 🦜🔗 The platform for reliable agents.☆127,192Updated this week
- DSPy: The framework for programming—not prompting—language models☆32,381Updated this week
- Solve puzzles. Improve your pytorch.☆3,950Jul 15, 2024Updated last year
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆9,401Feb 20, 2026Updated last week
- Implement a ChatGPT-like LLM in PyTorch from scratch, step by step☆86,149Feb 19, 2026Updated last week
- Unsupervised text tokenizer for Neural Network-based text generation.☆11,668Updated this week