karpathy / build-nanogpt
Video+code lecture on building nanoGPT from scratch
☆4,023Updated 7 months ago
Alternatives and similar repositories for build-nanogpt:
Users that are interested in build-nanogpt are comparing it to the libraries listed below
- NanoGPT (124M) in 3 minutes☆2,442Updated this week
- The n-gram Language Model☆1,408Updated 7 months ago
- nanoGPT style version of Llama 3.1☆1,350Updated 7 months ago
- PyTorch native post-training library☆5,041Updated this week
- An autoregressive character-level language model for making more things☆2,975Updated 10 months ago
- A PyTorch native library for large model training☆3,540Updated this week
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆9,542Updated 9 months ago
- Efficient Triton Kernels for LLM Training☆4,774Updated this week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆5,904Updated 3 weeks ago
- ☆4,072Updated 10 months ago
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,558Updated last week
- The Multilayer Perceptron Language Model☆545Updated 7 months ago
- llama3 implementation one matrix multiplication at a time☆14,763Updated 10 months ago
- A framework for few-shot evaluation of language models.☆8,467Updated this week
- LLM training in simple, raw C/CUDA☆26,184Updated 6 months ago
- Puzzles for learning Triton☆1,547Updated 4 months ago
- verl: Volcano Engine Reinforcement Learning for LLMs☆5,994Updated this week
- Curated list of datasets and tools for post-training.☆2,903Updated 2 months ago
- An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)☆6,051Updated this week
- The Autograd Engine☆588Updated 6 months ago
- Clean, minimal, accessible reproduction of DeepSeek R1-Zero☆11,479Updated this week
- Accessible large language models via k-bit quantization for PyTorch.☆6,876Updated this week
- A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.☆6,616Updated last week
- Agentic components of the Llama Stack APIs☆4,185Updated this week
- Go ahead and axolotl questions☆8,989Updated this week
- ☆1,127Updated last month
- Train transformer language models with reinforcement learning.☆12,998Updated this week
- A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API☆11,544Updated 7 months ago
- [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration☆2,895Updated last week
- AllenAI's post-training codebase☆2,854Updated this week