karpathy / llm.cLinks
LLM training in simple, raw C/CUDA
☆28,814Updated 7 months ago
Alternatives and similar repositories for llm.c
Users that are interested in llm.c are comparing it to the libraries listed below
Sorting:
- Inference Llama 2 in one file of pure C☆19,162Updated last year
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆10,309Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆52,642Updated 2 months ago
- llama3 implementation one matrix multiplication at a time☆15,241Updated last year
- A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API☆14,598Updated last year
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆23,494Updated last year
- Machine Learning Engineering Open Book☆16,586Updated 2 weeks ago
- Tensor library for machine learning☆13,923Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,137Updated last week
- LLM inference in C/C++☆94,823Updated this week
- Video+code lecture on building nanoGPT from scratch☆4,719Updated last year
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆8,891Updated last year
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,183Updated 5 months ago
- MLX: An array framework for Apple silicon☆23,812Updated this week
- ☆4,112Updated last year
- Fast and memory-efficient exact attention☆22,113Updated this week
- A minimal GPU design in Verilog to learn how GPUs work from the ground up☆11,290Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆69,622Updated this week
- Development repository for the Triton language and compiler☆18,387Updated this week
- LLM101n: Let's build a Storyteller☆36,281Updated last year
- An autoregressive character-level language model for making more things☆3,635Updated last year
- Material for gpu-mode lectures☆5,726Updated last week
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,346Updated last week
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,265Updated last year
- NanoGPT (124M) in 2 minutes☆4,589Updated last week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆23,439Updated this week
- Modeling, training, eval, and inference code for OLMo☆6,305Updated 2 months ago
- A PyTorch native platform for training generative AI models☆5,045Updated this week
- Neural Networks: Zero to Hero☆20,246Updated last year
- The official PyTorch implementation of Google's Gemma models☆5,601Updated 8 months ago