karpathy / rustbpeLinks
The missing tiktoken training code
☆342Updated last month
Alternatives and similar repositories for rustbpe
Users that are interested in rustbpe are comparing it to the libraries listed below
Sorting:
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆334Updated 3 months ago
- Simple MPI implementation for prototyping or learning☆300Updated 6 months ago
- Simple Byte pair Encoding mechanism used for tokenization process . written purely in C☆146Updated last year
- A lightweight, local-first, and 🆓 experiment tracking library from Hugging Face 🤗☆1,244Updated last week
- (WIP) A small but powerful, homemade PyTorch from scratch.☆672Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆198Updated 8 months ago
- SIMD quantization kernels☆94Updated 5 months ago
- ☆544Updated 6 months ago
- UNet diffusion model in pure CUDA☆661Updated last year
- Load compute kernels from the Hub☆397Updated this week
- ☆214Updated 2 weeks ago
- Where GPUs get cooked 👩🍳🔥☆363Updated 2 weeks ago
- Async RL Training at Scale☆1,044Updated this week
- Learnings and programs related to CUDA☆432Updated 7 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,058Updated 5 months ago
- Simple & Scalable Pretraining for Neural Architecture Research☆307Updated 2 months ago
- ☆961Updated 3 months ago
- Best practices & guides on how to write distributed pytorch training code☆575Updated 3 months ago
- dLLM: Simple Diffusion Language Modeling☆1,716Updated this week
- Frontier Models playing the board game Diplomacy.☆628Updated last month
- Dion optimizer algorithm☆431Updated 3 weeks ago
- An interface library for RL post training with environments.☆1,112Updated last week
- 👷 Build compute kernels☆215Updated last week
- Fast bare-bones BPE for modern tokenizer training☆175Updated 7 months ago
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆655Updated 7 months ago
- Quantized LLM training in pure CUDA/C++.☆238Updated 2 weeks ago
- small auto-grad engine inspired from Karpathy's micrograd and PyTorch☆276Updated last year
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆593Updated 4 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆457Updated 10 months ago
- Super basic implementation (gist-like) of RLMs with REPL environments.☆592Updated last month