The missing tiktoken training code
☆509Jan 3, 2026Updated 7 months ago
Alternatives and similar repositories for rustbpe
Users that are interested in rustbpe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Analyzing Hacker News discussions from a decade ago in hindsight with LLMs☆669Dec 10, 2025Updated 8 months ago
- Minimal Claude Code alternative. Single Python file, zero dependencies, ~250 lines.☆2,552Jan 14, 2026Updated 7 months ago
- The best ChatGPT that $100 can buy.☆57,290Aug 2, 2026Updated 2 weeks ago
- Render any git repo into a single static HTML page for humans or LLMs☆2,437Aug 21, 2025Updated 11 months ago
- Quick illustration of how one can easily read books together with LLMs. It's great and I highly recommend it.☆3,837Nov 18, 2025Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,282Aug 26, 2025Updated 11 months ago
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆252Jun 27, 2022Updated 4 years ago
- nice and effective super simple calorie counter web app☆163May 30, 2024Updated 2 years ago
- NanoGPT (124M) in 90 seconds☆5,681Aug 9, 2026Updated last week
- Persistent dict, backed by sqlite3 and pickle, multithread-safe.☆49Feb 21, 2020Updated 6 years ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆359Nov 2, 2025Updated 9 months ago
- Automating research publications discovery and analysis. For example, ever wish your computer could automatically open papers that are mo…☆500Sep 1, 2023Updated 2 years ago
- A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API☆17,173Aug 3, 2026Updated 2 weeks ago
- Game making library for using Canvas element☆109Oct 17, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Intelligent Scientific Literature Explorer | Discover, compare, and organize research across arXiv, Semantic Scholar & OpenAlex — powered…☆15Jul 10, 2026Updated last month
- The simplest, fastest repository for training/finetuning small-sized VLMs.☆4,987Oct 27, 2025Updated 9 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆62,188Nov 12, 2025Updated 9 months ago
- Our library for RL environments + evals☆4,521Updated this week
- A modular, production-grade framework for Reinforcement Learning from Human Feedback (RLHF) with Proximal Policy Optimization (PPO) and D…☆24Jun 6, 2026Updated 2 months ago
- A numeric optimization package for Torch.☆42Aug 19, 2021Updated 4 years ago
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆10,682Jul 1, 2024Updated 2 years ago
- PyTorch Single Controller☆1,073Updated this week
- gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI☆20,317Jul 24, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- LLM training in simple, raw C/CUDA☆30,825Jun 26, 2025Updated last year
- A set of tools/pages that help explore academic literature☆88Aug 11, 2014Updated 12 years ago
- ☆15Dec 4, 2025Updated 8 months ago
- AI agents running research on single-GPU nanochat training automatically☆94,072Mar 26, 2026Updated 4 months ago
- LLM Council works together to answer your hardest questions☆24,135Nov 22, 2025Updated 8 months ago
- One library, four surfaces. Production-grade Kolmogorov-Arnold Networks || TensorFlow + PyTorch + ONNX. || A small KAN beats a 10× larger…☆33Jul 9, 2026Updated last month
- A PyTorch native platform for training generative AI models☆5,636Updated this week
- Implementation of the fast weight product key memory from Sakana AI☆19Updated this week
- Efficient Triton Kernels for LLM Training☆6,569Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- UNet diffusion model in pure CUDA☆663Jun 28, 2024Updated 2 years ago
- Simple Byte pair Encoding mechanism used for tokenization process . written purely in C☆152Nov 11, 2024Updated last year
- CIFAR-10 speedrun: Trains to 94% accuracy in 1.98 seconds on a single NVIDIA A100 GPU.☆79Jul 30, 2026Updated 2 weeks ago
- Implementing DeepSeek R1's GRPO algorithm from scratch☆1,895Apr 18, 2025Updated last year
- Simple MPI implementation for prototyping or learning☆326Aug 6, 2025Updated last year
- Minimalistic large language model 3D-parallelism training☆2,787May 26, 2026Updated 2 months ago
- Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models☆4,596Jan 14, 2026Updated 7 months ago