The missing tiktoken training code
☆530Jan 3, 2026Updated 10 months ago
Alternatives and similar repositories for rustbpe
Users that are interested in rustbpe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Python programming language☆108Dec 19, 2025Updated 11 months ago
- Analyzing Hacker News discussions from a decade ago in hindsight with LLMs☆693Dec 10, 2025Updated 11 months ago
- Tracking exactly what happens to the internal "circuitry" (induction heads) of a 2-layer attention-only Transformer when forced to underg…☆15Jul 15, 2026Updated 4 months ago
- Do what Analysts usually do with just mouse clicks☆12Nov 30, 2024Updated last year
- Legacy MATLAB/Octave codebase for the original Coursera Machine Learning course by Andrew Ng. Preserved for archival purposes before the …☆13Jan 9, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- LLM providers frequently update their models without changing the model string or announcing behavioral shifts. These changes cause silen…☆15Jul 11, 2026Updated 4 months ago
- Race-line calculation (shortest and optimal waypoints) of a DeepRacer tracks☆14May 6, 2024Updated 2 years ago
- C++17 library of hand-written x86 SIMD kernels for the arithmetic at the core of neural-network inference: matrix multiplication, the mat…☆16Oct 21, 2026Updated 3 weeks ago
- Using devices such as Jawbone Up, Nike FuelBand, and Fitbit it is now possible to collect a large amount of data about personal activity …☆15Mar 8, 2024Updated 2 years ago
- The firefly algorithm (FA) is a nature-inspired metaheuristic optimization algorithm developed by Xin-She Yang that is inspired by the fl…☆15Jan 22, 2022Updated 4 years ago
- Lossless speculative decoding for HuggingFace causal language models, with a static-cache CUDA-graph fast path.☆17Oct 29, 2026Updated 3 weeks ago
- Minimal Claude Code alternative. Single Python file, zero dependencies, ~250 lines.☆2,819Jan 14, 2026Updated 10 months ago
- The best ChatGPT that $100 can buy.☆60,631Sep 7, 2026Updated 2 months ago
- Render any git repo into a single static HTML page for humans or LLMs☆2,509Aug 21, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- nice and effective super simple calorie counter web app☆176May 30, 2024Updated 2 years ago
- Game making library for using Canvas element☆117Oct 17, 2023Updated 3 years ago
- Persistent dict, backed by sqlite3 and pickle, multithread-safe.☆53Feb 21, 2020Updated 6 years ago
- Quick illustration of how one can easily read books together with LLMs. It's great and I highly recommend it.☆3,909Nov 18, 2025Updated last year
- my profile readme☆21Updated this week
- A research tool for visually exploring Bureau of Labor Statistics Occupational Outlook Handbook data. This is not a report, a paper, or a…☆2,054Mar 16, 2026Updated 8 months ago
- Intelligent Scientific Literature Explorer | Discover, compare, and organize research across arXiv, Semantic Scholar & OpenAlex — powered…☆20Jul 10, 2026Updated 4 months ago
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆11,063Jul 1, 2024Updated 2 years ago
- focuses on analyzing and categorizing customer sales data in a supermarket.☆13Dec 18, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,347Aug 26, 2025Updated last year
- A numeric optimization package for Torch.☆44Aug 19, 2021Updated 5 years ago
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆265Jun 27, 2022Updated 4 years ago
- LLM post-training from scratch: SFT, reward model, PPO, DPO; parity-tested against TRL☆28Nov 12, 2026Updated last week
- Automating research publications discovery and analysis. For example, ever wish your computer could automatically open papers that are mo…☆525Sep 1, 2023Updated 3 years ago
- A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API☆19,019Aug 3, 2026Updated 3 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆367Nov 2, 2025Updated last year
- NanoGPT (124M) in 90 seconds☆6,053Sep 28, 2026Updated last month
- A set of tools/pages that help explore academic literature☆95Aug 11, 2014Updated 12 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Video+code lecture on building nanoGPT from scratch☆5,656Aug 13, 2024Updated 2 years ago
- LLM training in simple, raw C/CUDA☆31,506Jun 26, 2025Updated last year
- Our library for RL environments + evals☆4,793Updated this week
- One library, four surfaces. Production-grade Kolmogorov-Arnold Networks || TensorFlow + PyTorch + ONNX. || A small KAN beats a 10× larger…☆38Oct 27, 2026Updated 3 weeks ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆64,857Nov 12, 2025Updated last year
- The simplest, fastest repository for training/finetuning small-sized VLMs.☆5,077Oct 27, 2025Updated last year
- Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …☆792Feb 3, 2024Updated 2 years ago
Are these results useful?