kuprel / minbpe-pytorchView external linksLinks
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization, with PyTorch/CUDA
☆42Feb 27, 2024Updated last year
Alternatives and similar repositories for minbpe-pytorch
Users that are interested in minbpe-pytorch are comparing it to the libraries listed below
Sorting:
- An analog touch screen joystick that pretends to be a bevy gamepad☆13Jul 13, 2024Updated last year
- Customizable charts made with TikZ and LaTeX3☆14Feb 11, 2023Updated 3 years ago
- see github.com/understanding-search/maze-transformer☆10Dec 8, 2023Updated 2 years ago
- The AI that helps you achieve your goals☆11Feb 4, 2024Updated 2 years ago
- Benchmarking LLM Inference Speeds☆13Feb 4, 2026Updated last week
- ☆11Jun 8, 2023Updated 2 years ago
- ☆12Oct 23, 2022Updated 3 years ago
- Implementation of a multi-agent system for the modeling of carpooling in a city with one-way streets. Used Python and the Mesa package fo…☆14Jan 19, 2022Updated 4 years ago
- Ability is a browser extension that helps people with varying degrees of ability have more control over their browsing experience.☆22Sep 24, 2025Updated 4 months ago
- A visionOS project that demonstrates how to scale a volume to account for Window Zoom changes☆18Apr 3, 2024Updated last year
- The Parrot stable and deterministic multi-threading system.☆25Nov 9, 2013Updated 12 years ago
- GPT4 Tokenizer Visualizer☆23May 21, 2023Updated 2 years ago
- gpt completions in vscode☆35Mar 24, 2023Updated 2 years ago
- Export userdata from your reddit accounts. Submissions, comments, saved, upvoted contents are supported.☆23Oct 31, 2024Updated last year
- This is a public repository for collecting excellent visualizations of knowledge and/or data.☆17Jan 6, 2021Updated 5 years ago
- ☆27Jul 29, 2025Updated 6 months ago
- ☆29Jul 17, 2023Updated 2 years ago
- Peer to peer video chat, file sharing etc☆69Mar 28, 2025Updated 10 months ago
- This repo is built to facilitate the training and analysis of autoregressive transformers on maze-solving tasks.☆34Oct 28, 2025Updated 3 months ago
- Rapid prototyping GUI, and visual printf-style debugging for computer vision development.☆25Apr 18, 2022Updated 3 years ago
- Export NetworkX graphs to TikZ directly☆31May 7, 2025Updated 9 months ago
- Tools to analyse and experiment with ActivityWatch data☆34Jun 25, 2024Updated last year
- ChatGPT-History-Downloader is a Chrome/Edge extension to help download chat history with OpenAI ChatGPT☆29Aug 23, 2025Updated 5 months ago
- Auditing agents for fine-tuning safety☆18Oct 21, 2025Updated 3 months ago
- ☆34Jan 13, 2022Updated 4 years ago
- ☆35Sep 13, 2023Updated 2 years ago
- 3d Cellular Automata using WGPU in Rust (for the web and using compute shaders)☆37Mar 4, 2025Updated 11 months ago
- Includes several examples of data manipulation techniques by using PySpark and machine learning algorithms using MLib☆10Jun 14, 2021Updated 4 years ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆40Aug 2, 2023Updated 2 years ago
- Analyse (group)chat messages. Currently supports: Facebook Messenger. Planned: Signal, Discord, WhatsApp☆42Jul 18, 2022Updated 3 years ago
- Layout and custom fields for DanePubliczne.gov.pl☆10Dec 7, 2022Updated 3 years ago
- Peer-to-peer NATS message routing and S3 object sync solution☆18Feb 5, 2026Updated last week
- Schema-aware JSON compression with millisecond lookups — cut transfer/storage while enabling exists*/pos* queries. (Demo + wheels; core i…☆24Jan 22, 2026Updated 3 weeks ago
- A distributed graph database system (GDBMS)☆11Feb 20, 2023Updated 2 years ago
- mass-contact text/SMS distribution tool☆11Apr 28, 2025Updated 9 months ago
- GraphicalDebugging extension for Visual Studio Code☆46Dec 24, 2025Updated last month
- Official AYON<->Kitsu intetgration (WIP)☆12Jan 27, 2026Updated 2 weeks ago
- Sandbox that demonstrates derivation of camera Log to Linear conversions, and an ACES IDT and ODT for Z-Log 2.☆10Nov 14, 2021Updated 4 years ago
- A salesforce library designed to provide idiomatic clojure representations of salesforce data and metadata☆11Jan 14, 2020Updated 6 years ago