Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization, with PyTorch/CUDA
☆42Feb 27, 2024Updated 2 years ago
Alternatives and similar repositories for minbpe-pytorch
Users that are interested in minbpe-pytorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Project exploring 3D volumetric rendering of NEXRAD radar data.☆13Oct 23, 2023Updated 2 years ago
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆15Feb 13, 2023Updated 3 years ago
- The AI that helps you achieve your goals☆11Feb 4, 2024Updated 2 years ago
- Customizable charts made with TikZ and LaTeX3☆14Feb 11, 2023Updated 3 years ago
- see github.com/understanding-search/maze-transformer☆10Dec 8, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Oct 23, 2022Updated 3 years ago
- Flight Recorder allows to record client program execution and examine it later☆11Sep 18, 2020Updated 5 years ago
- A small game demonstrating a grid distortion effect☆15Oct 5, 2021Updated 4 years ago
- Ability is a browser extension that helps people with varying degrees of ability have more control over their browsing experience.☆22Sep 24, 2025Updated 10 months ago
- A command line utility for doing polarization simulations☆17Aug 21, 2019Updated 6 years ago
- Bindings to Nvidia Labs's ꟻLIP image comparison and error visualization library☆23Jul 20, 2026Updated 3 weeks ago
- Hypercorn is an ASGI and WSGI Server based on Hyper libraries and inspired by Gunicorn.☆21Jan 12, 2026Updated 6 months ago
- GPT4 Tokenizer Visualizer☆23May 21, 2023Updated 3 years ago
- Transcribe with ease :D☆16Jun 21, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆29Jun 30, 2026Updated last month
- Tephigram plotting in Python☆23Aug 3, 2026Updated last week
- This is a public repository for collecting excellent visualizations of knowledge and/or data.☆17Jan 6, 2021Updated 5 years ago
- Rapid prototyping GUI, and visual printf-style debugging for computer vision development.☆25Apr 18, 2022Updated 4 years ago
- ☆22Sep 9, 2021Updated 4 years ago
- gpt completions in vscode☆35Mar 24, 2023Updated 3 years ago
- ChatGPT-History-Downloader is a Chrome/Edge extension to help download chat history with OpenAI ChatGPT☆29Aug 23, 2025Updated 11 months ago
- Visual Transformer Mechanistic Analysis Tool☆36Jun 3, 2023Updated 3 years ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆40Aug 2, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Windbg Utility Tools based upon PyKD☆41Sep 9, 2020Updated 5 years ago
- ☆35Sep 13, 2023Updated 2 years ago
- Demo of fine-tuning QA models for answering FAQ of cloud providers documentation☆11Jun 20, 2026Updated last month
- Export NetworkX graphs to TikZ directly☆31May 7, 2025Updated last year
- ☆34Jan 13, 2022Updated 4 years ago
- Real probability scales for matplotlib☆39Nov 3, 2023Updated 2 years ago
- Analyse (group)chat messages. Currently supports: Facebook Messenger. Planned: Signal, Discord, WhatsApp☆42Jul 18, 2022Updated 4 years ago
- ☆37May 7, 2026Updated 3 months ago
- Python implementation of the random-walk inductive classification algorithm Modified Adsorption from P. Talukdar☆15Jul 30, 2014Updated 12 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- This repo is built to facilitate the training and analysis of autoregressive transformers on maze-solving tasks.☆35Oct 28, 2025Updated 9 months ago
- ☆13Oct 5, 2020Updated 5 years ago
- ☆18Jan 21, 2021Updated 5 years ago
- Layout and custom fields for DanePubliczne.gov.pl☆10Dec 7, 2022Updated 3 years ago
- Blindspots in LLMs I've noticed while AI coding. Sonnet family emphasis.☆13Mar 20, 2025Updated last year
- ☆59Feb 13, 2024Updated 2 years ago
- digging the endless treasures of fastai☆20Oct 6, 2022Updated 3 years ago