Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization, with PyTorch/CUDA
☆43Feb 27, 2024Updated 2 years ago
Alternatives and similar repositories for minbpe-pytorch
Users that are interested in minbpe-pytorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ✒️ A gallery of experiments with Scalable Vector Graphics (SVG) and interactive visualizations.☆13Jan 6, 2023Updated 3 years ago
- The AI that helps you achieve your goals☆11Feb 4, 2024Updated 2 years ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆11Aug 29, 2023Updated 3 years ago
- A better way to (not) waste your time☆10Oct 18, 2022Updated 4 years ago
- Creative diagrams in Ti𝑘Z☆13Mar 25, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An experimental tool to explore GPT-3's "miraculous" ability not only to spell its own token strings (it being a "character blind" model)…☆12Oct 3, 2023Updated 3 years ago
- Serialization library for Exceptions and Tracebacks.☆13Oct 6, 2023Updated 3 years ago
- Quantifying degeneracy in toy models☆11Sep 6, 2024Updated 2 years ago
- Automated terminal emulator benchmarks☆23Oct 26, 2026Updated 3 weeks ago
- An analog touch screen joystick that pretends to be a bevy gamepad☆13Jul 13, 2024Updated 2 years ago
- Examples using the Leap Interpretability Engine!☆10Dec 22, 2023Updated 2 years ago
- A small game demonstrating a grid distortion effect☆15Oct 5, 2021Updated 5 years ago
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆15Feb 13, 2023Updated 3 years ago
- Project exploring 3D volumetric rendering of NEXRAD radar data.☆13Oct 23, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A command line utility for doing polarization simulations☆17Aug 21, 2019Updated 7 years ago
- Implementation of a multi-agent system for the modeling of carpooling in a city with one-way streets. Used Python and the Mesa package fo…☆14Jan 19, 2022Updated 4 years ago
- Ability is a browser extension that helps people with varying degrees of ability have more control over their browsing experience.☆23Sep 24, 2025Updated last year
- Bindings to Nvidia Labs's ꟻLIP image comparison and error visualization library☆23Updated this week
- Export userdata from your reddit accounts. Submissions, comments, saved, upvoted contents are supported.☆23Jul 8, 2026Updated 4 months ago
- A visionOS project that demonstrates how to scale a volume to account for Window Zoom changes☆18Apr 3, 2024Updated 2 years ago
- Hypercorn is an ASGI and WSGI Server based on Hyper libraries and inspired by Gunicorn.☆22Jan 12, 2026Updated 10 months ago
- ☆29Jun 30, 2026Updated 4 months ago
- GPT4 Tokenizer Visualizer☆23May 21, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- The missing Xcode Debugger Tools for RealityKit☆11Feb 5, 2022Updated 4 years ago
- Transcribe with ease :D☆15Jun 21, 2023Updated 3 years ago
- This is a public repository for collecting excellent visualizations of knowledge and/or data.☆18Jan 6, 2021Updated 5 years ago
- Rapid prototyping GUI, and visual printf-style debugging for computer vision development.☆25Apr 18, 2022Updated 4 years ago
- A CommonJS port of rtomayko's ronn☆13Oct 12, 2011Updated 15 years ago
- VibEx (vx) is a developer-friendly CLI tool that streamlines the process of working with AI coding assistants. It helps developers prepar…☆29Jul 10, 2026Updated 4 months ago
- ☆22Sep 9, 2021Updated 5 years ago
- gpt completions in vscode☆35Mar 24, 2023Updated 3 years ago
- ChatGPT-History-Downloader is a Chrome/Edge extension to help download chat history with OpenAI ChatGPT☆29Aug 23, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tools to analyse and experiment with ActivityWatch data☆36Updated this week
- ☆32Jul 17, 2023Updated 3 years ago
- Downloading all files of a language from the OSCAR (Open Super-large Crawled Aggregated coRpus)☆11Feb 28, 2023Updated 3 years ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆42Aug 2, 2023Updated 3 years ago
- Formulaire en ligne qui génère une attestation de déplacement dérogatoire☆10Mar 18, 2020Updated 6 years ago
- Code and experiments for the COLING2020 paper "Conception: Multilingually-Enhanced, Human-Readable Concept Vector Representations".☆11Dec 9, 2020Updated 5 years ago
- 📈 Interactive decision boundary visualizer☆10Sep 4, 2018Updated 8 years ago
Are these results useful?