Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization, with PyTorch/CUDA
☆42Feb 27, 2024Updated 2 years ago
Alternatives and similar repositories for minbpe-pytorch
Users that are interested in minbpe-pytorch are comparing it to the libraries listed below
Sorting:
- Project exploring 3D volumetric rendering of NEXRAD radar data.☆11Oct 23, 2023Updated 2 years ago
- see github.com/understanding-search/maze-transformer☆10Dec 8, 2023Updated 2 years ago
- An analog touch screen joystick that pretends to be a bevy gamepad☆13Jul 13, 2024Updated last year
- The AI that helps you achieve your goals☆11Feb 4, 2024Updated 2 years ago
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆13Feb 13, 2023Updated 3 years ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆10Aug 29, 2023Updated 2 years ago
- Benchmarking LLM Inference Speeds☆13Feb 4, 2026Updated last month
- ☆12Oct 23, 2022Updated 3 years ago
- ☆11Jun 8, 2023Updated 2 years ago
- Implementation of a multi-agent system for the modeling of carpooling in a city with one-way streets. Used Python and the Mesa package fo…☆14Jan 19, 2022Updated 4 years ago
- Transcribe with ease :D☆16Jun 21, 2023Updated 2 years ago
- Ability is a browser extension that helps people with varying degrees of ability have more control over their browsing experience.☆22Sep 24, 2025Updated 5 months ago
- The Parrot stable and deterministic multi-threading system.☆25Nov 9, 2013Updated 12 years ago
- This is a public repository for collecting excellent visualizations of knowledge and/or data.☆17Jan 6, 2021Updated 5 years ago
- ☆22Sep 9, 2021Updated 4 years ago
- ☆28Jul 29, 2025Updated 7 months ago
- ☆29Jul 17, 2023Updated 2 years ago
- Peer to peer video chat, file sharing etc☆69Mar 28, 2025Updated 11 months ago
- Rapid prototyping GUI, and visual printf-style debugging for computer vision development.☆25Apr 18, 2022Updated 3 years ago
- This repo is built to facilitate the training and analysis of autoregressive transformers on maze-solving tasks.☆34Oct 28, 2025Updated 4 months ago
- Tools to analyse and experiment with ActivityWatch data☆34Jun 25, 2024Updated last year
- Python library for analyzing, exploring, and visualizing epitrochoids and hypotrochoids in just a few lines of code☆31Jul 7, 2023Updated 2 years ago
- Visual Transformer Mechanistic Analysis Tool☆35Jun 3, 2023Updated 2 years ago
- ChatGPT-History-Downloader is a Chrome/Edge extension to help download chat history with OpenAI ChatGPT☆29Aug 23, 2025Updated 6 months ago
- This repository contains content related to 2D and 3D lane detection, as well as video lane detection. There are not only papers here, bu…☆13Sep 1, 2024Updated last year
- An open-source session replay tool for single-page applications that uses AI analysis, aggregated trends, and a RAG chatbot to help devel…☆11Jan 23, 2026Updated last month
- Auditing agents for fine-tuning safety☆20Oct 21, 2025Updated 4 months ago
- ☆35Sep 13, 2023Updated 2 years ago
- Topological Neuron Synthesis☆42Feb 26, 2025Updated last year
- 3d Cellular Automata using WGPU in Rust (for the web and using compute shaders)☆37Mar 4, 2025Updated last year
- Includes several examples of data manipulation techniques by using PySpark and machine learning algorithms using MLib☆10Jun 14, 2021Updated 4 years ago
- Agent Based Fire Evacuation Model built using Project Mesa☆41Mar 6, 2023Updated 3 years ago
- Official AYON<->Kitsu intetgration (WIP)☆12Jan 27, 2026Updated last month
- Sandbox that demonstrates derivation of camera Log to Linear conversions, and an ACES IDT and ODT for Z-Log 2.☆10Nov 14, 2021Updated 4 years ago
- Innervator: Hardware Acceleration for Neural Networks☆18Aug 3, 2024Updated last year
- Peer-to-peer NATS message routing and S3 object sync solution☆18Feb 5, 2026Updated last month
- A salesforce library designed to provide idiomatic clojure representations of salesforce data and metadata☆11Jan 14, 2020Updated 6 years ago
- Calculate how much a LLM completion costs☆16Updated this week
- A distributed graph database system (GDBMS)☆11Feb 20, 2023Updated 3 years ago