Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization, with PyTorch/CUDA
☆42Feb 27, 2024Updated 2 years ago
Alternatives and similar repositories for minbpe-pytorch
Users that are interested in minbpe-pytorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Project exploring 3D volumetric rendering of NEXRAD radar data.☆13Oct 23, 2023Updated 2 years ago
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆14Feb 13, 2023Updated 3 years ago
- An analog touch screen joystick that pretends to be a bevy gamepad☆13Jul 13, 2024Updated 2 years ago
- Flight Recorder allows to record client program execution and examine it later☆11Sep 18, 2020Updated 5 years ago
- A small game demonstrating a grid distortion effect☆15Oct 5, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Ability is a browser extension that helps people with varying degrees of ability have more control over their browsing experience.☆22Sep 24, 2025Updated 9 months ago
- ☆11Jun 8, 2023Updated 3 years ago
- Benchmarking LLM Inference Speeds☆14May 17, 2026Updated 2 months ago
- Bindings to Nvidia Labs's ꟻLIP image comparison and error visualization library☆22Updated this week
- Hypercorn is an ASGI and WSGI Server based on Hyper libraries and inspired by Gunicorn.☆21Jan 12, 2026Updated 6 months ago
- Transcribe with ease :D☆16Jun 21, 2023Updated 3 years ago
- ☆28Jun 30, 2026Updated 3 weeks ago
- IonSolver is a magnetohydrodynamic simulation software featuring an extended Lattice Boltzmann method and GPU acceleration☆24May 12, 2026Updated 2 months ago
- Tephigram plotting in Python☆23Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Rapid prototyping GUI, and visual printf-style debugging for computer vision development.☆25Apr 18, 2022Updated 4 years ago
- ☆22Sep 9, 2021Updated 4 years ago
- Tools to analyse and experiment with ActivityWatch data☆35Jun 25, 2024Updated 2 years ago
- Visual Transformer Mechanistic Analysis Tool☆36Jun 3, 2023Updated 3 years ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆40Aug 2, 2023Updated 2 years ago
- Windbg Utility Tools based upon PyKD☆41Sep 9, 2020Updated 5 years ago
- Python library for analyzing, exploring, and visualizing epitrochoids and hypotrochoids in just a few lines of code☆31Jul 7, 2023Updated 3 years ago
- This contains Helpful PYKD (Python Extension for Windbg) scripts☆50Mar 9, 2015Updated 11 years ago
- Demo of fine-tuning QA models for answering FAQ of cloud providers documentation☆11Jun 20, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Export NetworkX graphs to TikZ directly☆31May 7, 2025Updated last year
- 3d Cellular Automata using WGPU in Rust (for the web and using compute shaders)☆37Mar 4, 2025Updated last year
- Analyse (group)chat messages. Currently supports: Facebook Messenger. Planned: Signal, Discord, WhatsApp☆42Jul 18, 2022Updated 4 years ago
- GraphicalDebugging extension for Visual Studio Code☆49Mar 24, 2026Updated 3 months ago
- A simple tool to add mosaic effect to images☆10Nov 28, 2021Updated 4 years ago
- MLX implementation of GCN, with benchmark on MPS, CUDA and CPU (M1 Pro, M2 Ultra, M3 Max).☆25Dec 16, 2023Updated 2 years ago
- ☆13Oct 5, 2020Updated 5 years ago
- Blindspots in LLMs I've noticed while AI coding. Sonnet family emphasis.☆13Mar 20, 2025Updated last year
- ☆59Feb 13, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Fast wavelet transforms on the sphere☆13Dec 20, 2016Updated 9 years ago
- digging the endless treasures of fastai☆20Oct 6, 2022Updated 3 years ago
- Automated terminal emulator benchmarks☆24Jun 22, 2026Updated 3 weeks ago
- Top ML papers published daily in arXiv☆44Aug 31, 2020Updated 5 years ago
- Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)☆14Oct 3, 2024Updated last year
- An open-source session replay tool for single-page applications that uses AI analysis, aggregated trends, and a RAG chatbot to help devel…☆11Jan 23, 2026Updated 5 months ago
- Using cross-language LTO in Rust project☆12Aug 15, 2021Updated 4 years ago