Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization, with PyTorch/CUDA
☆43Feb 27, 2024Updated 2 years ago
Alternatives and similar repositories for minbpe-pytorch
Users that are interested in minbpe-pytorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The AI that helps you achieve your goals☆11Feb 4, 2024Updated 2 years ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆11Aug 29, 2023Updated 3 years ago
- ☆12Oct 23, 2022Updated 3 years ago
- Flight Recorder allows to record client program execution and examine it later☆11Sep 18, 2020Updated 6 years ago
- A small game demonstrating a grid distortion effect☆15Oct 5, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆11Jun 8, 2023Updated 3 years ago
- A command line utility for doing polarization simulations☆17Aug 21, 2019Updated 7 years ago
- Benchmarking LLM Inference Speeds☆14Sep 30, 2026Updated last week
- Implementation of a multi-agent system for the modeling of carpooling in a city with one-way streets. Used Python and the Mesa package fo…☆14Jan 19, 2022Updated 4 years ago
- Bindings to Nvidia Labs's ꟻLIP image comparison and error visualization library☆23Sep 21, 2026Updated 2 weeks ago
- Export userdata from your reddit accounts. Submissions, comments, saved, upvoted contents are supported.☆23Jul 8, 2026Updated 3 months ago
- A visionOS project that demonstrates how to scale a volume to account for Window Zoom changes☆18Apr 3, 2024Updated 2 years ago
- GPT4 Tokenizer Visualizer☆23May 21, 2023Updated 3 years ago
- ☆29Jun 30, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Tephigram plotting in Python☆22Updated this week
- Rapid prototyping GUI, and visual printf-style debugging for computer vision development.☆25Apr 18, 2022Updated 4 years ago
- ☆22Sep 9, 2021Updated 5 years ago
- Tools to analyse and experiment with ActivityWatch data☆36Sep 27, 2026Updated last week
- ☆16Nov 25, 2023Updated 2 years ago
- ChatGPT-History-Downloader is a Chrome/Edge extension to help download chat history with OpenAI ChatGPT☆29Aug 23, 2025Updated last year
- UI for extracting data from pdf files using watsonx prompts☆12Sep 18, 2025Updated last year
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆42Aug 2, 2023Updated 3 years ago
- UI components for frontend apps - starting with React☆11May 17, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Micro-framework for publishing linked data☆11Aug 1, 2017Updated 9 years ago
- ☆35Sep 13, 2023Updated 3 years ago
- This contains Helpful PYKD (Python Extension for Windbg) scripts☆50Mar 9, 2015Updated 11 years ago
- Demo of fine-tuning QA models for answering FAQ of cloud providers documentation☆11Jun 20, 2026Updated 3 months ago
- An Easy Annotation Tool for Natural Language Processing☆12May 17, 2024Updated 2 years ago
- Export NetworkX graphs to TikZ directly☆31May 7, 2025Updated last year
- BabelNet (and WordNet) sense embedding trained with Word2Vec and FastText☆10Sep 3, 2019Updated 7 years ago
- 3d Cellular Automata using WGPU in Rust (for the web and using compute shaders)☆37Mar 4, 2025Updated last year
- Analyse (group)chat messages. Currently supports: Facebook Messenger. Planned: Signal, Discord, WhatsApp☆42Jul 18, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆41May 7, 2026Updated 5 months ago
- GraphicalDebugging extension for Visual Studio Code☆49Mar 24, 2026Updated 6 months ago
- DEPRECATED: Provides an easy to use API to interact with SportX☆14Apr 11, 2023Updated 3 years ago
- Artifact of paper "Exploiting Recent SIMD Architectural Advances for Irregular Applications"☆11Jun 23, 2016Updated 10 years ago
- 🤖💬💡Chat with any document using conversational AI! Our project allows you to easily ask questions and get answers from any document. B…☆16Apr 17, 2024Updated 2 years ago
- A DLL load tracing tool for CPython☆64Sep 9, 2026Updated last month
- ☆13Oct 5, 2020Updated 6 years ago