This repository provides a clear, educational implementation of Byte Pair Encoding (BPE) tokenization in plain Python. The focus is on algorithmic understanding, not raw performance.
☆20Aug 28, 2024Updated last year
Alternatives and similar repositories for efficient_bpe_explanation
Users that are interested in efficient_bpe_explanation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Material de apoyo de la Materia Análisis Predictivo de la Licenciatura en Analítica (Data Science) ITBA☆14Mar 4, 2026Updated 4 months ago
- Acoustic-prosodic entrainment measurement in spoken dialogue and approximation of the evolution of a speaker’s a/p features.☆14Feb 26, 2024Updated 2 years ago
- ☆14Apr 24, 2024Updated 2 years ago
- I modified some code of K-BERT so that it can be fit to English datasets Topics Resources☆11Dec 15, 2022Updated 3 years ago
- A Javascript implementation of Pytorch with WebGPU.☆14Apr 20, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LaTeX snippets for Sublime Text.☆10Sep 20, 2017Updated 8 years ago
- [ICLR 2026] Meta-RL Induces Exploration in Language Agents☆45Feb 1, 2026Updated 5 months ago
- ☆10Mar 2, 2024Updated 2 years ago
- A web interface to understand language-specific BERT-models☆18Apr 16, 2024Updated 2 years ago
- Replication of "Regularizing and Optimizing LSTM Language Models" by Merity et al. (2017).☆12Sep 17, 2019Updated 6 years ago
- Reimplentation of paper using gzip + knn for text classification☆18Aug 1, 2023Updated 2 years ago
- ☆13Oct 25, 2024Updated last year
- A repo to do interpretability of pre-trained acoustic models☆15Oct 15, 2023Updated 2 years ago
- Provincias y departamentos de Argentina renderizados con Leafletjs.com☆17Feb 23, 2019Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Source code of "FlowWalker: A Memory-efficient and High-performance GPU-based Dynamic Graph Random Walk Framework"☆11Oct 23, 2024Updated last year
- ☆12Sep 11, 2020Updated 5 years ago
- ☆14Jan 12, 2022Updated 4 years ago
- GPU based Compressed Graph Traversal☆16Jan 9, 2026Updated 6 months ago
- Model and datasets for schema matching☆15Jul 17, 2021Updated 5 years ago
- ☆15Nov 27, 2023Updated 2 years ago
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Apr 15, 2022Updated 4 years ago
- Globe Engineer - Handkerchief: A higher quality alternative to vector database RAG.☆24Jan 4, 2024Updated 2 years ago
- GPU TopK Benchmark☆18Dec 19, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆19Nov 21, 2022Updated 3 years ago
- RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs☆20Feb 8, 2026Updated 5 months ago
- An API wrapper for Google's Perspective API☆20Sep 1, 2021Updated 4 years ago
- [ICML 2025] CoreMatching: Co-adaptive Sparse Inference Framework for Comprehensive Acceleration of Vision Language Model☆16May 27, 2025Updated last year
- Source code of the paper "OpSparse: a Highly Optimized Framework for Sparse General Matrix Multiplication on GPUs"☆16Aug 23, 2022Updated 3 years ago
- ☆15Jan 14, 2025Updated last year
- Repository for the paper: Aligning LLMs to Ask Good Questions A Case Study in Clinical Reasoning☆18Feb 21, 2025Updated last year
- ☆16Oct 15, 2025Updated 9 months ago
- Singular Binarized Neural Network based on GPU Bit Operations (see our SC-19 paper)☆17Dec 9, 2020Updated 5 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Reverse engineering of the Redragon's peripherals LED USB command☆23Jul 22, 2021Updated 5 years ago
- Code for the ICLR'24 paper "Self-supervised Representation Learning From Random Data Projectors☆16Mar 16, 2024Updated 2 years ago
- ☆23Oct 22, 2021Updated 4 years ago
- Daily notebook/mini blog☆26Jun 14, 2026Updated last month
- Artifact of Chimera☆18May 6, 2025Updated last year
- ☆19Mar 4, 2025Updated last year
- Ruby C extension where dig meets fetch.☆28Dec 30, 2015Updated 10 years ago