Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe
☆18Feb 19, 2024Updated 2 years ago
Alternatives and similar repositories for minbpe
Users that are interested in minbpe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.☆34Mar 1, 2024Updated 2 years ago
- JCS (JSON Canonicalization Scheme), JSON digests, and JSON Merkle hashes☆15Mar 10, 2024Updated 2 years ago
- NearForm multi-platform application accelerator☆35Jun 30, 2021Updated 4 years ago
- 🚒✨ Rescue: better errors through types (a more type directed MonadThrow/MonadCatch)☆20Feb 1, 2022Updated 4 years ago
- Homotopy type theory cheatsheets☆12Apr 15, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A CoffeScript html generator compatible with CoffeeKup but without the magic.☆27Jul 16, 2013Updated 12 years ago
- A collection of additional language phonology settings for use with VulgarLang.☆13Aug 19, 2022Updated 3 years ago
- A Modeling Notation ꕤ☆15Mar 3, 2026Updated 2 months ago
- Fast Map built for keys that are always fixed size uniformly distributed buffers.☆37Mar 21, 2022Updated 4 years ago
- Non-allocating command line flag parser☆17Mar 26, 2026Updated last month
- List key diff algorithm.☆15Nov 10, 2015Updated 10 years ago
- ☆17Feb 27, 2025Updated last year
- Monitor millions of S3 objects without external dependencies☆24Feb 6, 2025Updated last year
- A website that lets you know where to watch a movie built on Next.js and Meilisearch, deployed on Vercel with the Meilisearch + Vercel in…☆12Aug 10, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Bento - Rust Container Runtime☆46Feb 23, 2026Updated 2 months ago
- Scroll to the current anchor in the url if possible☆11Jun 18, 2017Updated 8 years ago
- NLTK ported to Javascript☆13Sep 3, 2017Updated 8 years ago
- 📤 Magically generate `fetch` types from OpenAPI schemas for zero-cost browser-native api clients☆21Apr 17, 2025Updated last year
- Parse Dat protocol SLEEP files.☆13Apr 28, 2021Updated 5 years ago
- 🎯 A Single Class CSS Framework - Classic Form Styling With Ease☆10May 13, 2020Updated 5 years ago
- Generator framework for your own Ruby framework☆74Dec 21, 2015Updated 10 years ago
- Generate typescript model definitions with just the JSON schema (including reference resolution).☆14Feb 1, 2021Updated 5 years ago
- Commander.js (command-line interfaces) for Deno.☆10Jul 22, 2020Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Promisify a callback-style function, resolving with [err,val]☆31May 19, 2021Updated 4 years ago
- 📖 CLI for dynamic runbooks: a structured and auditable approach to creating and executing operational procedures, bridging the gap betwe…☆19Mar 7, 2026Updated last month
- ☆43Mar 6, 2023Updated 3 years ago
- A stream that can substitute contents of a file in streaming fashion.☆14Aug 10, 2021Updated 4 years ago
- Lelylan API proxy☆13Dec 12, 2016Updated 9 years ago
- Implementation of "practical type inference for arbitrary-rank types" in Javascript☆12Mar 27, 2019Updated 7 years ago
- The same application, implemented and measured in both ReactN and redux.☆11Dec 10, 2020Updated 5 years ago
- HTML5 File and FormData APIs for Node.JS☆31Jan 7, 2017Updated 9 years ago
- (Alternative) Visualizer for XState☆12Mar 2, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A cross-platform scanner for wireless networks☆13Oct 4, 2015Updated 10 years ago
- Node 18's node:test, as an npm package☆99Dec 21, 2024Updated last year
- ☆84Apr 23, 2025Updated last year
- Photos of U.S. congressional representatives and scrapers used to collect them.☆14Jan 30, 2026Updated 3 months ago
- A simplified HTML5 Javascript library☆42Aug 25, 2010Updated 15 years ago
- HTML5 cache manifest generation.☆35Feb 4, 2012Updated 14 years ago
- Ideas for the decipherment of Easter Island's rongorongo writing☆12Sep 4, 2023Updated 2 years ago