Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe
☆18Feb 19, 2024Updated 2 years ago
Alternatives and similar repositories for minbpe
Users that are interested in minbpe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A set of UI components to help you integrate Orama on your website or app.☆17Jun 19, 2025Updated 9 months ago
- Minimalist (yet helpful) monorepo manager for Deno☆18Dec 13, 2023Updated 2 years ago
- JCS (JSON Canonicalization Scheme), JSON digests, and JSON Merkle hashes☆16Mar 10, 2024Updated 2 years ago
- NearForm multi-platform application accelerator☆35Jun 30, 2021Updated 4 years ago
- 🚒✨ Rescue: better errors through types (a more type directed MonadThrow/MonadCatch)☆20Feb 1, 2022Updated 4 years ago
- Homotopy type theory cheatsheets to read the HoTT Book☆12Jul 27, 2019Updated 6 years ago
- A set of macros and functions to make defining a C module easier☆11Sep 9, 2019Updated 6 years ago
- A CoffeScript html generator compatible with CoffeeKup but without the magic.☆27Jul 16, 2013Updated 12 years ago
- A collection of additional language phonology settings for use with VulgarLang.☆13Aug 19, 2022Updated 3 years ago
- A Modeling Notation ꕤ☆15Mar 3, 2026Updated 3 weeks ago
- Fast Map built for keys that are always fixed size uniformly distributed buffers.☆37Mar 21, 2022Updated 4 years ago
- Non-allocating command line flag parser☆16Apr 27, 2025Updated 10 months ago
- Monitor millions of S3 objects without external dependencies☆24Feb 6, 2025Updated last year
- A website that lets you know where to watch a movie built on Next.js and Meilisearch, deployed on Vercel with the Meilisearch + Vercel in…☆12Aug 10, 2023Updated 2 years ago
- Bento - Rust Container Runtime☆33Feb 23, 2026Updated last month
- A small utility for creating warnings and emitting them☆38Mar 1, 2026Updated 3 weeks ago
- Scroll to the current anchor in the url if possible☆11Jun 18, 2017Updated 8 years ago
- NLTK ported to Javascript☆13Sep 3, 2017Updated 8 years ago
- 📤 Magically generate `fetch` types from OpenAPI schemas for zero-cost browser-native api clients☆21Apr 17, 2025Updated 11 months ago
- Parse Dat protocol SLEEP files.☆13Apr 28, 2021Updated 4 years ago
- 🎯 A Single Class CSS Framework - Classic Form Styling With Ease☆10May 13, 2020Updated 5 years ago
- Javascript directed acyclic word graph (DAWG)☆14Apr 30, 2016Updated 9 years ago
- A suffix trie written in JavaScript☆10Jul 26, 2021Updated 4 years ago
- Generate typescript model definitions with just the JSON schema (including reference resolution).☆14Feb 1, 2021Updated 5 years ago
- Customizable user flair system for Reddit☆16May 2, 2021Updated 4 years ago
- Promisify a callback-style function, resolving with [err,val]☆31May 19, 2021Updated 4 years ago
- DNS-SD (aka Zeroconf, Bonjour, Avahi) in TypeScript for Deno and Node.☆56Jul 14, 2024Updated last year
- A stream that can substitute contents of a file in streaming fashion.☆14Aug 10, 2021Updated 4 years ago
- an animated Mayan Calendar☆12Jan 12, 2014Updated 12 years ago
- [obsolete] [incomplete] typed JavaScript interfaces for Facebook Flow☆15Jan 18, 2015Updated 11 years ago
- LinguaLibre – Massive Open Audio Recording system☆13Jan 19, 2021Updated 5 years ago
- Implementation of "practical type inference for arbitrary-rank types" in Javascript☆12Mar 27, 2019Updated 6 years ago
- HTML5 File and FormData APIs for Node.JS☆31Jan 7, 2017Updated 9 years ago
- (Alternative) Visualizer for XState☆12Mar 2, 2023Updated 3 years ago
- AWS CDK constructs for AWS ControlTower☆19Updated this week
- A cross-platform scanner for wireless networks☆13Oct 4, 2015Updated 10 years ago
- ☆84Apr 23, 2025Updated 11 months ago
- AssemblyScript version of Rust Option<T> and Result<O, E> etc.☆26May 9, 2024Updated last year
- Photos of U.S. congressional representatives and scrapers used to collect them.☆14Jan 30, 2026Updated last month