oramasearch / minbpeLinks
Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe
☆18Updated last year
Alternatives and similar repositories for minbpe
Users that are interested in minbpe are comparing it to the libraries listed below
Sorting:
- Private symbols for node.js☆14Updated 4 years ago
- JSON canonicalize function☆52Updated 7 months ago
- Fast Map built for keys that are always fixed size uniformly distributed buffers.☆37Updated 3 years ago
- Generate TypeScript runtime types from your database schema.☆37Updated last year
- An SQLite binding for node.js with built-in encryption, focused on simplicity and (async) performance☆41Updated last week
- Yet another auto expiring, max sizable cache☆50Updated last month
- a language acceptor for the JavaScript Pattern (regular expression internals) grammar☆16Updated 3 years ago
- Promise Semaphore☆26Updated 3 years ago
- Peek a stream!☆13Updated 3 years ago
- load a plugin via a synchronous worker☆58Updated 2 years ago
- 🕵️♀️ Light-weight observable implementation and functional utilities in TypeScript☆48Updated 2 years ago
- Heap dump and sample profiler generator for Node.☆57Updated 10 months ago
- Creates a Promise that waits for a single event☆25Updated 4 years ago
- A small-but-powerful typesafe state machine, designed to handle large state graphs☆13Updated 2 years ago
- Simple benchmarking suite powered by HDR histograms.☆87Updated last week
- ☆53Updated 5 years ago
- A set helpers for writing dynamic SQL queries with `pg-sql` in Javascript.☆38Updated 4 years ago
- ☆83Updated 7 months ago
- ☆53Updated 4 years ago
- PiscinaPriorityQueue☆12Updated 3 weeks ago
- Same as sqlite-tag but without the native sqlite3 module dependency☆19Updated 9 months ago
- An Opinionated Message Queue with an emitter-style API☆164Updated last week
- ☆18Updated 4 years ago
- a quick syntax for JSON object☆57Updated last year
- Opentelemetry instrumentation for Prisma ORM☆11Updated 3 years ago
- Minimalist (yet helpful) monorepo manager for Deno☆18Updated last year
- 🐉 An experimental node.js FFI library☆39Updated 5 months ago
- Simple, fun, memory safe language.☆16Updated 2 years ago
- FaaS like GraphQL runtime☆27Updated 10 months ago
- Kubernetes tools for Node.js☆40Updated 4 months ago