oramasearch / minbpeLinks
Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe
☆18Updated last year
Alternatives and similar repositories for minbpe
Users that are interested in minbpe are comparing it to the libraries listed below
Sorting:
- JSON canonicalize function☆50Updated 4 months ago
- A small-but-powerful typesafe state machine, designed to handle large state graphs☆13Updated 2 years ago
- Same as sqlite-tag but without the native sqlite3 module dependency☆19Updated 6 months ago
- a language acceptor for the JavaScript Pattern (regular expression internals) grammar☆16Updated 3 years ago
- ☆33Updated 3 years ago
- 👣 Effective tracing for the edge and origins☆47Updated last month
- Generate TypeScript runtime types from your database schema.☆37Updated last year
- Alternate Promise.race() implementation which doesn't leak memory, courtesy Brian Kim (https://github.com/brainkim)☆13Updated last year
- A bunch of functions for building HTTP servers☆22Updated 6 months ago
- Private symbols for node.js☆14Updated 4 years ago
- Determines whether a Node file is a Module (`import`) or a Script (`require`)☆11Updated 4 years ago
- Minimalist (yet helpful) monorepo manager for Deno☆18Updated last year
- small ~1k unzip library☆17Updated 2 months ago
- A set helpers for writing dynamic SQL queries with `pg-sql` in Javascript.☆38Updated 3 years ago
- A small Javascript Promise-based Finite State Machine implementation☆23Updated 2 years ago
- load a plugin via a synchronous worker☆58Updated last year
- FaaS like GraphQL runtime☆27Updated 7 months ago
- ☆29Updated 4 years ago
- Create an AsyncIterableIterator from anything while handling back-pressure!☆24Updated last week
- Experimenting with making using workers easy.☆32Updated 8 years ago
- Tiny, type-safe JSON-RPC 2.0 implementation☆20Updated last year
- Configuration, benchmarking scripts, and raw data for serverless cold start benchmarks.☆17Updated last year
- Run a command if a file changes via Git hooks☆38Updated this week
- Creates a Promise that waits for a single event☆25Updated 3 years ago
- Heap dump and sample profiler generator for Node.☆57Updated 7 months ago
- Opentelemetry instrumentation for Prisma ORM☆11Updated 3 years ago
- ☆53Updated 4 years ago
- Simple benchmarking suite powered by HDR histograms.☆86Updated 4 months ago
- An SQLite binding for node.js with built-in encryption, focused on simplicity and (async) performance☆40Updated 5 months ago
- Immutable persistent data collections for Javascript which increase efficiency and simplicity.☆26Updated last year