oramasearch / minbpeLinks
Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe
☆18Updated last year
Alternatives and similar repositories for minbpe
Users that are interested in minbpe are comparing it to the libraries listed below
Sorting:
- FaaS like GraphQL runtime☆27Updated 8 months ago
- a language acceptor for the JavaScript Pattern (regular expression internals) grammar☆16Updated 3 years ago
- A small-but-powerful typesafe state machine, designed to handle large state graphs☆13Updated 2 years ago
- Tiny, type-safe JSON-RPC 2.0 implementation☆20Updated last year
- Private symbols for node.js☆14Updated 4 years ago
- Peek a stream!☆13Updated 3 years ago
- JSON canonicalize function☆50Updated 5 months ago
- A set helpers for writing dynamic SQL queries with `pg-sql` in Javascript.☆38Updated 4 years ago
- 👣 Effective tracing for the edge and origins☆47Updated 2 months ago
- An SQLite binding for node.js with built-in encryption, focused on simplicity and (async) performance☆41Updated this week
- load a plugin via a synchronous worker☆58Updated last year
- small ~1k unzip library☆16Updated 3 months ago
- Fork of https://github.com/observing/pre-commit☆11Updated this week
- ☆77Updated 11 months ago
- Asynchronous HTTP microservices☆47Updated 2 years ago
- Generate TypeScript runtime types from your database schema.☆37Updated last year
- Alternate Promise.race() implementation which doesn't leak memory, courtesy Brian Kim (https://github.com/brainkim)☆14Updated 2 years ago
- PostgreSQL client library for Deno and Node.js that exposes all features of wire protocol.☆82Updated 11 months ago
- Yet another auto expiring, max sizable cache☆50Updated last year
- Create SQL for Postgres in a safe and composable fashion with the power of template strings.☆37Updated 8 years ago
- JSON.stringify any data types☆17Updated 4 years ago
- A fast fifo implementation similar to the one powering nextTick in Node.js core☆61Updated last year
- A bunch of functions for building HTTP servers☆22Updated 7 months ago
- An Opinionated Message Queue with an emitter-style API☆163Updated last month
- ☆37Updated last year
- A micro-framework for bidirectional mapping between relational datastores and GraphQL APIs (powered by Node.js)☆58Updated 2 years ago
- A slim, easy-to-use wrapper around EventSource☆30Updated 4 years ago
- OpenTelemetry Node 18+ native fetch automatic instrumentation package☆19Updated last year
- 🕵️♀️ Light-weight observable implementation and functional utilities in TypeScript☆47Updated 2 years ago
- 🐉 An experimental node.js FFI library☆37Updated 3 months ago