oramasearch / minbpeLinks
Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe
☆18Updated last year
Alternatives and similar repositories for minbpe
Users that are interested in minbpe are comparing it to the libraries listed below
Sorting:
- Tiny, type-safe JSON-RPC 2.0 implementation☆20Updated 2 years ago
- Private symbols for node.js☆14Updated 5 years ago
- JSON canonicalize function☆52Updated 10 months ago
- 🕵️♀️ Light-weight observable implementation and functional utilities in TypeScript☆48Updated 3 years ago
- a language acceptor for the JavaScript Pattern (regular expression internals) grammar☆16Updated 3 years ago
- A set helpers for writing dynamic SQL queries with `pg-sql` in Javascript.☆38Updated 4 years ago
- Peek a stream!☆13Updated 3 years ago
- Opentelemetry instrumentation for Prisma ORM☆11Updated 4 years ago
- ☆33Updated 3 years ago
- 👣 Effective tracing for the edge and origins☆48Updated 6 months ago
- ☆29Updated 5 years ago
- Simple, fun, memory safe language.☆16Updated 2 years ago
- A slim, easy-to-use wrapper around EventSource☆30Updated 4 years ago
- A small-but-powerful typesafe state machine, designed to handle large state graphs☆13Updated 3 years ago
- Generate TypeScript runtime types from your database schema.☆37Updated last year
- 🐉 An experimental node.js FFI library☆41Updated 7 months ago
- An Opinionated Message Queue with an emitter-style API☆165Updated this week
- Logs Slonik queries.☆13Updated last year
- Configuration, benchmarking scripts, and raw data for serverless cold start benchmarks.☆17Updated last year
- load a plugin via a synchronous worker☆58Updated 2 years ago
- Asynchronous HTTP microservices☆47Updated 3 years ago
- Create an AsyncIterableIterator from anything while handling back-pressure!☆24Updated last week
- Same as sqlite-tag but without the native sqlite3 module dependency☆19Updated 11 months ago
- JavaScript library to make Directed Acyclic Graph construction and traversal easy, including deep circular dependency detection ♽☆55Updated 3 months ago
- Promise Semaphore☆26Updated 3 years ago
- A Node.js / Posix-like JavaScript front-end API for the Socket Runtime☆21Updated 3 years ago
- An SQLite binding for node.js with built-in encryption, focused on simplicity and (async) performance☆44Updated last month
- Porting the ideas of babel-plugin-macro over to esbuild☆15Updated 4 years ago
- A type safe JS runtime☆20Updated 5 years ago
- Provides Lock and RwLock synchronization primitives.☆15Updated last year