oramasearch / minbpe
Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe
☆18Updated last year
Alternatives and similar repositories for minbpe:
Users that are interested in minbpe are comparing it to the libraries listed below
- Private symbols for node.js☆14Updated 4 years ago
- Type-safe SQL builder using ES2015 template tags☆11Updated 3 years ago
- Running Node within Node (a fork of synchronous-worker)☆27Updated last year
- ☆33Updated 3 years ago
- A set helpers for writing dynamic SQL queries with `pg-sql` in Javascript.☆38Updated 3 years ago
- ☆10Updated 10 months ago
- Automatically federate a Mercurius GraphQL service☆32Updated 3 months ago
- Generate TypeScript runtime types from your database schema.☆37Updated 9 months ago
- Peek a stream!☆13Updated 2 years ago
- Opentelemetry instrumentation for Prisma ORM☆11Updated 3 years ago
- NPR allows you to run your CLI dependencies without having a copy in node_modules.☆16Updated 2 years ago
- fastify-split-validator is a plugin which allows you to setup, granularly, different validator per HTTP part of the request. This works a…☆10Updated this week
- Determines whether a Node file is a Module (`import`) or a Script (`require`)☆11Updated 4 years ago
- Kubernetes tools for Node.js☆33Updated last month
- Simple JavaScript HTML parser.☆31Updated 10 years ago
- Find and erase strings and comments in JavaScript code☆14Updated 4 years ago
- ☆18Updated 3 years ago
- Same as sqlite-tag but without the native sqlite3 module dependency☆19Updated last month
- a language acceptor for the JavaScript Pattern (regular expression internals) grammar☆16Updated 2 years ago
- A bunch of functions for building HTTP servers☆21Updated last month
- An SSR, islands friendly, way to render ube components.☆15Updated 3 years ago
- ☆23Updated 5 years ago
- JavaScript userland partial implementation of IEEE 754 Decimal128 decimal floating-point arithmetic☆21Updated 3 months ago
- Promise Semaphore☆26Updated 3 years ago
- Enables `attributechanged` element's listener.☆15Updated 4 years ago
- Yet another auto expiring, max sizable cache☆50Updated last year
- Alternate Promise.race() implementation which doesn't leak memory, courtesy Brian Kim (https://github.com/brainkim)☆13Updated last year
- Fast and minimal JS <head> server-side writer and client-side manager.☆25Updated 6 months ago
- A NodeJS framework for creating sandboxed runtimes for untrusted code.☆16Updated 3 years ago
- 📼 Simplest high speed testing☆25Updated last week