josephrocca / gpt-2-3-tokenizer
GPT-2/3 tokenizer based on @latitudegames/GPT-3-Encoder that works in the browser and Deno
☆32Updated last year
Alternatives and similar repositories for gpt-2-3-tokenizer:
Users that are interested in gpt-2-3-tokenizer are comparing it to the libraries listed below
- Better way to cancel promises using AbortSignal☆19Updated 11 months ago
- Simple JavaScript HTML parser.☆31Updated 10 years ago
- support for type acquisition with url imports, npm, jsr prefixes☆15Updated 9 months ago
- hast utility to transform to estree (JavaScript AST) JSX☆20Updated 2 weeks ago
- A fast function for calculating where a string should be truncated, given an optional width limit and an ellipsis string.☆13Updated 2 months ago
- Track the size of a react-dom element in 540 bytes (without ResizeObserver)☆16Updated 2 years ago
- A test suite comparing Node.js BPE tokenizers for use with AI models.☆30Updated last year
- Small, no dependencies, Markdown, HTML, and inline CSS parser. Just 4KB, available as ESM module from CDN.☆19Updated this week
- Transform JSX in estrees to function calls (for react, preact, and most hyperscript interfaces)☆22Updated 7 months ago
- Alternative JSON.stringify function with sorted keys, so the output is stable.☆13Updated 2 months ago
- ☆24Updated 3 weeks ago
- build everything on esbuild☆27Updated 4 years ago
- Syncronize a YJS document to/from a plain old javascript object☆22Updated 2 years ago
- Create a twitter card-sized image for your blog posts 🖼☆13Updated 2 years ago
- Write a WebGL 2 command, use it like a component.☆12Updated 2 years ago
- A maybe slightly safer-ish wrapper around eval Function constructors☆26Updated 2 years ago
- undo/redo for easy-peasy☆18Updated 2 years ago
- A proof of concept for adding Remix loaders and actions in a service-worker☆12Updated last year
- JS Trie / DAWG classes☆30Updated last year
- ☆11Updated 4 months ago
- Interactive videos for the web☆12Updated 3 years ago
- jotai-yjs makes yjs state even easier☆39Updated 3 years ago
- HTML processor to parse and compile with browser APIs, powered by plugins☆26Updated 3 months ago
- Bridge between MobX and Yjs☆26Updated 3 years ago
- JS formatter for dprint Wasm plugins.☆33Updated 8 months ago
- Autosizing <input> and <textarea> elements, which expand and shrink to fit contents☆21Updated this week
- Build your Cloudflare Workers, on Cloudflare Workers☆17Updated 2 years ago
- ☆26Updated 3 years ago
- hnswlib-node provides Node.js bindings for Hnswlib☆108Updated last week