josephrocca / gpt-2-3-tokenizer
GPT-2/3 tokenizer based on @latitudegames/GPT-3-Encoder that works in the browser and Deno
☆32Updated last year
Alternatives and similar repositories for gpt-2-3-tokenizer:
Users that are interested in gpt-2-3-tokenizer are comparing it to the libraries listed below
- hnswlib-node provides Node.js bindings for Hnswlib☆108Updated last week
- Track the size of a react-dom element in 540 bytes (without ResizeObserver)☆16Updated 2 years ago
- hast utility to transform to estree (JavaScript AST) JSX☆20Updated last month
- A fast function for calculating where a string should be truncated, given an optional width limit and an ellipsis string.☆13Updated last month
- Syncronize a YJS document to/from a plain old javascript object☆22Updated 2 years ago
- undo/redo for easy-peasy☆18Updated 2 years ago
- ☆10Updated 3 months ago
- Better way to cancel promises using AbortSignal☆19Updated 10 months ago
- Interactive videos for the web☆12Updated 2 years ago
- Opinionated list selection state manager.☆22Updated 11 months ago
- Change the color of an image to a specific color you have in mind.☆23Updated 3 years ago
- A test suite comparing Node.js BPE tokenizers for use with AI models.☆29Updated last year
- Generate smooth, consistent and always-sexy box-shadows, no matter the size, ideal for design token generation.☆11Updated 2 years ago
- Library to get a unique integer id. Defaults to getting lowest positive integer☆14Updated 11 months ago
- Manage state locally and globally in React with signals☆12Updated last year
- mdast extensions to parse and serialize frontmatter (YAML, TOML, etc)☆15Updated last year
- A React hook to navigate through lists with your keyboard☆16Updated last year
- Kitchen sink of helpful utilities.☆50Updated this week
- ☆31Updated 6 years ago
- utility to reparse a hast tree☆12Updated 3 months ago
- Autosizing <input> and <textarea> elements, which expand and shrink to fit contents☆20Updated this week
- This Tailwind CSS plugin provides custom variants to apply styles to apps that are running on the ToDesktop platform☆18Updated last year
- Write a WebGL 2 command, use it like a component.☆12Updated 2 years ago
- Finds balanced matches.☆15Updated 2 years ago
- mdast extension to parse and serialize MDX (or MDX.js)☆22Updated last year
- Simple JavaScript HTML parser.☆31Updated 9 years ago
- ESLint Plugin to enforce i18n best practices☆20Updated 3 years ago
- build everything on esbuild☆27Updated 3 years ago
- A faithful port of UIPopoverPresentationController, which respects the safe area, to React Native.☆11Updated 2 years ago