syonfox / gptokenLinks
Javascript BPE Encoder Decoder for GPT-2 / GPT-3
☆24Updated last month
Alternatives and similar repositories for gptoken
Users that are interested in gptoken are comparing it to the libraries listed below
Sorting:
- Parse incomplete json text in best-effort manner☆242Updated 2 months ago
- Turndown plugin to add GitHub Flavored Markdown extensions☆114Updated 2 years ago
- 🌳 Parse HTML to get icon information☆56Updated 8 months ago
- OpenAI's tiktoken but with node bindings☆105Updated last year
- Node module to find the same/diff of two arrays.☆114Updated 3 months ago
- A high-performance in-memory convertor to convert svg to png/jpeg images for Node.☆166Updated last year
- SRT parser that can handle wrong SRT format too (like 0012.682 use dot as separator, which is wrong, it should be a comma)☆68Updated last year
- CLDR text segmentation for JavaScript☆38Updated last year
- Unicode character splitter☆157Updated 3 years ago
- A stream based implementation of JSON.parse and JSON.stringify for big POJOs☆117Updated 2 years ago
- WebAssembly based Javascript bindings for google Compact Language Detector v3☆73Updated last year
- A JS library for convert HTML<String> to markdown<String>, gzip 10kb☆150Updated 4 months ago
- Global HTTP & HTTPS tunelling agent - hard fork of https://github.com/SalesforceEng/global-tunnel☆120Updated last year
- Fast dom parser based on regexps☆113Updated last year
- Enable hot reloading for content script and background script (service worker) in MV3.☆84Updated last month
- SSE Viewer is a Chrome extension that allows you to view EventStream in the devtools.☆66Updated last year
- Get text content from any file☆64Updated last year
- Modify your objects with a mongo syntax. Integral part of rxdb and mongo-mock.☆50Updated 2 years ago
- A pure JavaScript QRCode encode and decode library.☆221Updated last week
- Fetch adapter for axios☆104Updated last year
- hnswlib-node provides Node.js bindings for Hnswlib☆119Updated this week
- Web Streams, based on the WHATWG spec reference implementation☆322Updated last month
- Parse partial JSON generated by LLM☆170Updated last month
- The fastest smallest Javascript polyfill for encodeInto of TextEncoder, encode of TextEncoder, and decode of TextDecoder for UTF-8 only.☆155Updated last year
- A high-performance Javascript string compression library☆328Updated 2 years ago
- Get the list of fonts installed in the system.☆139Updated this week
- mdast utility to parse markdown☆264Updated 6 months ago
- WASM binding to jieba-rs☆78Updated this week
- 给 Markdown 中英文自动插入空格的 remark 插件☆30Updated 4 years ago
- ESLint plugin for Chinese typographies (中文排版) with zhlint☆11Updated 2 years ago