syonfox / gptokenLinks
Javascript BPE Encoder Decoder for GPT-2 / GPT-3
☆24Updated last month
Alternatives and similar repositories for gptoken
Users that are interested in gptoken are comparing it to the libraries listed below
Sorting:
- Parse incomplete json text in best-effort manner☆262Updated 5 months ago
- Turndown plugin to add GitHub Flavored Markdown extensions☆115Updated 2 years ago
- Isomorphic JavaScript/TypeScript Tokenizer for GPT-3 and Codex Models by OpenAI.☆172Updated 2 years ago
- 🌳 Parse HTML to get icon information☆56Updated last year
- The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken wit…☆707Updated last month
- A JS library for convert HTML<String> to markdown<String>, gzip 10kb☆153Updated 8 months ago
- OpenAI's tiktoken but with node bindings☆106Updated last year
- SRT parser that can handle wrong SRT format too (like 0012.682 use dot as separator, which is wrong, it should be a comma)☆69Updated 2 years ago
- Parse partial JSON generated by LLM☆196Updated 4 months ago
- Node module to find the same/diff of two arrays.☆114Updated 6 months ago
- Javascript BPE Encoder Decoder for GPT-2 / GPT-3☆722Updated 2 years ago
- Get selected text from any application☆31Updated 5 years ago
- A stream based implementation of JSON.parse and JSON.stringify for big POJOs☆118Updated 2 years ago
- Unicode character splitter☆159Updated 3 years ago
- A CLI tool that utilizes the OpenAI API to translate JSON-based locale files☆198Updated 9 months ago
- ESLint plugin for Chinese typographies (中文排版) with zhlint☆11Updated 2 years ago
- Get text and context (sentence, paragraph...) from window.getSelection().☆35Updated 2 years ago
- Global HTTP & HTTPS tunelling agent - hard fork of https://github.com/SalesforceEng/global-tunnel☆122Updated last year
- Allows you to include native Node.js `.node` modules in your Next.js project☆18Updated last year
- Streaming, source-agnostic EventSource/Server-Sent Events parser☆444Updated 2 weeks ago
- ☆34Updated 3 years ago
- Polyfills for w3c API on top of Weapp API☆49Updated 3 years ago
- Yet another library to extract text from MS Office and PDF files☆84Updated this week
- Complete unfinished JSON streamed in by LLMs (Like OpenAI's GPT)☆62Updated last year
- A high-performance in-memory convertor to convert svg to png/jpeg images for Node.☆167Updated 2 years ago
- CLI tool to upload Chrome Extensions to the Chrome Web Store☆474Updated 2 months ago
- Enable hot reloading for content script and background script (service worker) in MV3.☆83Updated 4 months ago
- IndexedDB database adapter for Yjs☆260Updated 10 months ago
- hnswlib-node provides Node.js bindings for Hnswlib☆127Updated 2 weeks ago
- Global HTTP/HTTPS proxy agent configurable using environment variables.☆387Updated last year