The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
☆747Feb 10, 2026Updated 3 weeks ago
Alternatives and similar repositories for gpt-tokenizer
Users that are interested in gpt-tokenizer are comparing it to the libraries listed below
Sorting:
- JS port and JS/WASM bindings for openai/tiktoken☆1,012Aug 9, 2025Updated 7 months ago
- Javascript BPE Encoder Decoder for GPT-2 / GPT-3☆724Apr 16, 2023Updated 2 years ago
- Isomorphic JavaScript/TypeScript Tokenizer for GPT-3 and Codex Models by OpenAI.☆172Jan 27, 2023Updated 3 years ago
- The agent engineering platform☆17,126Updated this week
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆17,473Feb 8, 2026Updated last month
- Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.☆34Mar 1, 2024Updated 2 years ago
- Get structured, fully typed, and validated JSON outputs from OpenAI and Anthropic models.☆628Apr 26, 2024Updated last year
- Official JavaScript / TypeScript library for the OpenAI API☆10,692Updated this week
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆590Feb 19, 2026Updated 2 weeks ago
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆22,419Updated this week
- 📄 PDF extraction and rendering across all JavaScript runtimes☆1,033Feb 25, 2026Updated last week
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆15,518Updated this week
- Converts Zod schemas to Json schemas☆1,246Dec 27, 2025Updated 2 months ago
- Prompt design using JSX.☆2,770Oct 15, 2025Updated 4 months ago
- Panda CSS Ecosystem☆12May 10, 2024Updated last year
- High-performance In-browser LLM Inference Engine☆17,515Mar 2, 2026Updated last week
- A lightweight React Hook intended mainly for AI chat applications, for smoothly sticking to bottom of messages☆690Feb 6, 2026Updated last month
- Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…☆10,821Updated this week
- ☆16Dec 12, 2025Updated 2 months ago
- Library to generate easy to remember, and sometimes entertaining, human readable ids.☆14Mar 1, 2026Updated last week
- 🤖💬 extra-small AI SDK.☆591Mar 2, 2026Updated last week
- The TypeScript library for building AI applications.☆1,316Jul 19, 2024Updated last year
- TypeChat is a library that makes it easy to build natural language interfaces using types.☆8,627Updated this week
- OpenAI's tiktoken but with node bindings☆106May 18, 2024Updated last year
- hnswlib-node provides Node.js bindings for Hnswlib☆135Updated this week
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆35,466Mar 1, 2026Updated last week
- 🧙 Valtio makes proxy-state simple for React and Vanilla☆10,137Mar 3, 2026Updated last week
- Dead simple pdf text reader☆44Jan 19, 2026Updated last month
- Calculate the token consumption and amount of openai gpt message☆115Feb 9, 2025Updated last year
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,052Sep 20, 2023Updated 2 years ago
- ☆17Oct 16, 2023Updated 2 years ago
- primitives for advanced inference in TS☆18Nov 21, 2025Updated 3 months ago
- The official TypeScript SDK for Model Context Protocol servers and clients☆11,788Updated this week
- Your API ⇒ Paid MCP. Instantly.☆18,129Feb 11, 2026Updated 3 weeks ago
- Repair invalid JSON documents☆2,247Jan 14, 2026Updated last month
- A drawer component for React.☆8,183Oct 3, 2025Updated 5 months ago
- To extract main article from given URL with Node.js☆1,869Sep 4, 2025Updated 6 months ago
- The simplest and fastest way to bundle your TypeScript libraries.☆11,151Feb 28, 2026Updated last week
- TypeScript/JavaScript SDK for Gemini and Vertex AI.☆1,510Updated this week