The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
☆838Aug 16, 2026Updated 2 weeks ago
Alternatives and similar repositories for gpt-tokenizer
Users that are interested in gpt-tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- JS port and JS/WASM bindings for openai/tiktoken☆1,067Aug 9, 2025Updated last year
- Javascript BPE Encoder Decoder for GPT-2 / GPT-3☆720Apr 16, 2023Updated 3 years ago
- 📐 Fast token estimation with 95%+ average accuracy in a 2kB bundle☆175Aug 5, 2026Updated 3 weeks ago
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆19,144Aug 17, 2026Updated 2 weeks ago
- Isomorphic JavaScript/TypeScript Tokenizer for GPT-3 and Codex Models by OpenAI.☆171Jan 27, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Official JavaScript / TypeScript library for the OpenAI API☆11,159Updated this week
- 📄 PDF extraction and rendering across all JavaScript runtimes☆1,222Aug 14, 2026Updated 2 weeks ago
- The agent engineering platform☆18,156Updated this week
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆26,547Updated this week
- Repair invalid JSON documents☆2,401Jul 3, 2026Updated last month
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆633Jul 20, 2026Updated last month
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆16,282Updated this week
- 🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, bench…☆25,309Updated this week
- Mastra is the modern TypeScript framework for AI-powered applications and agents.☆27,647Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 🤖💬 extra-small AI SDK.☆650Updated this week
- Get structured, fully typed, and validated JSON outputs from OpenAI and Anthropic models.☆628Apr 26, 2024Updated 2 years ago
- Typed model metadata and context/cost utilities that help AI apps answer: Does this fit? What will it cost? Should we compact now? How mu…☆263Jul 2, 2026Updated 2 months ago
- A robust, strictly-typed Node.js and Browser library for parsing office files into a rich Abstract Syntax Tree (AST) and generating high-…☆533Aug 18, 2026Updated 2 weeks ago
- Converts Zod schemas to Json schemas☆1,251Mar 27, 2026Updated 5 months ago
- Dead simple pdf text reader☆44Jan 19, 2026Updated 7 months ago
- Online playground for OpenAPI tokenizers☆1,681Apr 24, 2025Updated last year
- A drop-in replacement for react-markdown, designed for AI-powered streaming.☆5,581Updated this week
- Compact YAML, TOML, JSONC and JSON5 and INI parser and serializer☆299Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The official TypeScript SDK for Model Context Protocol servers and clients☆13,307Updated this week
- primitives for advanced inference in TS☆18Jul 9, 2026Updated last month
- The simplest and fastest way to bundle your TypeScript libraries.☆11,294Jul 20, 2026Updated last month
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆38,231Updated this week
- High-performance In-browser LLM Inference Engine☆18,747Updated this week
- OpenAI's tiktoken but with node bindings☆108May 18, 2024Updated 2 years ago
- The beautiful & flexible React.js docs framework.☆13,051Updated this week
- 🛏 An HTML to Markdown converter written in JavaScript☆11,417Jun 23, 2026Updated 2 months ago
- Prompt design using JSX.☆2,851Oct 15, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🧙 Valtio makes proxy-state simple for React and Vanilla☆10,231Updated this week
- Bash for Agents☆4,227Updated this week
- Turn standard types into JSON schemas☆24May 3, 2025Updated last year
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆40,571Updated this week
- Simple utils to pack arrays, objects and strings to a flat object (and back again).☆17Apr 1, 2025Updated last year
- hnswlib-node provides Node.js bindings for Hnswlib☆138Updated this week
- The SDK For Browser Agents☆24,128Updated this week