The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
☆832Feb 10, 2026Updated 6 months ago
Alternatives and similar repositories for gpt-tokenizer
Users that are interested in gpt-tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- JS port and JS/WASM bindings for openai/tiktoken☆1,064Aug 9, 2025Updated last year
- Javascript BPE Encoder Decoder for GPT-2 / GPT-3☆719Apr 16, 2023Updated 3 years ago
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆18,976May 24, 2026Updated 2 months ago
- Isomorphic utilities for GPT-3 tokenization and prompt building.☆10Apr 11, 2023Updated 3 years ago
- Isomorphic JavaScript/TypeScript Tokenizer for GPT-3 and Codex Models by OpenAI.☆170Jan 27, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Official JavaScript / TypeScript library for the OpenAI API☆11,110Updated this week
- 📄 PDF extraction and rendering across all JavaScript runtimes☆1,208Aug 5, 2026Updated last week
- The agent engineering platform☆18,053Updated this week
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆26,146Updated this week
- Calculate how much a LLM completion costs☆16Updated this week
- Repair invalid JSON documents☆2,393Jul 3, 2026Updated last month
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆629Jul 20, 2026Updated 3 weeks ago
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆16,244Jul 31, 2026Updated last week
- 🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, bench…☆25,143Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Mastra is the modern TypeScript framework for AI-powered applications and agents.☆27,136Updated this week
- 🤖💬 extra-small AI SDK.☆651Aug 3, 2026Updated last week
- Get structured, fully typed, and validated JSON outputs from OpenAI and Anthropic models.☆630Apr 26, 2024Updated 2 years ago
- Typed model metadata and context/cost utilities that help AI apps answer: Does this fit? What will it cost? Should we compact now? How mu…☆261Jul 2, 2026Updated last month
- A robust, strictly-typed Node.js and Browser library for parsing office files into a rich Abstract Syntax Tree (AST) and generating high-…☆521Jul 30, 2026Updated 2 weeks ago
- Converts Zod schemas to Json schemas☆1,251Mar 27, 2026Updated 4 months ago
- Dead simple pdf text reader☆44Jan 19, 2026Updated 6 months ago
- Online playground for OpenAPI tokenizers☆1,668Apr 24, 2025Updated last year
- A drop-in replacement for react-markdown, designed for AI-powered streaming.☆5,500Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Compact YAML, TOML, JSONC and JSON5 and INI parser and serializer☆295Updated this week
- The official TypeScript SDK for Model Context Protocol servers and clients☆13,148Updated this week
- primitives for advanced inference in TS☆18Jul 9, 2026Updated last month
- The simplest and fastest way to bundle your TypeScript libraries.☆11,290Jul 20, 2026Updated 3 weeks ago
- React Flow | Svelte Flow - Powerful open source libraries for building node-based UIs with React (https://reactflow.dev) or Svelte (https…☆37,999Updated this week
- High-performance In-browser LLM Inference Engine☆18,554Aug 4, 2026Updated last week
- OpenAI's tiktoken but with node bindings☆108May 18, 2024Updated 2 years ago
- Reactive fs for WebContainers☆29Mar 14, 2023Updated 3 years ago
- The beautiful & flexible React.js docs framework.☆12,868Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 🛏 An HTML to Markdown converter written in JavaScript☆11,386Jun 23, 2026Updated last month
- Prompt design using JSX.☆2,845Oct 15, 2025Updated 9 months ago
- 🧙 Valtio makes proxy-state simple for React and Vanilla☆10,219Jul 29, 2026Updated 2 weeks ago
- Bash for Agents☆4,123Updated this week
- Turn standard types into JSON schemas☆24May 3, 2025Updated last year
- 🧙♀️ Move Fast and Break Nothing. End-to-end typesafe APIs made easy.☆40,515Updated this week
- Simple utils to pack arrays, objects and strings to a flat object (and back again).☆17Apr 1, 2025Updated last year