dqbd / tiktokenLinks
JS port and JS/WASM bindings for openai/tiktoken
☆987Updated 3 months ago
Alternatives and similar repositories for tiktoken
Users that are interested in tiktoken are comparing it to the libraries listed below
Sorting:
- The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken wit…☆699Updated 3 weeks ago
- Streaming, source-agnostic EventSource/Server-Sent Events parser☆433Updated 3 months ago
- Javascript BPE Encoder Decoder for GPT-2 / GPT-3☆721Updated 2 years ago
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆417Updated 2 months ago
- ☆251Updated 7 months ago
- structured extraction for llms☆759Updated 10 months ago
- Tools for working with OpenAI streams in Node.js and TypeScript.☆293Updated 2 years ago
- JavaScript/Typescript SDK for Qdrant Vector Database☆405Updated last week
- OpenAI's tiktoken but with node bindings☆106Updated last year
- Isomorphic JavaScript/TypeScript Tokenizer for GPT-3 and Codex Models by OpenAI.☆172Updated 2 years ago
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆544Updated 6 months ago
- Calculate the token consumption and amount of openai gpt message☆115Updated 9 months ago
- Node.js client for Replicate☆587Updated 2 weeks ago
- The official TypeScript/Node client for the Pinecone vector database☆253Updated 2 weeks ago
- The TypeScript library for building AI applications.☆1,305Updated last year
- Fast HTML to markdown converter for NodeJS or the browser☆240Updated 2 weeks ago
- Parse partial JSON generated by LLM☆190Updated 3 months ago
- Get structured, fully typed, and validated JSON outputs from OpenAI and Anthropic models.☆629Updated last year
- Parse incomplete json text in best-effort manner☆258Updated 4 months ago
- Everything you need to start building ChatGPT Plugins in JS/TS 🔥☆542Updated 2 years ago
- Turn a stream of token into a parsable JSON object as soon as possible. Enable Streaming UI for AI app based on LLM.☆120Updated last year
- Node.js bindings for faiss☆138Updated 2 years ago
- Converts Zod schemas to Json schemas☆1,222Updated 2 weeks ago
- Data framework for your LLM applications. Focus on server side solution☆2,958Updated this week
- Hooks and components for working with OpenAI streams.☆239Updated 2 years ago
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆292Updated last year
- gpt4all and llama typescript bindings☆398Updated last year
- Repair invalid JSON documents☆1,969Updated last month
- 📄 PDF extraction and rendering across all JavaScript runtimes☆937Updated last month
- hnswlib-node provides Node.js bindings for Hnswlib☆123Updated last week