niieani / gpt-tokenizer
The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT-2 / GPT-3 / GPT-4 / GPT-4o. Port of OpenAI's tiktoken with additional features.
☆455Updated last week
Related projects ⓘ
Alternatives and complementary repositories for gpt-tokenizer
- Isomorphic JavaScript/TypeScript Tokenizer for GPT-3 and Codex Models by OpenAI.☆170Updated last year
- JS port and JS/WASM bindings for openai/tiktoken☆723Updated last month
- Calculate the token consumption and amount of openai gpt message☆106Updated last month
- Javascript BPE Encoder Decoder for GPT-2 / GPT-3☆716Updated last year
- Tools for working with OpenAI streams in Node.js and TypeScript.☆289Updated last year
- 🛠 openai function calling tools for JS/TS☆283Updated 9 months ago
- Everything you need to start building ChatGPT Plugins in JS/TS 🔥☆546Updated last year
- Streaming, source-agnostic EventSource/Server-Sent Events parser☆312Updated 2 weeks ago
- Parse incomplete json text in best-effort manner☆159Updated 5 months ago
- OpenAI's tiktoken but with node bindings☆104Updated 6 months ago
- ☆250Updated last year
- ☆290Updated last year
- Online playground for OpenAPI tokenizers☆708Updated last month
- Minimal and opinionated OpenAI client powered by fetch.☆179Updated last week
- ChatGTP (gpt3.5-turbo) starter app☆935Updated last year
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆398Updated this week
- The official TypeScript/Node client for the Pinecone vector database☆190Updated 2 weeks ago
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆865Updated last year
- Turn a stream of token into a parsable JSON object as soon as possible. Enable Streaming UI for AI app based on LLM.☆91Updated 5 months ago
- Get structured, fully typed, and validated JSON outputs from OpenAI and Anthropic models.☆588Updated 6 months ago
- ☆497Updated last year
- Access to Anthropic's safety-first language model APIs☆725Updated this week
- 🧬 The open source chat-ai toolkit☆881Updated last year
- hnswlib-node provides Node.js bindings for Hnswlib☆100Updated last week
- Self-hosted version of OpenAI’s new stateful Assistants API☆517Updated 10 months ago
- ☆194Updated last year
- This is a fork of the official OpenAI Node.js library that has been adapted to support the Azure OpenAI API. The objective of this librar…☆79Updated last year
- Build AI Agents with JS & TS☆239Updated last year
- Next.js frontend for LangChain Chat.☆990Updated last year
- Langchain.js template to get started quickly☆168Updated last year