botisan-ai / gpt3-tokenizer
Isomorphic JavaScript/TypeScript Tokenizer for GPT-3 and Codex Models by OpenAI.
☆171Updated 2 years ago
Alternatives and similar repositories for gpt3-tokenizer:
Users that are interested in gpt3-tokenizer are comparing it to the libraries listed below
- OpenAI's tiktoken but with node bindings☆104Updated 10 months ago
- Calculate the token consumption and amount of openai gpt message☆110Updated last month
- The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT-2 / GPT-3 / GPT-4 / GPT-4o / GPT-o1. Port of OpenAI's tiktoken with…☆536Updated 2 weeks ago
- Minimal and opinionated OpenAI client powered by fetch.☆184Updated 2 months ago
- Node.js bindings for faiss☆121Updated last year
- 🛠 openai function calling tools for JS/TS☆292Updated last year
- Tools for working with OpenAI streams in Node.js and TypeScript.☆291Updated last year
- JS port and JS/WASM bindings for openai/tiktoken☆814Updated last month
- Javascript BPE Encoder Decoder for GPT-2 / GPT-3☆719Updated last year
- Parse incomplete json text in best-effort manner☆187Updated last month
- hnswlib-node provides Node.js bindings for Hnswlib☆108Updated last week
- JavaScript implementation of LiteLLM.☆118Updated 2 months ago
- Streaming, source-agnostic EventSource/Server-Sent Events parser☆344Updated 4 months ago
- ☆252Updated last year
- Example of running LangChain on Vercel☆166Updated last year
- Collection of ChatGPT plugins☆103Updated last year
- Vector Storage is a vector database that enables semantic similarity searches on text documents in the browser's local storage. It uses O…☆215Updated 3 months ago
- Everything you need to start building ChatGPT Plugins in JS/TS 🔥☆546Updated last year
- Run Alpaca LLM in LangChain☆218Updated last year
- ☆66Updated last year
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆453Updated 4 months ago
- A test suite comparing Node.js BPE tokenizers for use with AI models.☆30Updated last year
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆361Updated last month
- ☆291Updated last year
- ☆197Updated last year
- Semantic search with openai's embeddings stored to pineconedb (vector database)☆151Updated 2 years ago
- ☆145Updated last month
- Turn a stream of token into a parsable JSON object as soon as possible. Enable Streaming UI for AI app based on LLM.☆100Updated 9 months ago
- Pinecone.io client with excellent TypeScript support.☆117Updated last year
- Checks Alexa's top 1M websites for the presence of OpenAI's new .well-known/ai-plugin.json files☆175Updated last year