Alternatives and similar repositories for tiktokenizer

Users that are interested in tiktokenizer are comparing it to the libraries listed below

• dqbd / tiktoken
  JS port and JS/WASM bindings for openai/tiktoken
  ☆885Updated 2 months ago
• e2b-dev / code-interpreter
  Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app
  ☆1,839Updated last week
• MagnivOrg / prompt-layer-library
  🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.
  ☆633Updated this week
• philschmid / clipper.js
  HTML to Markdown converter and crawler.
  ☆571Updated last year
• domeccleston / sharegpt
  Easily share permanent links to ChatGPT conversations with your friends
  ☆1,760Updated 9 months ago
• niieani / gpt-tokenizer
  The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (o1, o3, o4, gpt-4o, gpt-4, etc.). Port of OpenAI's tiktoken…
  ☆578Updated 2 weeks ago
• OpenRouterTeam / openrouter-runner
  Inference engine powering open source models on OpenRouter
  ☆967Updated 5 months ago
• anysphere / priompt
  Prompt design using JSX.
  ☆2,552Updated 4 months ago
• upstash / wikipedia-semantic-search
  Semantic Search on Wikipedia with Upstash Vector
  ☆467Updated 2 months ago
• weavel-ai / Ape
  Your first AI prompt engineer
  ☆385Updated 7 months ago
• openai / openai-realtime-api-beta
  Node.js + JavaScript reference client for the Realtime API (beta)
  ☆968Updated 7 months ago
• langchain-ai / langsmith-sdk
  LangSmith Client SDK Implementations
  ☆581Updated this week
• recalign / RecAlign
  Chrome extension to filter your feed with LLM according to an explicitly stated and user-editable preference.
  ☆259Updated last year
• hinthornw / promptimizer
  Prompt optimization scratch
  ☆755Updated 2 months ago
• openai / model_spec
  The OpenAI Model Spec
  ☆300Updated 2 months ago
• fatwang2 / search4all
  Personal AI search copilot, open-source Perplexity
  ☆777Updated 4 months ago
• mlc-ai / web-llm-chat
  Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
  ☆774Updated last month
• zilliztech / GPTCache
  Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
  ☆7,603Updated 9 months ago
• jina-ai / node-DeepResearch
  Keep searching, reading webpages, reasoning until it finds the answer (or exceeding the token budget)
  ☆4,492Updated last week
• ax-llm / ax
  The "official" unofficial DSPy framework. Build LLM powered agents and other workflows, based on the Stanford DSP paper.
  ☆1,588Updated this week
• mckaywrigley / paul-graham-gpt
  RAG on Paul Graham's essays.
  ☆2,669Updated last year
• LiveBench / LiveBench
  LiveBench: A Challenging, Contamination-Free LLM Benchmark
  ☆789Updated 2 weeks ago
• anthropics / anthropic-sdk-python
  ☆2,042Updated this week
• harishsg993010 / LLM-Research-Scripts
  ☆435Updated 8 months ago
• langchain-ai / chat-langchainjs
  💬 Chat with the LangChain JS/TS documentation, with sources. 💬
  ☆331Updated 3 months ago
• openai / openai-fm
  Code for openai.fm, a demo for the OpenAI Speech API
  ☆448Updated 2 months ago
• ddupont808 / GPT-4V-Act
  AI agent using GPT-4V(ision) capable of using a mouse/keyboard to interact with web UI
  ☆1,042Updated 6 months ago
• mckaywrigley / clarity-ai
  A Perplexity clone.
  ☆1,342Updated last year
• jtsang4 / claude-to-chatgpt
  This project converts the API of Anthropic's Claude model to the OpenAI Chat API format.
  ☆1,296Updated 10 months ago
• poe-platform / server-bot-quick-start
  Tutorial for Poe server bots
  ☆1,354Updated this week