Online playground for OpenAPI tokenizers
☆1,612Apr 24, 2025Updated last year
Alternatives and similar repositories for tiktokenizer
Users that are interested in tiktokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆18,459May 24, 2026Updated 2 weeks ago
- JS port and JS/WASM bindings for openai/tiktoken☆1,052Aug 9, 2025Updated 10 months ago
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆49,384Jun 5, 2026Updated last week
- LlamaIndex is the leading document agent and OCR platform☆50,073Updated this week
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆10,549Jul 1, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Search infrastructure for AI☆28,312Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆82,482Updated this week
- Examples and guides for using the OpenAI API☆74,126Updated this week
- The agent engineering platform.☆138,777Updated this week
- Your API ⇒ Paid MCP. Instantly.☆18,118Feb 11, 2026Updated 4 months ago
- Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆173,296Updated this week
- LLM inference in C/C++☆115,667Updated this week
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆42,815Jun 5, 2026Updated last week
- An AI-powered search engine with a generative UI☆8,893Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,470May 1, 2026Updated last month
- 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.☆75,338Mar 11, 2026Updated 3 months ago
- The agent engineering platform☆17,771Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆11,013May 22, 2026Updated 3 weeks ago
- Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search☆44,674Updated this week
- Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.☆66,153Updated this week
- TypeChat is a library that makes it easy to build natural language interfaces using types.☆8,663Jun 3, 2026Updated last week
- Build AI Agents, Visually☆53,427Updated this week
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆24,726Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.☆21,195Jul 4, 2024Updated last year
- Robust Speech Recognition via Large-Scale Weak Supervision☆101,671Apr 15, 2026Updated last month
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆59,420Nov 12, 2025Updated 6 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆140,752Updated this week
- Production-ready platform for agentic workflow development.☆144,240Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆11,987May 25, 2026Updated 2 weeks ago
- Virtual whiteboard for sketching hand-drawn like diagrams☆124,733Updated this week
- Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…☆16,280Updated this week
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆16,078Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆8,056Jul 11, 2025Updated 11 months ago
- The open source codebase powering HuggingChat☆10,754Updated this week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆5,780May 18, 2026Updated 3 weeks ago
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆18,624Apr 14, 2026Updated last month
- 🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire …☆78,377Updated this week
- Chat with Hacker News using natural language. Built with OpenAI Functions and Vercel AI SDK.☆1,179Oct 30, 2023Updated 2 years ago
- Easily share permanent links to ChatGPT conversations with your friends☆1,758Sep 25, 2024Updated last year