Online playground for OpenAPI tokenizers
☆1,622Apr 24, 2025Updated last year
Alternatives and similar repositories for tiktokenizer
Users that are interested in tiktokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆18,627May 24, 2026Updated last month
- JS port and JS/WASM bindings for openai/tiktoken☆1,056Aug 9, 2025Updated 10 months ago
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆51,475Jun 25, 2026Updated last week
- LlamaIndex is the leading document agent and OCR platform☆50,533Updated this week
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆10,598Jul 1, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Search infrastructure for AI☆28,614Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆84,877Updated this week
- Examples and guides for using the OpenAI API☆74,488Updated this week
- The agent engineering platform.☆140,319Updated this week
- Your API ⇒ Paid MCP. Instantly.☆18,119Feb 11, 2026Updated 4 months ago
- Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆174,889Jun 25, 2026Updated last week
- LLM inference in C/C++☆118,422Updated this week
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆42,989Jun 24, 2026Updated last week
- An AI-powered search engine with a generative UI☆8,947Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,492May 1, 2026Updated 2 months ago
- 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.☆75,965Mar 11, 2026Updated 3 months ago
- The agent engineering platform☆17,862Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆11,374May 22, 2026Updated last month
- Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search☆44,975Updated this week
- Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.☆67,571Updated this week
- TypeChat is a library that makes it easy to build natural language interfaces using types.☆8,671Updated this week
- Build AI Agents, Visually☆54,067Updated this week
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆25,191Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.☆21,194Jul 4, 2024Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆60,304Nov 12, 2025Updated 7 months ago
- Robust Speech Recognition via Large-Scale Weak Supervision☆103,646Apr 15, 2026Updated 2 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆143,369Updated this week
- Production-ready platform for agentic workflow development.☆146,705Updated this week
- A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆12,209May 25, 2026Updated last month
- Virtual whiteboard for sketching hand-drawn like diagrams☆126,217Updated this week
- Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…☆16,429Jun 25, 2026Updated last week
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆16,152Jun 24, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆8,083Jul 11, 2025Updated 11 months ago
- The open source codebase powering HuggingChat☆10,786Jun 24, 2026Updated last week
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆5,857Jun 11, 2026Updated 2 weeks ago
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆18,783Apr 14, 2026Updated 2 months ago
- 🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire …☆79,172Updated this week
- Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization☆7,897Jun 6, 2026Updated 3 weeks ago
- Chat with Hacker News using natural language. Built with OpenAI Functions and Vercel AI SDK.☆1,179Oct 30, 2023Updated 2 years ago