Online playground for OpenAPI tokenizers
☆1,584Apr 24, 2025Updated last year
Alternatives and similar repositories for tiktokenizer
Users that are interested in tiktokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆18,037Mar 27, 2026Updated last month
- JS port and JS/WASM bindings for openai/tiktoken☆1,047Aug 9, 2025Updated 8 months ago
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆45,153Updated this week
- LlamaIndex is the leading document agent and OCR platform☆48,997Updated this week
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆10,454Jul 1, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Data infrastructure for AI☆27,630Apr 26, 2026Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆78,385Updated this week
- Examples and guides for using the OpenAI API☆73,072Updated this week
- The agent engineering platform☆135,612Updated this week
- Your API ⇒ Paid MCP. Instantly.☆18,124Feb 11, 2026Updated 2 months ago
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆170,289Updated this week
- LLM inference in C/C++☆107,892Updated this week
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆42,459Updated this week
- An AI-powered search engine with a generative UI☆8,800Apr 15, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,461Jun 2, 2025Updated 11 months ago
- 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.☆73,988Mar 11, 2026Updated last month
- The agent engineering platform☆17,609Updated this week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆10,709Apr 16, 2026Updated 2 weeks ago
- Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search☆44,080Updated this week
- Web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.☆63,070Updated this week
- TypeChat is a library that makes it easy to build natural language interfaces using types.☆8,649Updated this week
- Build AI Agents, Visually☆52,479Updated this week
- The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.☆21,208Jul 4, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Robust Speech Recognition via Large-Scale Weak Supervision☆98,662Apr 15, 2026Updated 2 weeks ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆57,242Nov 12, 2025Updated 5 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆134,183Apr 24, 2026Updated last week
- A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆11,539Mar 25, 2026Updated last month
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆23,960Updated this week
- Production-ready platform for agentic workflow development.☆139,793Updated this week
- Virtual whiteboard for sketching hand-drawn like diagrams☆122,238Updated this week
- Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…☆16,101Updated this week
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆15,914Apr 25, 2026Updated last week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆8,007Jul 11, 2025Updated 9 months ago
- The open source codebase powering HuggingChat☆10,687Updated this week
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆18,330Apr 14, 2026Updated 2 weeks ago
- The ultimate space for work and life — to find, build, and collaborate with agent teammates that grow with you. We are taking agent harne…☆75,942Updated this week
- Chat with Hacker News using natural language. Built with OpenAI Functions and Vercel AI SDK.☆1,182Oct 30, 2023Updated 2 years ago
- 🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓☆5,576Apr 23, 2026Updated last week
- Easily share permanent links to ChatGPT conversations with your friends☆1,757Sep 25, 2024Updated last year