Online playground for OpenAPI tokenizers
☆1,600Apr 24, 2025Updated last year
Alternatives and similar repositories for tiktokenizer
Users that are interested in tiktokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆18,243May 15, 2026Updated last week
- JS port and JS/WASM bindings for openai/tiktoken☆1,049Aug 9, 2025Updated 9 months ago
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆47,667Updated this week
- LlamaIndex is the leading document agent and OCR platform☆49,501May 15, 2026Updated last week
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆10,484Jul 1, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Search infrastructure for AI☆27,973May 15, 2026Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆80,418Updated this week
- Examples and guides for using the OpenAI API☆73,651Updated this week
- A utility for storing and reading files for Korean LM training 💾☆35Oct 15, 2025Updated 7 months ago
- The agent engineering platform.☆136,798May 14, 2026Updated last week
- Your API ⇒ Paid MCP. Instantly.☆18,124Feb 11, 2026Updated 3 months ago
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆171,844Updated this week
- LLM inference in C/C++☆110,506Updated this week
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆42,634Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- An AI-powered search engine with a generative UI☆8,839Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,474May 1, 2026Updated 3 weeks ago
- 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.☆74,809Mar 11, 2026Updated 2 months ago
- The agent engineering platform☆17,671May 16, 2026Updated last week
- Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/☆10,879Updated this week
- Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search☆44,307May 15, 2026Updated last week
- Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.☆64,485Updated this week
- TypeChat is a library that makes it easy to build natural language interfaces using types.☆8,653May 8, 2026Updated 2 weeks ago
- Build AI Agents, Visually☆52,839May 14, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.☆21,203Jul 4, 2024Updated last year
- Korean Named Entity Corpus☆25May 12, 2023Updated 3 years ago
- The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered application…☆24,253May 16, 2026Updated last week
- Robust Speech Recognition via Large-Scale Weak Supervision☆99,901Apr 15, 2026Updated last month
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆58,258Nov 12, 2025Updated 6 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆137,407May 15, 2026Updated last week
- Production-ready platform for agentic workflow development.☆141,464May 15, 2026Updated last week
- A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆11,818Updated this week
- Virtual whiteboard for sketching hand-drawn like diagrams☆123,747May 14, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with struc…☆16,220Updated this week
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆16,007May 13, 2026Updated last week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆8,031Jul 11, 2025Updated 10 months ago
- The open source codebase powering HuggingChat☆10,712May 14, 2026Updated last week
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆18,467Apr 14, 2026Updated last month
- LobeHub organizes your agents into 7×24 operation. It hires, schedules, reports on your entire AI team. You stay in charge — without stay…☆77,167Updated this week
- Chat with Hacker News using natural language. Built with OpenAI Functions and Vercel AI SDK.☆1,180Oct 30, 2023Updated 2 years ago