zurawiki / tiktoken-rsLinks
Ready-made tokenizer library for working with GPT and tiktoken
☆337Updated last month
Alternatives and similar repositories for tiktoken-rs
Users that are interested in tiktoken-rs are comparing it to the libraries listed below
Sorting:
- Rust client for Qdrant vector search engine☆330Updated last week
- pgvector support for Rust☆178Updated 2 weeks ago
- Rust library for generating vector embeddings, reranking. Re-write of qdrant/fastembed.☆599Updated this week
- An unofficial, async Rust library for the OpenAI API☆118Updated 3 months ago
- OpenAI API client library for Rust (unofficial)☆438Updated 2 weeks ago
- Rust SDK for the Model Context Protocol (MCP)☆133Updated 2 months ago
- LLama.cpp rust bindings☆403Updated last year
- Llama2 LLM ported to Rust burn☆279Updated last year
- High-level, optionally asynchronous Rust bindings to llama.cpp☆229Updated last year
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆221Updated 3 months ago
- A rust library for extracting content from pdfs☆512Updated 5 months ago
- Server-sent events (SSE) client implementation for Rust☆96Updated 2 months ago
- LLM Orchestrator built in Rust☆282Updated last year
- A simple Rust library for OpenAI API, free from complex async operations and redundant dependencies.☆197Updated last year
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆556Updated this week
- Rust language bindings for Faiss☆228Updated last week
- OpenAI's ChatGPT API wrapper for Rust 🦀☆147Updated last year
- Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Gemini, DeepSeek, xAI/Grok, Groq,Cohere, ...)☆524Updated last week
- Low rank adaptation (LoRA) for Candle.☆160Updated 5 months ago
- Model Context Protocol (MCP) CLI server template for Rust☆80Updated 5 months ago
- OpenAI Dive is an unofficial async Rust library that allows you to interact with the OpenAI API.☆70Updated last week
- ☆338Updated last week
- Model Context Protocol (MCP) implementation in Rust☆345Updated 6 months ago
- A Rust implementation of OpenAI's Whisper model using the burn framework☆322Updated last year
- Rust implementation of the HNSW algorithm (Malkov-Yashunin)☆206Updated last week
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Ele…☆217Updated last week
- Inference Llama 2 in one file of pure Rust 🦀☆233Updated 2 years ago
- A set of Rust macros for working with OpenAI function/tool calls.☆53Updated last year
- A high performance, zero-copy URL router.☆476Updated last month
- ☆359Updated this week