zurawiki / tiktoken-rsLinks
Ready-made tokenizer library for working with GPT and tiktoken
☆334Updated 3 weeks ago
Alternatives and similar repositories for tiktoken-rs
Users that are interested in tiktoken-rs are comparing it to the libraries listed below
Sorting:
- Rust client for Qdrant vector search engine☆323Updated last week
- pgvector support for Rust☆175Updated 3 months ago
- Rust library for generating vector embeddings, reranking. Re-write of qdrant/fastembed.☆581Updated this week
- OpenAI API client library for Rust (unofficial)☆435Updated this week
- LLama.cpp rust bindings☆398Updated last year
- Llama2 LLM ported to Rust burn☆280Updated last year
- Rust SDK for the Model Context Protocol (MCP)☆133Updated last month
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆221Updated 2 months ago
- High-level, optionally asynchronous Rust bindings to llama.cpp☆228Updated last year
- An unofficial, async Rust library for the OpenAI API☆117Updated 2 months ago
- Fast, streaming indexing, query, and agentic LLM applications in Rust☆542Updated this week
- LLM Orchestrator built in Rust☆280Updated last year
- OpenAI's ChatGPT API wrapper for Rust 🦀☆147Updated last year
- A rust library for extracting content from pdfs☆507Updated 4 months ago
- A Rust implementation of OpenAI's Whisper model using the burn framework☆321Updated last year
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Ele…☆190Updated 3 weeks ago
- Example of tch-rs on M1☆54Updated last year
- Rust language bindings for Faiss☆228Updated 5 months ago
- A simple Rust library for OpenAI API, free from complex async operations and redundant dependencies.☆193Updated last year
- Stable Diffusion v1.4 ported to Rust's burn framework☆341Updated 10 months ago
- Inference Llama 2 in one file of pure Rust 🦀☆233Updated last year
- Low rank adaptation (LoRA) for Candle.☆154Updated 4 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆230Updated 3 weeks ago
- Server-sent events (SSE) client implementation for Rust☆95Updated last month
- Wrapper around reqwest to allow for client middleware chains.☆333Updated this week
- A set of Rust macros for working with OpenAI function/tool calls.☆53Updated last year
- Model Context Protocol (MCP) CLI server template for Rust☆80Updated 4 months ago
- Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Gemini, DeepSeek, xAI/Grok, Groq,Cohere, ...)☆519Updated last week
- ☆348Updated this week
- An Approximate Nearest Neighbors library in Rust, based on random projections and LMDB and optimized for memory usage☆277Updated last week