Fast Tokens
☆158Nov 9, 2026Updated last week
Alternatives and similar repositories for fastokens
Users that are interested in fastokens are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Conditional Random Fields implemented in pure Rust☆13Mar 17, 2025Updated last year
- LLM Kernel Library for Rust☆32Oct 30, 2026Updated 2 weeks ago
- ☆30Updated this week
- 🦞 Rust library of natural language dictionaries using character-wise double-array tries.☆40Aug 12, 2026Updated 3 months ago
- Fast tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and WordPiece tok…☆64Oct 26, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆10Feb 8, 2025Updated last year
- Communication patterns for AI, built on top of NCCL device and host APIs☆83Updated this week
- Stylometric study of AI writing tells: corpus, metrics, and detector behind the solmaz.io AI de-smeller post☆15Aug 27, 2026Updated 2 months ago
- ☆125Nov 6, 2026Updated last week
- ☆14May 11, 2026Updated 6 months ago
- ☆107Oct 25, 2026Updated 3 weeks ago
- Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives☆13Apr 8, 2026Updated 7 months ago
- Blazing fast, self-hosted structured decisions for open models with a TypeSafe AI compatible API, written in Rust.☆62Nov 8, 2026Updated last week
- Rust + Python implementation of the jzip spherical compression format for embeddings☆11Feb 21, 2026Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.☆286Oct 18, 2026Updated last month
- High-performance tokenization for inference☆15Updated this week
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 10 months ago
- Always-on, low-overhead GPU and CUDA performance tracing SDK for AI workloads. C++ client APIs, CLI tools, open data model, Perfetto expo…☆115Updated this week
- TokenSpeed is a speed-of-light LLM inference engine.☆2,941Updated this week
- ☆41Oct 21, 2025Updated last year
- ☆15Jul 10, 2026Updated 4 months ago
- ⚡Japanese sentence splitting(日本語文境界判定器), 40–250× faster via a Rust-accelerated Python library with near-perfect API compatibility with …☆77Oct 14, 2025Updated last year
- LBFGS optimization algorithm ported from liblbfgs☆12Nov 25, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆389Updated this week
- GenAI inference performance benchmarking tool☆278Updated this week
- Includes a file with zstd compression in Rust☆14Feb 17, 2023Updated 3 years ago
- KV cache store for distributed LLM inference☆457Sep 16, 2026Updated 2 months ago
- High-performance safetensors model loader☆185Updated this week
- Tutti is a GPU-centric KV Cache Store to make SSD work as DRAM.☆74Nov 4, 2026Updated 2 weeks ago
- Package diskcache provides a on-disk cache for storing http results.☆12Mar 27, 2026Updated 7 months ago
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆205Updated this week
- NVIDIA Inference Xfer Library (NIXL)☆1,371Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- https://arxiv.org/abs/2610.13990☆37Oct 15, 2026Updated last month
- A better wrapper for using RDMA programming APIs in Rust flavor☆96Nov 9, 2026Updated last week
- Debug print operator for cudagraph debugging☆18Aug 2, 2024Updated 2 years ago
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,904Sep 24, 2026Updated last month
- htop-like TUI for real-time RDMA network monitoring.☆129Nov 11, 2026Updated last week
- Benchmark scripts for comparing different tokenizers and sentence segmenters of German☆12Feb 27, 2023Updated 3 years ago
- mKernel: fast multi-node, multi-GPU fused kernels☆316Updated this week
Are these results useful?