Fast Tokens
☆155Oct 25, 2026Updated this week
Alternatives and similar repositories for fastokens
Users that are interested in fastokens are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆28Updated this week
- Conditional Random Fields implemented in pure Rust☆13Mar 17, 2025Updated last year
- LLM Kernel Library for Rust☆32Updated this week
- 🦞 Rust library of natural language dictionaries using character-wise double-array tries.☆39Aug 12, 2026Updated 2 months ago
- ☆118Aug 5, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆10Feb 8, 2025Updated last year
- ☆15Jul 10, 2026Updated 3 months ago
- Tutti is a GPU-centric KV Cache Store to make SSD work as DRAM.☆67Oct 14, 2026Updated 2 weeks ago
- Stylometric study of AI writing tells: corpus, metrics, and detector behind the solmaz.io AI de-smeller post☆15Aug 27, 2026Updated 2 months ago
- Implements kernels with RISC-V Vector☆22Mar 24, 2023Updated 3 years ago
- Communication patterns for AI, built on top of NCCL device and host APIs☆72Updated this week
- ☆16Oct 23, 2026Updated last week
- High-performance tokenization for inference☆14Oct 21, 2026Updated last week
- ☆106Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives☆13Apr 8, 2026Updated 6 months ago
- TokenSpeed is a speed-of-light LLM inference engine.☆2,820Updated this week
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.☆285Oct 18, 2026Updated last week
- Rust + Python implementation of the jzip spherical compression format for embeddings☆11Feb 21, 2026Updated 8 months ago
- GenAI inference performance benchmarking tool☆267Updated this week
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 9 months ago
- ☆41Oct 21, 2025Updated last year
- W4A16 MoE GEMM CUDA kernel. Tuned for H200, B200 & B300.☆13Oct 20, 2026Updated last week
- LBFGS optimization algorithm ported from liblbfgs☆12Nov 25, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ⚡Japanese sentence splitting(日本語文境界判定器), 40–250× faster via a Rust-accelerated Python library with near-perfect API compatibility with …☆77Oct 14, 2025Updated last year
- A model-agnostic GPU runtime for shipping models as verified programs.☆145Updated this week
- KV cache store for distributed LLM inference☆449Sep 16, 2026Updated last month
- Statistically-Lossless Quantization of Large Language Models☆26Oct 8, 2026Updated 3 weeks ago
- First open-source KVTC implementation (NVIDIA, ICLR 2026) -- 8-32x KV cache compression via PCA + adaptive quantization + entropy coding☆24Apr 17, 2026Updated 6 months ago
- Debug print operator for cudagraph debugging☆18Aug 2, 2024Updated 2 years ago
- Package diskcache provides a on-disk cache for storing http results.☆12Mar 27, 2026Updated 7 months ago
- htop-like TUI for real-time RDMA network monitoring.☆125Updated this week
- The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221☆32Apr 22, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,875Sep 24, 2026Updated last month
- ☆380Updated this week
- A better wrapper for using RDMA programming APIs in Rust flavor☆95Oct 15, 2026Updated 2 weeks ago
- A high-performance and light-weight router for vLLM large scale deployment☆490Updated this week
- mKernel: fast multi-node, multi-GPU fused kernels☆306Oct 17, 2026Updated last week
- NVIDIA Inference Xfer Library (NIXL)☆1,341Updated this week
- Benchmark scripts for comparing different tokenizers and sentence segmenters of German☆12Feb 27, 2023Updated 3 years ago