Fast Tokens
☆151Sep 30, 2026Updated this week
Alternatives and similar repositories for fastokens
Users that are interested in fastokens are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM Kernel Library for Rust☆32Sep 9, 2026Updated 3 weeks ago
- htop-like TUI for real-time RDMA network monitoring.☆109Updated this week
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆177Updated this week
- Implements kernels with RISC-V Vector☆22Mar 24, 2023Updated 3 years ago
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- High-performance GPU kernels for Ads and Recsys model training, independently implemented and optimized for real-world workloads and mode…☆52Updated this week
- Completed codelabs from the gRPC project.☆18Sep 2, 2026Updated last month
- A high-performance and light-weight router for vLLM large scale deployment☆453Updated this week
- KV cache store for distributed LLM inference☆445Sep 16, 2026Updated 2 weeks ago
- ☆360Updated this week
- IP Over Infiniband (IPoIB) CNI Plugin☆19Updated this week
- A better wrapper for using RDMA programming APIs in Rust flavor☆96Sep 20, 2026Updated last week
- TokenSpeed is a speed-of-light LLM inference engine.☆2,189Updated this week
- Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders☆19May 23, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Learning High-Quality and General-Purpose Phrase Representations. Findings of EACL 2024☆16Feb 29, 2024Updated 2 years ago
- SiMM: Scalable in-Memory Middleware☆43Sep 24, 2026Updated last week
- Systematic and comprehensive benchmarks for LLM systems.☆61Jan 28, 2026Updated 8 months ago
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆1,006Sep 15, 2026Updated 2 weeks ago
- DeeperGEMM: crazy optimized version☆85May 5, 2025Updated last year
- ☆101Updated this week
- NVIDIA Inference Xfer Library (NIXL)☆1,283Updated this week
- High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and S…☆210Updated this week
- Communication patterns for AI, built on top of NCCL device and host APIs☆66Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Early-stage Rust drop-in alternative frontend for vLLM☆73May 22, 2026Updated 4 months ago
- CUDA Embedding Lookup Kernel Library☆50Jun 26, 2026Updated 3 months ago
- All things generative! Discord Bot☆21Aug 13, 2023Updated 3 years ago
- bpf(2)-based ftrace(1)-like function graph tracer for golang processes.☆33Aug 18, 2023Updated 3 years ago
- A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.☆119Dec 17, 2025Updated 9 months ago
- ☆383Updated this week
- ☆15Updated this week
- Proof of concept for running moshi/hibiki using webrtc☆21Feb 28, 2025Updated last year
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆27Nov 11, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official Code Repositiry for "RaDeR: Reasoning-aware Dense Retrieval Models" accepted at Main Conference EMNLP 2025☆18Jun 23, 2025Updated last year
- IREE Tokenizer Python Bindings☆21Mar 5, 2026Updated 6 months ago
- ☆19Jun 25, 2026Updated 3 months ago
- High-performance safetensors model loader☆168Updated this week
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆1,356Updated this week
- This repositories contains the reference implementation for the Sparse Delta Memory paper.More precisely, it contains the model definitio…☆40Jul 9, 2026Updated 2 months ago
- In this project, we propose to study Vision Transformers trained using the Barlow Twins self-supervised method, and compare the results w…☆17Oct 3, 2023Updated 2 years ago