High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and SGLang.
☆219Oct 30, 2026Updated this week
Alternatives and similar repositories for pegaflow
Users that are interested in pegaflow are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 9 months ago
- Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2☆729Updated this week
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- ☆134Updated this week
- KV cache store for distributed LLM inference☆449Sep 16, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Early-stage Rust drop-in alternative frontend for vLLM☆73May 22, 2026Updated 5 months ago
- High Performance KV Cache Store for LLM☆59May 20, 2026Updated 5 months ago
- TokenSpeed is a speed-of-light LLM inference engine.☆2,824Updated this week
- A model-agnostic GPU runtime for shipping models as verified programs.☆145Updated this week
- NVIDIA Inference Xfer Library (NIXL)☆1,344Updated this week
- Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini &…☆693Updated this week
- Tutti is a GPU-centric KV Cache Store to make SSD work as DRAM.☆69Updated this week
- W4A16 MoE GEMM CUDA kernel. Tuned for H200, B200 & B300.☆14Updated this week
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆6,929Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆380Updated this week
- A workload for deploying LLM inference services on Kubernetes☆312Updated this week
- ☆184Apr 23, 2026Updated 6 months ago
- Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSi…☆275Updated this week
- RDMA library in Go☆18Jun 17, 2026Updated 4 months ago
- A high-performance and light-weight router for vLLM large scale deployment☆490Updated this week
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆208Feb 11, 2026Updated 8 months ago
- mKernel: fast multi-node, multi-GPU fused kernels☆306Oct 17, 2026Updated last week
- A curated collection of Claude Code agent skills that accelerate the entire vLLM development lifecycle.☆22Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- htop-like TUI for real-time RDMA network monitoring.☆125Updated this week
- ☆28Updated this week
- ☆1,089Updated this week
- An adaptive-radix-tree metastore☆31Updated this week
- a high-performance, large-capacity, multi-tenant, data-persistent, strong data consistency based on raft, Redis-compatible elastic KV dat…☆57Oct 14, 2026Updated 2 weeks ago
- A high-performance, RDMA-native data-plane library for large-scale heterogeneous memory pools, developed by the Tencent Astral Network Te…☆35Aug 6, 2026Updated 2 months ago
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆197Updated this week
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,878Sep 24, 2026Updated last month
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,240Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A throughput-oriented high-performance serving framework for LLMs☆976Mar 29, 2026Updated 7 months ago
- SiMM: Scalable in-Memory Middleware☆45Sep 24, 2026Updated last month
- Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.☆1,500Oct 19, 2026Updated last week
- Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for…☆340Updated this week
- ☆97Sep 15, 2025Updated last year
- High-performance LLM operator library built on TileLang.☆202Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆8,409Updated this week