☆29Oct 20, 2026Updated last week
Alternatives and similar repositories for kvcache-blog
Users that are interested in kvcache-blog are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆20Aug 27, 2026Updated 2 months ago
- ☆19Oct 18, 2025Updated last year
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- ☆12Apr 29, 2022Updated 4 years ago
- TokenSim is a tool for simulating the behavior of large language models (LLMs) in a distributed environment.☆45Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Inference Platform Simulation☆49Updated this week
- La-MIR is a benchmarking framework to evaluate and analyze the ability of LLMs to understand compiler Intermediate Representation (IR).☆13May 23, 2025Updated last year
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated 11 months ago
- SGLang Kunlun (sglang-kunlun) is a community-maintained hardware plugin designed to seamlessly run SGLang on the Kunlun XPU.☆62Oct 16, 2026Updated last week
- PyPTO kernels and end-to-end LLM models for Ascend NPUs.☆25Updated this week
- An Efficent BPE Algorithm Faster then Hugging Face Tokenizer's Implementation☆13Sep 30, 2026Updated last month
- Linux FullMAC driver for Realtek RTL8188SU/RTL8191SU/RTL8192SU devices☆13Aug 17, 2017Updated 9 years ago
- Red Team AI Benchmark: Evaluating LLMs for authorized offensive-security tasks☆18Jul 13, 2026Updated 3 months ago
- Agent Skill Development Kit for Skill Writers and Power Users☆16Feb 6, 2026Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ASPLOS 2026] M2XFP: A Metadata-Augmented Microscaling Data Format for Efficient Low-bit Quantization.☆17Jan 29, 2026Updated 9 months ago
- ☆16Jun 1, 2026Updated 4 months ago
- Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSi…☆275Updated this week
- A living AI civilisation you can watch: tiny creatures discover, build, teach and pass knowledge on, with any LLM in their minds.☆24Oct 17, 2026Updated last week
- Rewrite Capstone in Rust☆43Oct 15, 2026Updated 2 weeks ago
- Speed of Light Analysis for ML Model Runtime☆143Oct 13, 2026Updated 2 weeks ago
- ☆21Updated this week
- DLAFNet: Direct LiDAR-Aerial Fusion Network for Semantic Segmentation of 2D Aerial Image and 3D LiDAR Point Cloud☆19Nov 21, 2023Updated 2 years ago
- MLSys 2021 paper: MicroRec: efficient recommendation inference by hardware and data structure solutions☆21May 26, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Flash-Flash KDA: H100-optimized Flash Kimi Delta Attention kernels☆24Jul 24, 2026Updated 3 months ago
- 跑得比HK记者快的日志库☆11Jun 30, 2021Updated 5 years ago
- Made a CPU in Logisim when I was 14 (2009), and wrote a naive assembler and compiler for it in Flash. The CPU's design is inspired by Don…☆10Sep 30, 2016Updated 10 years ago
- Radix Tree KV Cache with Turn-Aware Growth☆12Jul 21, 2025Updated last year
- GLM-5.3-Flash NVFP4 on two or four DGX Sparks cabled as a ring, with no switch: the RiNGSiDE serving recipe☆30Sep 27, 2026Updated last month
- c++ library for reactive programming. Based on streamulus.☆15Dec 31, 2015Updated 10 years ago
- Educational implementation of Kimi Delta Attention from 'Kimi Linear: An Expressive, Efficient Attention Architecture' (arXiv:2510.26692)☆16Updated this week
- Very small and high performance CPU☆13Dec 3, 2024Updated last year
- A community-driven pypto implementation☆132Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and S…☆218Updated this week
- Flexible and Pluggable Serving Engine for Diffusion LLMs☆158Jul 13, 2026Updated 3 months ago
- original 8bit CPU of ICF3-Z☆12Feb 20, 2020Updated 6 years ago
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated 4 months ago
- Cache Simulator specialized for flash caching for bulk storage systems)☆13Jan 16, 2024Updated 2 years ago
- A Vibed GPU written in SpinalHDL☆18Mar 31, 2026Updated 6 months ago
- 使用Sentencepiece对中文语料进行分词☆13Nov 30, 2023Updated 2 years ago