LMCache-Ascend is a plugin for running LMCache on the Ascend NPU.
☆92Oct 25, 2026Updated this week
Alternatives and similar repositories for LMCache-Ascend
Users that are interested in LMCache-Ascend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Community maintained hardware plugin for vLLM on Huawei Ascend☆3,036Updated this week
- Persist and reuse KV Cache to speedup your LLM.☆350Updated this week
- SGLang kernel library for NPU☆197Updated this week
- ☆19Oct 20, 2026Updated last week
- ☆12Apr 29, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Memory-bounded compressed sparse attention via streaming top-k. Triton kernels for the DeepSeek-V4 lightning indexer. 32x regime extensio…☆27May 5, 2026Updated 5 months ago
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,240Updated this week
- The driver for LMCache core to run in vLLM☆71Feb 4, 2025Updated last year
- ☆28Jul 29, 2025Updated last year
- Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature se…☆133Sep 20, 2026Updated last month
- ☆77Oct 16, 2026Updated 2 weeks ago
- Examples of inference pipelines implemented using https://github.com/SeldonIO/seldon-core☆16Feb 1, 2023Updated 3 years ago
- A minimal implementation of vllm.☆73Jul 27, 2024Updated 2 years ago
- FalconFS is a high-performance distributed file system (DFS) designed for AI workloads.☆72May 19, 2026Updated 5 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Ascend TileLang adapter☆424Updated this week
- Coarse Grained Reconfigurable Arrays with Chisel3☆11Jul 1, 2024Updated 2 years ago
- ☆56Jul 7, 2025Updated last year
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆6,929Updated this week
- Triton adapter for Ascend. Mirror of https://gitcode.com/ascend/triton-ascend☆130May 18, 2026Updated 5 months ago
- Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSi…☆275Updated this week
- The repository provides docs & api & tutorials & FAQ and all things like that.☆18Updated this week
- KV cache store for distributed LLM inference☆449Sep 16, 2026Updated last month
- A comprehensive knowledge base for Huawei Ascend NPU development, structured as distributed Agent Skills. https://ascend-ai-coding.github…☆177Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- NVIDIA Inference Xfer Library (NIXL)☆1,344Updated this week
- ☆11Apr 18, 2020Updated 6 years ago
- openyuanrong project☆103May 25, 2026Updated 5 months ago
- [MICRO'20] LENS: A Low-level NVRAM Profiler [USENIX Security'23] NVLeak: Off-Chip Side-Channel Attacks via Non-Volatile Memory Systems☆14Jul 8, 2024Updated 2 years ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆26Updated this week
- [EuroSys27] TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications☆14Updated this week
- SGQuant: Squeezing the Last Bit on Graph Neural Networks with Specialized Quantization☆12Aug 12, 2020Updated 6 years ago
- As the core component of the Ascend for PyTorch community, TorchNPU is a deep learning adapter plugin built by Ascend for PyTorch, enabli…☆598Updated this week
- ☆28Jun 8, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆84Updated this week
- ☆18Jan 11, 2026Updated 9 months ago
- A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Fou…☆1,613Updated this week
- ☆44Jun 23, 2026Updated 4 months ago
- ☆10Jun 11, 2019Updated 7 years ago
- ☆11Nov 7, 2023Updated 2 years ago
- A skill for automatically optimizing CUDA code.☆47Mar 26, 2026Updated 7 months ago