LMCache-Ascend is a plugin for running LMCache on the Ascend NPU.
☆93Nov 16, 2026Updated this week
Alternatives and similar repositories for LMCache-Ascend
Users that are interested in LMCache-Ascend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Community maintained hardware plugin for vLLM on Huawei Ascend☆3,119Updated this week
- Persist and reuse KV Cache to speedup your LLM.☆359Updated this week
- SGLang kernel library for NPU☆203Updated this week
- ☆28Jul 29, 2025Updated last year
- nano-vllm是开源的一个gpu推理项目,基于开源版本弄的一个ascend npu版本推理小demo,旨在帮助初学者了解推理的整体流程,区别于vllm,nano-vllm体量更小,麻雀虽小五脏俱全,更有助于初学者学习。☆96May 4, 2026Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Systematic and comprehensive benchmarks for LLM systems.☆62Jan 28, 2026Updated 9 months ago
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,398Updated this week
- ☆12Apr 29, 2022Updated 4 years ago
- 在Ascend服务器上使用Dcoker创建指定的可以运行的容器☆10Jul 30, 2024Updated 2 years ago
- A comprehensive knowledge base for Huawei Ascend NPU development, structured as distributed Agent Skills. https://ascend-ai-coding.github…☆185Updated this week
- A collection of amd kernels for vLLM☆21Updated this week
- openyuanrong project☆103May 25, 2026Updated 5 months ago
- Ascend TileLang adapter☆432Nov 13, 2026Updated last week
- Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature se…☆133Sep 20, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ⚡ Official code for “ReaDy: Recurrent States as Dynamic Context for Speculative Drafting in Hybrid Linear Attention Large Language Models…☆17Oct 15, 2026Updated last month
- A minimal implementation of vllm.☆73Jul 27, 2024Updated 2 years ago
- Examples of inference pipelines implemented using https://github.com/SeldonIO/seldon-core☆16Feb 1, 2023Updated 3 years ago
- 🔮 A 16-bit MIPS Processor Implementation in Verilog HDL☆12Aug 30, 2020Updated 6 years ago
- ☆23Updated this week
- About the source code of "Merging Similar Patterns for Hardware Prefetching" paper, which is accepted in MICRO 2022.☆14Mar 1, 2023Updated 3 years ago
- FalconFS is a high-performance distributed file system (DFS) designed for AI workloads.☆72May 19, 2026Updated 6 months ago
- Postman & Chatbot Arena for inference benchmarking.☆15Jun 19, 2025Updated last year
- Coarse Grained Reconfigurable Arrays with Chisel3☆11Jul 1, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆55Nov 5, 2026Updated 2 weeks ago
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆7,083Updated this week
- ☆28Mar 31, 2026Updated 7 months ago
- Triton adapter for Ascend. Mirror of https://gitcode.com/ascend/triton-ascend☆130May 18, 2026Updated 6 months ago
- ☆52Nov 4, 2026Updated 2 weeks ago
- Simulator for pFabric's ideal algorithm.☆11Apr 14, 2016Updated 10 years ago
- 🎞️ NoC router in Verilog with FIFO☆15Sep 1, 2022Updated 4 years ago
- KV cache store for distributed LLM inference☆457Sep 16, 2026Updated 2 months ago
- ☆11Apr 18, 2020Updated 6 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSi…☆284Updated this week
- [MICRO'20] LENS: A Low-level NVRAM Profiler [USENIX Security'23] NVLeak: Off-Chip Side-Channel Attacks via Non-Volatile Memory Systems☆14Jul 8, 2024Updated 2 years ago
- NVIDIA Inference Xfer Library (NIXL)☆1,371Updated this week
- ☆12Sep 25, 2019Updated 7 years ago
- SGQuant: Squeezing the Last Bit on Graph Neural Networks with Specialized Quantization☆12Aug 12, 2020Updated 6 years ago
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆498Sep 23, 2026Updated last month
- SGLang is a high-performance serving framework for large language models and multimodal models.☆27Updated this week
Are these results useful?