IndexCache: Accelerating Sparse Attention via Cross-Layer Index Reuse
☆147Mar 14, 2026Updated 7 months ago
Alternatives and similar repositories for IndexCache
Users that are interested in IndexCache are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 4 months ago
- A high-performance CLI tool written in Rust that acts as a standalone Git Agent.☆11Apr 15, 2026Updated 6 months ago
- ☆15Jul 10, 2026Updated 4 months ago
- DeeperGEMM: crazy optimized version☆85May 5, 2025Updated last year
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆52Nov 19, 2025Updated 11 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Autonomous GPU kernel optimization system driven by AI agents.☆32Mar 29, 2026Updated 7 months ago
- a size profiler for cuda binary☆74Oct 3, 2026Updated last month
- Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for…☆356Updated this week
- Offline optimization of your disaggregated Dynamo graph☆467Oct 29, 2026Updated 2 weeks ago
- Memory-bounded compressed sparse attention via streaming top-k. Triton kernels for the DeepSeek-V4 lightning indexer. 32x regime extensio…☆27May 5, 2026Updated 6 months ago
- A high-performance, RDMA-native data-plane library for large-scale heterogeneous memory pools, developed by the Tencent Astral Network Te…☆35Aug 6, 2026Updated 3 months ago
- DeepSelect: TopK kernels for DeepSeek Sparse Attention (DSA) and Samplers☆540Sep 30, 2026Updated last month
- [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads☆545Feb 10, 2025Updated last year
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,893Sep 24, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference☆316May 1, 2025Updated last year
- ☆255Nov 19, 2025Updated 11 months ago
- ☆68Updated this week
- Design hardware-friendly model architectures and migrate existing LLMs with minimal performance loss☆518Updated this week
- [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Se…☆867Mar 6, 2025Updated last year
- ☆104Feb 11, 2026Updated 9 months ago
- ☆437Oct 31, 2026Updated last week
- Perplexity GPU Kernels☆615Nov 7, 2025Updated last year
- ☆11Mar 7, 2026Updated 8 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆27Jul 13, 2026Updated 3 months ago
- ☆20Updated this week
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆280Aug 31, 2024Updated 2 years ago
- High-performance tokenization for inference☆15Nov 3, 2026Updated last week
- ☆97Sep 15, 2025Updated last year
- ☆1,162Updated this week
- High Performance LLM Inference Operator Library☆1,191Updated this week
- ☆384Updated this week
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆205Sep 2, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆135Jun 24, 2025Updated last year
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆208Feb 11, 2026Updated 9 months ago
- Open Source AI Accelerator Research Platform Standard / 开源推理研究平台☆2,025Updated this week
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆1,394Updated this week
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆1,280Updated this week
- Accelerating MoE with IO and Tile-aware Optimizations☆791Aug 29, 2026Updated 2 months ago
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,232Oct 10, 2026Updated last month
Are these results useful?