Relaxed-System-Lab / HKUST-COMP6211J-2025fallLinks
☆22Updated 2 months ago
Alternatives and similar repositories for HKUST-COMP6211J-2025fall
Users that are interested in HKUST-COMP6211J-2025fall are comparing it to the libraries listed below
Sorting:
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆82Updated last month
- [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning☆87Updated 2 months ago
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆52Updated last year
- Code release for AdapMoE accepted by ICCAD 2024☆35Updated 9 months ago
- Github repo for ICLR-2025 paper, Fine-tuning Large Language Models with Sparse Matrices☆23Updated 8 months ago
- [NeurIPS 2024] The official implementation of ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification☆32Updated 10 months ago
- A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention☆274Updated 2 months ago
- CASS: Nvidia to AMD Transpilation with Data, Models, and Benchmark☆32Updated 7 months ago
- ☆58Updated last year
- Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)☆70Updated 9 months ago
- Learning TileLang with 10 puzzles!☆56Updated this week
- Keyformer proposes KV Cache reduction through key tokens identification and without the need for fine-tuning☆59Updated last year
- gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling☆53Updated 2 weeks ago
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆61Updated 10 months ago
- Artifact for "Marconi: Prefix Caching for the Era of Hybrid LLMs" [MLSys '25 Outstanding Paper Award, Honorable Mention]☆49Updated 10 months ago
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆79Updated last month
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆97Updated last month
- ☆38Updated 5 months ago
- A collection of specialized agent skills for AI infrastructure development, enabling Claude Code to write, optimize, and debug high-perfo…☆51Updated last week
- Multi-Level Triton Runner supporting Python, IR, PTX, and cubin.☆84Updated this week
- The Official Implementation of Ada-KV [NeurIPS 2025]☆125Updated 2 months ago
- ☆143Updated last month
- [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System☆51Updated 6 months ago
- ☆54Updated 4 months ago
- ClusterKV: Manipulating LLM KV Cache in Semantic Space for Recallable Compression (DAC'25)☆22Updated 4 months ago
- This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…☆271Updated last month
- Building the Virtuous Cycle for AI-driven LLM Systems☆140Updated this week
- Summary of some awesome work for optimizing LLM inference☆168Updated 2 months ago
- [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning☆122Updated last year
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆25Updated last year