xinhao-luo / ClusterFusionLinks
[NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive
☆60Updated 3 weeks ago
Alternatives and similar repositories for ClusterFusion
Users that are interested in ClusterFusion are comparing it to the libraries listed below
Sorting:
- A lightweight design for computation-communication overlap.☆207Updated 2 weeks ago
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆151Updated 3 months ago
- ☆130Updated last year
- Tile-based language built for AI computation across all scales☆115Updated 2 weeks ago
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆76Updated 3 weeks ago
- High performance Transformer implementation in C++.☆148Updated 11 months ago
- ☆39Updated 2 months ago
- Building the Virtuous Cycle for AI-driven LLM Systems☆112Updated this week
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆50Updated last year
- ☆81Updated 2 months ago
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆74Updated last month
- gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling☆52Updated this week
- ☆92Updated 9 months ago
- nnScaler: Compiling DNN models for Parallel Training☆122Updated 3 months ago
- ☆81Updated 7 months ago
- ☆70Updated 2 months ago
- Nex Venus Communication Library☆70Updated last month
- Sequence-level 1F1B schedule for LLMs.☆38Updated 4 months ago
- Stateful LLM Serving☆93Updated 9 months ago
- ☆15Updated last year
- ☆65Updated 8 months ago
- ☆40Updated 2 months ago
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆170Updated last year
- [EuroSys'25] Mist: Efficient Distributed Training of Large Language Models via Memory-Parallelism Co-Optimization☆21Updated 5 months ago
- ☆79Updated 3 years ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆174Updated this week
- ☆112Updated 7 months ago
- ☆337Updated this week
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆95Updated 3 weeks ago
- DeepSeek-V3/R1 inference performance simulator☆175Updated 9 months ago