[NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive
☆66Dec 11, 2025Updated 2 months ago
Alternatives and similar repositories for ClusterFusion
Users that are interested in ClusterFusion are comparing it to the libraries listed below
Sorting:
- ☆18Mar 4, 2025Updated last year
- ☆36Dec 9, 2025Updated 2 months ago
- A collection of specialized agent skills for AI infrastructure development, enabling Claude Code to write, optimize, and debug high-perfo…☆88Feb 2, 2026Updated last month
- libsmctrl论文的复现，添加了python端接口，可以在python端灵活调用接口来分配计算资源☆12May 21, 2024Updated last year
- Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration☆36Jan 8, 2026Updated last month
- a simple API to use CUPTI☆11Aug 19, 2025Updated 6 months ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆56May 29, 2024Updated last year
- ☆12Jun 29, 2024Updated last year
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆34Feb 10, 2025Updated last year
- A lightweight design for computation-communication overlap.☆223Jan 20, 2026Updated last month
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆42May 13, 2025Updated 9 months ago
- ☆226Nov 19, 2025Updated 3 months ago
- ☆15Jun 26, 2024Updated last year
- DeeperGEMM: crazy optimized version☆74May 5, 2025Updated 10 months ago
- STREAMer: Benchmarking remote volatile and non-volatile memory bandwidth☆17Aug 21, 2023Updated 2 years ago
- ☆18Apr 21, 2024Updated last year
- ☆41Oct 15, 2025Updated 4 months ago
- ☆131Nov 11, 2024Updated last year
- ☆38Aug 7, 2025Updated 6 months ago
- Efficient GPU communication over multiple NICs.☆26Nov 20, 2025Updated 3 months ago
- APEX+ is an LLM Serving Simulator☆42Jun 16, 2025Updated 8 months ago
- Compiler for Dynamic Neural Networks☆45Nov 13, 2023Updated 2 years ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆194Feb 27, 2026Updated last week
- ☆52May 19, 2025Updated 9 months ago
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆90Sep 11, 2025Updated 5 months ago
- tutorials about polyhedral compilation.☆61Feb 9, 2026Updated 3 weeks ago
- ☆68Jun 23, 2025Updated 8 months ago
- High Performance KV Cache Store for LLM☆47Updated this week
- Pipeline Parallelism Emulation and Visualization☆79Jan 8, 2026Updated last month
- Distributed Compiler based on Triton for Parallel Systems☆1,371Feb 13, 2026Updated 3 weeks ago
- Pin based tool for simulation of rack-scale disaggregated memory systems☆32Mar 8, 2025Updated 11 months ago
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆446Feb 4, 2026Updated last month
- A low-latency & high-throughput serving engine for LLMs☆482Jan 8, 2026Updated last month
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆30Jun 14, 2024Updated last year
- Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“☆64Jun 5, 2024Updated last year
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆19Nov 18, 2024Updated last year
- Codes & examples for "CUDA - From Correctness to Performance"☆123Oct 24, 2024Updated last year
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆33Nov 29, 2024Updated last year
- GLake: optimizing GPU memory management and IO transmission.☆498Mar 24, 2025Updated 11 months ago