infinigence / FlashOverlapLinks
A lightweight design for computation-communication overlap.
☆219Updated 2 weeks ago
Alternatives and similar repositories for FlashOverlap
Users that are interested in FlashOverlap are comparing it to the libraries listed below
Sorting:
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆161Updated 4 months ago
- ☆105Updated last year
- Tile-based language built for AI computation across all scales☆120Updated this week
- ☆113Updated 8 months ago
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆123Updated last month
- High performance Transformer implementation in C++.☆150Updated last year
- ☆95Updated 10 months ago
- ☆159Updated last year
- ☆342Updated last week
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆71Updated 4 months ago
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆66Updated last month
- nnScaler: Compiling DNN models for Parallel Training☆124Updated 4 months ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆82Updated last year
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆92Updated 2 weeks ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆192Updated last year
- ☆175Updated 9 months ago
- DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.☆92Updated 3 weeks ago
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆80Updated last month
- DeepSeek-V3/R1 inference performance simulator☆176Updated 10 months ago
- Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.☆70Updated 10 months ago
- ☆131Updated last year
- NVIDIA cuTile learn☆158Updated 2 months ago
- ☆65Updated 9 months ago
- ☆161Updated 3 months ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆148Updated 8 months ago
- Learning TileLang with 10 puzzles!☆118Updated last week
- ☆85Updated 3 months ago
- Pipeline Parallelism Emulation and Visualization☆77Updated last month
- ☆88Updated 8 months ago
- Open ABI and FFI for Machine Learning Systems☆333Updated this week