infinigence / FUSCOLinks
High-performance distributed data shuffling (all-to-all) library for MoE training and inference
☆79Updated this week
Alternatives and similar repositories for FUSCO
Users that are interested in FUSCO are comparing it to the libraries listed below
Sorting:
- DeeperGEMM: crazy optimized version☆74Updated 7 months ago
- ☆65Updated 8 months ago
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆89Updated this week
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆150Updated 3 months ago
- ☆115Updated 7 months ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆53Updated last year
- ☆52Updated 7 months ago
- A lightweight design for computation-communication overlap.☆206Updated last week
- ☆32Updated 6 months ago
- Autonomous GPU Kernel Generation via Deep Agents☆197Updated this week
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆73Updated this week
- Debug print operator for cudagraph debugging☆14Updated last year
- PyTorch bindings for CUTLASS grouped GEMM.☆135Updated 7 months ago
- ☆39Updated 4 months ago
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆153Updated last month
- Distributed MoE in a Single Kernel [NeurIPS '25]☆171Updated this week
- ☆125Updated 4 months ago
- Implement Flash Attention using Cute.☆100Updated last year
- ☆36Updated 2 months ago
- ☆80Updated 2 months ago
- Accelerating MoE with IO and Tile-aware Optimizations☆469Updated last week
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆73Updated 3 months ago
- Building the Virtuous Cycle for AI-driven LLM Systems☆103Updated this week
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆140Updated 7 months ago
- Tile-based language built for AI computation across all scales☆109Updated last week
- ☆67Updated this week
- A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.☆74Updated 2 weeks ago
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆66Updated 3 months ago
- ☆96Updated 9 months ago
- a size profiler for cuda binary☆69Updated 2 months ago