HydraQYH / expert_specialization_moeLinks
Expert Specialization MoE Solution based on CUTLASS
☆23Updated last week
Alternatives and similar repositories for expert_specialization_moe
Users that are interested in expert_specialization_moe are comparing it to the libraries listed below
Sorting:
- ☆39Updated 4 months ago
- ☆31Updated 5 months ago
- ☆65Updated 8 months ago
- DeeperGEMM: crazy optimized version☆73Updated 7 months ago
- Debug print operator for cudagraph debugging☆14Updated last year
- An experimental communicating attention kernel based on DeepEP.☆35Updated 4 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆55Updated this week
- ☆36Updated 2 months ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆157Updated this week
- ☆52Updated 7 months ago
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆70Updated 3 weeks ago
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆38Updated last month
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆51Updated 2 weeks ago
- Estimate MFU for DeepSeekV3☆26Updated 11 months ago
- Tile-based language built for AI computation across all scales☆106Updated this week
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆147Updated 3 months ago
- 16-fold memory access reduction with nearly no loss☆109Updated 9 months ago
- Nex Venus Communication Library☆68Updated last month
- ☆34Updated 9 months ago
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆71Updated last week
- Building the Virtuous Cycle for AI-driven LLM Systems☆100Updated this week
- Low overhead tracing library and trace visualizer for pipelined CUDA kernels☆127Updated last month
- ☆58Updated last year
- Autonomous GPU Kernel Generation via Deep Agents☆192Updated last week
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆87Updated this week
- a simple API to use CUPTI☆11Updated 4 months ago
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆72Updated 3 months ago
- ☆39Updated last week
- ☆125Updated 4 months ago
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆159Updated 2 months ago