Alternatives and similar repositories for FlashMoE

Users that are interested in FlashMoE are comparing it to the libraries listed below

• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆142Updated last month
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆183Updated last month
• parasailteam / coconet
  ☆83Updated 2 years ago
• yifuwang / symm-mem-recipes
  ☆146Updated 10 months ago
• microsoft / SparTA
  ☆158Updated last year
• UDC-GAC / venom
  A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
  ☆54Updated last year
• facebookexperimental / triton
  Github mirror of trition-lang/triton repo.
  ☆98Updated this week
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆118Updated last month
• flashinfer-ai / flashinfer-bench
  Building the Virtuous Cycle for AI-driven LLM Systems
  ☆82Updated this week
• apache / tvm-ffi
  Open ABI and FFI for Machine Learning Systems
  ☆167Updated this week
• ColfaxResearch / cfx-article-src
  ☆154Updated 6 months ago
• ParCIS / Chimera
  Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.
  ☆67Updated 7 months ago
• HPMLL / NVIDIA-Hopper-Benchmark
  ☆63Updated 5 months ago
• humuyan / Korch
  ASPLOS'24: Optimal Kernel Orchestration for Tensor Programs with Korch
  ☆38Updated 7 months ago
• shenh10 / DeepSeek_Simulator
  ☆90Updated 7 months ago
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆222Updated 2 years ago
• hao-ai-lab / MuxServe
  ☆75Updated 3 weeks ago
• zhuohan123 / terapipe
  ☆77Updated 4 years ago
• DD-DuDa / BitLadder
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆61Updated 3 weeks ago
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆80Updated 11 months ago
• uwsampl / SparseTIR
  SparseTIR: Sparse Tensor Compiler for Deep Learning
  ☆140Updated 2 years ago
• nox-410 / tvm.tl
  An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.
  ☆51Updated last year
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆100Updated 4 months ago
• xinhao-luo / ClusterFusion
  [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive
  ☆48Updated last month
• AlibabaPAI / FLASHNN
  ☆101Updated last year
• thu-pacman / PET
  PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections
  ☆121Updated 3 years ago
• ColfaxResearch / cutlass-kernels
  ☆243Updated last year
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆114Updated 5 months ago
• apuaaChen / EVT_AE
  Artifacts of EVT ASPLOS'24
  ☆28Updated last year
• toyaix / triton-runner
  Multi-Level Triton Runner supporting Python, IR, PTX, and cubin.
  ☆76Updated this week