Alternatives and similar repositories for DLSlime

Users that are interested in DLSlime are comparing it to the libraries listed below

• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆130Updated 2 weeks ago
• flashinfer-ai / cutlass-viz
  ☆64Updated 5 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆177Updated 2 weeks ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆71Updated 4 months ago
• tile-ai / tilescale
  Tile-based language built for AI computation across all scales
  ☆61Updated this week
• gty111 / gLLM
  gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling
  ☆41Updated this week
• shenh10 / DeepSeek_Simulator
  ☆85Updated 6 months ago
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆60Updated last month
• Ascend / triton-ascend
  Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend
  ☆75Updated last week
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆72Updated 3 months ago
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆95Updated 9 months ago
• zhuzilin / flash-attention-with-sink
  ☆39Updated last month
• tile-ai / AttentionEngine
  ☆50Updated 4 months ago
• KuangjuX / AttnLink
  An experimental communicating attention kernel based on DeepEP.
  ☆34Updated 2 months ago
• xlite-dev / HGEMM
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆118Updated 4 months ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆111Updated 4 months ago
• Infrawaves / DeepEP_ibrc_dual-ports_multiQP
  Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport
  ☆63Updated 4 months ago
• microsoft / tokenweave
  Efficient Compute-Communication Overlap for Distributed LLM Inference
  ☆58Updated this week
• AlibabaPAI / FLASHNN
  ☆98Updated last year
• heheda12345 / MagPy
  ☆39Updated last year
• hao-ai-lab / MuxServe
  ☆72Updated last year
• HPMLL / NVIDIA-Hopper-Benchmark
  ☆57Updated 4 months ago
• flashinfer-ai / debug-print
  Debug print operator for cudagraph debugging
  ☆13Updated last year
• CalebDu / Awesome-Cute
  ☆106Updated 4 months ago
• TiledTensor / TiledLower
  TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.
  ☆14Updated 10 months ago
• ovg-project / kvcached
  kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.
  ☆94Updated this week
• cherichy / tilecute
  ☆30Updated 3 months ago
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆97Updated 3 months ago
• xxyux / SpInfer
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆58Updated 6 months ago
• ruipeterpan / marconi
  Artifact for "Marconi: Prefix Caching for the Era of Hybrid LLMs" [MLSys '25 Outstanding Paper Award, Honorable Mention]
  ☆37Updated 6 months ago