Alternatives and similar repositories for SpaceServe

Users that are interested in SpaceServe are comparing it to the libraries listed below

• DeepLink-org / DLSlime
  DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
  ☆91Updated this week
• Infrawaves / DeepEP_ibrc_dual-ports_multiQP
  Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport
  ☆73Updated 8 months ago
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆151Updated 3 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆148Updated 11 months ago
• ByteDance-Seed / StragglerAnalysis
  ☆49Updated 8 months ago
• infinigence / FUSCO
  High-performance distributed data shuffling (all-to-all) library for MoE training and inference
  ☆102Updated last week
• alibaba-edu / qwen-bailian-usagetraces-anon
  ☆70Updated 2 months ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆64Updated last year
• gty111 / gLLM
  gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling
  ☆52Updated this week
• kvcache-ai / TrEnv-X
  ☆72Updated 3 months ago
• NEO-MLSys25 / NEO
  NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading
  ☆77Updated 6 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆93Updated 9 months ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆123Updated 2 weeks ago
• tjluyao / kv.run
  A model serving framework for various research and production scenarios. Seamlessly built upon the PyTorch and HuggingFace ecosystem.
  ☆24Updated last year
• infinigence / HamiltonAttention
  ☆39Updated 2 months ago
• sspec-project / SparseSpec
  Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding
  ☆74Updated last month
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆74Updated 8 months ago
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆20Updated last year
• microsoft / tokenweave
  Efficient Compute-Communication Overlap for Distributed LLM Inference
  ☆67Updated 2 months ago
• Azure / msccl-executor-nccl
  ☆47Updated last year
• abcdabcd987 / libfabric-efa-demo
  ☆73Updated last year
• tile-ai / TileOPs
  ☆69Updated this week
• awslabs / optimizing-multitask-training-through-dynamic-pipelines
  Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
  ☆19Updated 2 years ago
• antgroup / DeepXTrace
  DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.
  ☆83Updated 3 weeks ago
• hao-ai-lab / MuxServe
  ☆81Updated 2 months ago
• liangyuRain / ForestColl
  ☆16Updated 8 months ago
• eth-easl / sailor
  AI model training on heterogeneous, geo-distributed resources
  ☆32Updated last month
• zhuzilin / flash-attention-with-sink
  ☆39Updated 5 months ago
• microsoft / chunk-attention
  ☆84Updated 8 months ago
• sii-research / VCCL
  Venus Collective Communication Library, supported by SII and Infrawaves.
  ☆132Updated this week