Alternatives and similar repositories for DeepSeek_Simulator

Users that are interested in DeepSeek_Simulator are comparing it to the libraries listed below

• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆175Updated 9 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆207Updated last week
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆151Updated 3 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆147Updated 11 months ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆64Updated last year
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆123Updated last week
• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆129Updated last year
• DeepLink-org / DLSlime
  DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
  ☆89Updated last week
• HPMLL / NVIDIA-Hopper-Benchmark
  ☆77Updated 7 months ago
• tile-ai / tilescale
  Tile-based language built for AI computation across all scales
  ☆115Updated 2 weeks ago
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆44Updated 5 months ago
• LoongServe / LoongServe
  ☆130Updated last year
• parasailteam / coconet
  ☆84Updated 3 years ago
• sunkx109 / GPUs-Specs
  Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM
  ☆71Updated 4 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆92Updated 9 months ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated last year
• gty111 / gLLM
  gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling
  ☆52Updated this week
• Infrawaves / DeepEP_ibrc_dual-ports_multiQP
  Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport
  ☆73Updated 7 months ago
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆66Updated last year
• AlibabaResearch / mononn
  ☆32Updated last year
• abhibambhaniya / GenZ-LLM-Analyzer
  LLM Inference analyzer for different hardware platforms
  ☆97Updated last month
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆66Updated 3 months ago
• hao-ai-lab / MuxServe
  ☆80Updated 2 months ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆150Updated last year
• apache / tvm-ffi
  Open ABI and FFI for Machine Learning Systems
  ☆274Updated this week
• xinhao-luo / ClusterFusion
  [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive
  ☆60Updated 3 weeks ago
• toyaix / triton-runner
  Multi-Level Triton Runner supporting Python, IR, PTX, and cubin.
  ☆80Updated 2 weeks ago
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆104Updated 3 years ago
• alibaba-edu / qwen-bailian-usagetraces-anon
  ☆70Updated 2 months ago
• Hsword / Awesome-Machine-Learning-System-Papers
  ☆79Updated 3 years ago