Alternatives and similar repositories for SysGPT

Users that are interested in SysGPT are comparing it to the libraries listed below

• NEO-MLSys25 / NEO
  NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading
  ☆64Updated 3 months ago
• alibaba / ServeGen
  A framework for generating realistic LLM serving workloads
  ☆67Updated last week
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆72Updated 4 months ago
• alibaba-edu / qwen-bailian-usagetraces-anon
  ☆52Updated 4 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆185Updated last year
• FlexFusion / FlexFusion
  The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221
  ☆25Updated 5 months ago
• ovg-project / kvcached
  Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
  ☆103Updated this week
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆60Updated 11 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆135Updated 8 months ago
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆135Updated 3 weeks ago
• sii-research / VCCL
  Venus Collective Communication Library, supported by SII and Infrawaves.
  ☆95Updated this week
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆181Updated this week
• ByteDance-Seed / StragglerAnalysis
  ☆42Updated 5 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆116Updated 4 months ago
• Hsword / Awesome-Machine-Learning-System-Papers
  ☆77Updated 3 years ago
• fanlai0990 / CS598
  Systems for GenAI
  ☆144Updated 5 months ago
• xinhao-luo / ClusterFusion
  [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive
  ☆43Updated 3 weeks ago
• mental2008 / awesome-papers
  Here are my personal paper reading notes (including cloud computing, resource management, systems, machine learning, deep learning, and o…
  ☆126Updated this week
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆241Updated 2 weeks ago
• WukLab / preble
  Stateful LLM Serving
  ☆85Updated 7 months ago
• antgroup / DeepXTrace
  DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.
  ☆60Updated this week
• xlite-dev / HGEMM
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆120Updated 5 months ago
• InfiniTensor / InfiniTensor
  ☆259Updated this week
• KuangjuX / AttnLink
  An experimental communicating attention kernel based on DeepEP.
  ☆34Updated 2 months ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆72Updated 5 months ago
• stepfun-ai / StepMesh
  ☆304Updated 2 weeks ago
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆277Updated 7 months ago
• cherichy / tilecute
  ☆31Updated 3 months ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆48Updated last month
• abcdabcd987 / libfabric-efa-demo
  ☆60Updated 9 months ago