Alternatives and similar repositories for SysGPT

Users that are interested in SysGPT are comparing it to the libraries listed below

• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆58Updated 10 months ago
• FlexFusion / FlexFusion
  The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221
  ☆25Updated 4 months ago
• fanlai0990 / CS598
  Systems for GenAI
  ☆144Updated 4 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆181Updated 11 months ago
• alibaba / ServeGen
  A framework for generating realistic LLM serving workloads
  ☆55Updated 2 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆103Updated 3 months ago
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆69Updated 2 months ago
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆266Updated 6 months ago
• Hsword / Awesome-Machine-Learning-System-Papers
  ☆76Updated 3 years ago
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆37Updated 3 years ago
• alibaba-edu / qwen-bailian-usagetraces-anon
  ☆47Updated 2 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆81Updated 5 months ago
• NEO-MLSys25 / NEO
  NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading
  ☆57Updated 2 months ago
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆323Updated 3 weeks ago
• CentML / Mist
  [EuroSys'25] Mist: Efficient Distributed Training of Large Language Models via Memory-Parallelism Co-Optimization
  ☆15Updated last month
• Relaxed-System-Lab / HexGen
  [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.
  ☆29Updated last year
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆44Updated 6 months ago
• jasperzhong / read-papers-and-code
  My paper/code reading notes in Chinese
  ☆46Updated 2 months ago
• YaoJiayi / CacheBlend
  ☆132Updated last month
• Ascend / triton-ascend
  Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend
  ☆68Updated this week
• LINs-lab / DeFT
  [ICLR 2025] DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference
  ☆34Updated 2 months ago
• open-neutrino / neutrino
  ☆148Updated last month
• microsoft / RetrievalAttention
  Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system.
  ☆77Updated 2 weeks ago
• ByteDance-Seed / StragglerAnalysis
  ☆41Updated 4 months ago
• mental2008 / awesome-papers
  Here are my personal paper reading notes (including cloud computing, resource management, systems, machine learning, deep learning, and o…
  ☆119Updated 2 weeks ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆132Updated 7 months ago
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆272Updated 8 months ago
• ovg-project / kvcached
  kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.
  ☆75Updated this week
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆233Updated 3 weeks ago
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆152Updated last year