Alternatives and similar repositories for OpenCATP-LLM

Users that are interested in OpenCATP-LLM are comparing it to the libraries listed below

• NetX-lab / Ayo
  [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo
  ☆57Updated 5 months ago
• yuanmu97 / PacketGame
  PacketGame: Multi-Stream Packet Gating for Concurrent Video Inference at Scale
  ☆14Updated 2 years ago
• UChi-JCL / CacheGen
  ☆145Updated last year
• chaojin0310 / Ditto
  Artifacts for our SIGCOMM'23 paper Ditto
  ☆15Updated 2 years ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆66Updated last year
• Ying1123 / VTC-artifact
  ☆43Updated last year
• CSU-NetLab / A2TP-Eurosys2023
  ☆10Updated 2 years ago
• Mercidaiha / IRT-Router
  [ACL'25] Code for ACL'25 paper "IRT-Router: Effective and Interpretable Multi-LLM Routing via Item Response Theory"
  ☆24Updated 10 months ago
• Thesys-lab / Helix-ASPLOS25
  Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"
  ☆75Updated 2 months ago
• zxxia / benchmarking
  ☆20Updated 3 years ago
• newtrip-project / afr
  Enabling High Quality Real-Time Communications with Adaptive Frame-Rate (USENIX NSDI 2023)
  ☆23Updated 2 years ago
• JF-D / Parcae
  ☆21Updated last year
• LiuXiaoxuanPKU / OSD
  ☆64Updated last year
• microsoft / TE-CCL
  ☆47Updated last year
• tonyzhao-jt / LLM-PQ
  Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …
  ☆36Updated 4 months ago
• gudiandian / ElasticFlow
  ☆16Updated last year
• NASP-THU / multiverse
  GPU-accelerated LLM Training Simulator
  ☆47Updated 6 months ago
• gta0804 / MASS
  Official implementation of MASS: Multi-Agent Simulation Scaling for Portfolio Construction
  ☆157Updated last month
• hongzhangblaze / CS854-F24
  ☆54Updated 3 months ago
• S-Lab-System-Group / Primo
  Primo: Practical Learning-Augmented Systems with Interpretable Models
  ☆19Updated 2 years ago
• eth-easl / sailor
  AI model training on heterogeneous, geo-distributed resources
  ☆32Updated last month
• michaelzhiluo / starburst
  Burstable Cloud Scheduler
  ☆16Updated last year
• noise-lab / research-course
  "How to Do Great Research" Course for Ph.D. Students
  ☆133Updated 2 months ago
• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆102Updated last year
• James-QiuHaoran / LLM-serving-with-proxy-models
  Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …
  ☆48Updated last year
• junhua-l / Awesome-Video-Streaming-and-Analysis
  🔥🔥🔥 Latest works on video streaming/processing/analysis
  ☆111Updated 2 years ago
• yichuan-w / MLsys_reading_list
  A record of reading list on some MLsys popular topic
  ☆17Updated 9 months ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆93Updated 2 years ago
• xinzhel / LLM-Search
  Survey on LLM Inference via Search (TMLR 2025)
  ☆14Updated 8 months ago
• MincYu / gillis-open-source
  ☆26Updated 2 years ago