Alternatives and similar repositories for OpenCATP-LLM

Users that are interested in OpenCATP-LLM are comparing it to the libraries listed below

• NetX-lab / Ayo
  [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo
  ☆60Updated 5 months ago
• CausalSim / Unbiased-Trace-Driven-Simulation
  ☆37Updated 2 years ago
• Mercidaiha / IRT-Router
  [ACL'25] Code for ACL'25 paper "IRT-Router: Effective and Interpretable Multi-LLM Routing via Item Response Theory"
  ☆27Updated 11 months ago
• Ketonmi / Awesome-Large-Scale-LLM-Serving
  Must-read papers on improving efficiency for LLM serving clusters
  ☆32Updated 8 months ago
• UChi-JCL / CacheGen
  ☆147Updated last year
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆69Updated last year
• chaojin0310 / Ditto
  Artifacts for our SIGCOMM'23 paper Ditto
  ☆15Updated 2 years ago
• noise-lab / research-course
  "How to Do Great Research" Course for Ph.D. Students
  ☆137Updated 3 months ago
• eth-easl / sailor
  AI model training on heterogeneous, geo-distributed resources
  ☆33Updated 2 months ago
• yuanmu97 / PacketGame
  PacketGame: Multi-Stream Packet Gating for Concurrent Video Inference at Scale
  ☆14Updated 2 years ago
• CSU-NetLab / A2TP-Eurosys2023
  ☆11Updated 2 years ago
• Ying1123 / VTC-artifact
  ☆43Updated last year
• NASP-THU / multiverse
  GPU-accelerated LLM Training Simulator
  ☆50Updated 7 months ago
• inpluslab-wuhui / Systems-for-Foundation-Models
  ☆19Updated 8 months ago
• gta0804 / MASS
  Official implementation of MASS: Multi-Agent Simulation Scaling for Portfolio Construction
  ☆161Updated 2 months ago
• yichuan-w / MLsys_reading_list
  A record of reading list on some MLsys popular topic
  ☆21Updated 10 months ago
• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆102Updated 2 years ago
• songxxzp / OpenReviewers
  Openreviewers: Multi Agent Academic Review Simulation System
  ☆23Updated last year
• netiken / m4
  [TBD] "m4: A Learned Flow-level Network Simulator" by Chenning Li, Anton A. Zabreyko, Om Chabra, Arash Nasr-Esfahany, Kevin Zhao, Pratees…
  ☆16Updated 2 months ago
• ACMClassCourses / Arch2022-Notes
  ☆12Updated 2 years ago
• alibaba / alibaba-lingjun-dataset-2023
  ☆64Updated last year
• hongzhangblaze / CS854-F24
  ☆54Updated 4 months ago
• AmyWorkspace / nassim
  Data repository of NAssim
  ☆29Updated 3 years ago
• LiuXiaoxuanPKU / OSD
  ☆64Updated last year
• Thesys-lab / Helix-ASPLOS25
  Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"
  ☆76Updated 3 months ago
• microsoft / TE-CCL
  ☆48Updated last year
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆278Updated last month
• fanlai0990 / CS598
  Systems for GenAI
  ☆155Updated last week
• michaelzhiluo / starburst
  Burstable Cloud Scheduler
  ☆16Updated last year
• gudiandian / ElasticFlow
  ☆17Updated last year