Alternatives and similar repositories for torch-graph

Users that are interested in torch-graph are comparing it to the libraries listed below

• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆36Updated 2 years ago
• tonyzhao-jt / LLM-PQ
  Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"
  ☆31Updated last year
• Youhe-Jiang / IJCAI2023-OptimalShardedDataParallel
  [IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any inte…
  ☆51Updated last year
• pengyanghua / optimus
  A Deep Learning Cluster Scheduler
  ☆37Updated 4 years ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆100Updated last year
• S-Lab-System-Group / HeliosArtifact
  HeliosArtifact
  ☆20Updated 2 years ago
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆81Updated last year
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆34Updated 2 years ago
• S-Lab-System-Group / Lucid
  Lucid: A Non-Intrusive, Scalable and Interpretable Scheduler for Deep Learning Training Jobs
  ☆53Updated last year
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆58Updated last year
• SJTU-IPADS / disb
  DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.
  ☆52Updated 8 months ago
• msr-fiddle / blox
  ☆42Updated 10 months ago
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆28Updated last year
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆73Updated last month
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆60Updated 11 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆67Updated 2 months ago
• JF-D / Parcae
  ☆17Updated last year
• msr-fiddle / dnn-partitioning
  ☆40Updated 4 years ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆167Updated 7 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆113Updated last week
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆73Updated 2 weeks ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆88Updated 4 months ago
• JF-D / Proteus
  ☆23Updated 10 months ago
• DicardoX / Research-Space
  This repository is established to store personal notes and annotated papers during daily research.
  ☆122Updated 3 weeks ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆99Updated last year
• msr-fiddle / DS-Analyzer
  ☆35Updated 4 years ago
• kungfu-team / tenplex
  Dynamic resources changes for multi-dimensional parallelism training
  ☆25Updated 6 months ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆38Updated 2 months ago
• sunkx109 / GPUs-Specs
  Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM
  ☆39Updated 2 months ago