Alternatives and similar repositories for PAT

Users that are interested in PAT are comparing it to the libraries listed below

• byungsoo-oh / ml-systems-papers
  Curated collection of papers in machine learning systems
  ☆500Updated last month
• TJU-NSL / awesome-papers
  ☆28Updated last week
• DicardoX / Research-Space
  This repository is established to store personal notes and annotated papers during daily research.
  ☆179Updated 2 weeks ago
• ASISys / Adrenaline
  Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation
  ☆40Updated 2 months ago
• AI-Infra-Team / awesome-papers
  Paper reading and discussion notes, covering AI frameworks, distributed systems, cluster management, etc.
  ☆53Updated 2 months ago
• S-Lab-System-Group / Awesome-DL-Scheduling-Papers
  ☆323Updated 2 years ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆236Updated last week
• LLMServe / DistServe
  Disaggregated serving system for Large Language Models (LLMs).
  ☆772Updated 9 months ago
• MLSysU / TD-Pipe
  A Throughput-Optimized Pipeline Parallel Inference System for Large Language Models
  ☆46Updated last month
• gbxu / autoccl
  [NSDI25] AutoCCL: Automated Collective Communication Tuning for Accelerating Distributed and Parallel DNN Training
  ☆30Updated 8 months ago
• mental2008 / awesome-papers
  Here are my personal paper reading notes (including machine learning systems, AI infrastructure, and other interesting stuffs).
  ☆154Updated this week
• LLMServe / dLoRA-artifact
  ☆29Updated last year
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆172Updated 2 months ago
• QLM-project / QLM
  ☆28Updated last year
• xpan413 / FSMoE
  ☆15Updated last year
• calculon-ai / calculon
  ☆166Updated last year
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆339Updated 3 months ago
• ss7krd / Usher
  ☆14Updated last year
• icloud-ecnu / igniter
  iGniter, an interference-aware GPU resource provisioning framework for achieving predictable performance of DNN inference in the cloud.
  ☆39Updated last year
• AFDWang / Hetu-Galvatron
  Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs). If you hav…
  ☆23Updated 3 months ago
• microsoft / vidur
  A large-scale simulation framework for LLM inference
  ☆528Updated 6 months ago
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆174Updated last year
• aliyun / SimAI
  ☆803Updated last month
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆347Updated last month
• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆134Updated last year
• hemingkx / SpeculativeDecodingPapers
  📰 Must-read papers and blogs on Speculative Decoding ⚡️
  ☆1,110Updated last week
• jychen21 / Habana-LLM-Viewer
  ☆12Updated last year
• msr-fiddle / dejavu
  ☆21Updated last year
• ROCm / mori
  Modular RDMA Interface
  ☆73Updated this week
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆147Updated 3 years ago