Alternatives and similar repositories for GenZ-LLM-Analyzer

Users that are interested in GenZ-LLM-Analyzer are comparing it to the libraries listed below

• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆99Updated last year
• PrincetonUniversity / LLMCompass
  ☆140Updated 10 months ago
• casys-kaist / LLMServingSim
  LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale
  ☆113Updated 2 months ago
• hao-ai-lab / MuxServe
  ☆60Updated 11 months ago
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆50Updated 11 months ago
• clevercool / ANT-Quantization
  ☆97Updated last year
• shenh10 / DeepSeek_Simulator
  ☆61Updated last month
• microsoft / SparTA
  ☆144Updated 9 months ago
• LoongServe / LoongServe
  ☆96Updated 6 months ago
• UDC-GAC / venom
  A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
  ☆51Updated last year
• sitar-lab / NeuSight
  ☆34Updated 2 weeks ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆167Updated 6 months ago
• JF-D / Proteus
  ☆23Updated 10 months ago
• ranggihwang / Pregated_MoE
  ☆47Updated last year
• goliaro / specinfer-ae
  ☆19Updated last year
• naver-aics / lut-gemm
  ☆55Updated last year
• casys-kaist / NeuPIMs
  NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing
  ☆80Updated 10 months ago
• SJTU-ReArch-Group / Paper-Reading-List
  ☆106Updated 2 weeks ago
• casys-kaist / EnvPipe
  ☆24Updated last year
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆130Updated 10 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆92Updated last week
• d-matrix-ai / keyformer-llm
  ☆53Updated last year
• ParCIS / Chimera
  Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.
  ☆62Updated last month
• WukLab / preble
  Stateful LLM Serving
  ☆67Updated 2 months ago
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆81Updated last year
• xxyux / SpInfer
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆44Updated last month
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆206Updated last year
• calculon-ai / calculon
  ☆136Updated last year
• snu-comparch / Tender
  Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)
  ☆14Updated 10 months ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆65Updated 5 months ago