Alternatives and similar repositories for GenZ-LLM-Analyzer

Users that are interested in GenZ-LLM-Analyzer are comparing it to the libraries listed below

• PrincetonUniversity / LLMCompass
  ☆142Updated 11 months ago
• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆100Updated last year
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆51Updated last year
• casys-kaist / LLMServingSim
  LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale
  ☆117Updated 3 months ago
• UDC-GAC / venom
  A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
  ☆51Updated last year
• hao-ai-lab / MuxServe
  ☆62Updated 11 months ago
• pku-liang / ArkVale
  ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)
  ☆40Updated 5 months ago
• microsoft / SparTA
  ☆146Updated 10 months ago
• sitar-lab / NeuSight
  ☆36Updated last month
• xxyux / SpInfer
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆47Updated 2 months ago
• ranggihwang / Pregated_MoE
  ☆47Updated last year
• clevercool / ANT-Quantization
  ☆97Updated last year
• ParCIS / Magicube
  Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.
  ☆88Updated 2 years ago
• casys-kaist / NeuPIMs
  NeuPIMs: NPU-PIM Heterogeneous Acceleration for Batched LLM Inferencing
  ☆83Updated 11 months ago
• SJTU-ReArch-Group / Paper-Reading-List
  ☆108Updated last week
• ruipeterpan / marconi
  Artifact for "Marconi: Prefix Caching for the Era of Hybrid LLMs" [MLSys '25 Outstanding Paper Honorable Mention]
  ☆10Updated 2 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆70Updated 2 months ago
• LoongServe / LoongServe
  ☆99Updated 6 months ago
• uchuhimo / amanda
  ☆18Updated last year
• zhaiyi000 / tlm
  ☆38Updated 10 months ago
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆211Updated last year
• hgyhungry / ShflBW_Sparse_NN
  ☆15Updated 2 years ago
• d-matrix-ai / keyformer-llm
  ☆54Updated last year
• pku-liang / AMOS
  Automatic Mapping Generation, Verification, and Exploration for ISA-based Spatial Accelerators
  ☆110Updated 2 years ago
• parasailteam / coconet
  ☆79Updated 2 years ago
• VITA-Group / Q-Hitter
  ☆14Updated last year
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆132Updated 3 weeks ago
• YJHMITWEB / ExFlow
  Explore Inter-layer Expert Affinity in MoE Model Inference
  ☆9Updated last year
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆36Updated last month
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆81Updated last year