Alternatives and similar repositories for gLLM

Users that are interested in gLLM are comparing it to the libraries listed below

• HPMLL / NVIDIA-Hopper-Benchmark
  ☆44Updated 3 weeks ago
• TiledTensor / TiledLower
  TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.
  ☆14Updated 7 months ago
• alibaba-edu / qwen-bailian-usagetraces-anon
  ☆19Updated 2 weeks ago
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆36Updated 3 years ago
• WukLab / preble
  Stateful LLM Serving
  ☆73Updated 3 months ago
• open-neutrino / neutrino
  ☆54Updated this week
• yuyangJin / PerFlow-AI
  PerFlow-AI is a programmable performance analysis, modeling, prediction tool for AI system.
  ☆19Updated last month
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆61Updated last year
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆27Updated 4 months ago
• AlibabaResearch / mononn
  ☆28Updated 11 months ago
• Scientific-Computing-Lab / STREAMer
  STREAMer: Benchmarking remote volatile and non-volatile memory bandwidth
  ☆17Updated last year
• google / iopddl
  Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning
  ☆23Updated last month
• KuangjuX / Paper-reading
  My Paper Reading Lists and Notes.
  ☆20Updated 5 months ago
• microsoft / cusync
  ☆27Updated last year
• Chtholly-Boss / swizzle
  A practical way of learning Swizzle
  ☆20Updated 4 months ago
• aoli-al / HFuse
  Horizontal Fusion
  ☆24Updated 3 years ago
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆94Updated 2 years ago
• LeiWang1999 / Stream-k.tvm
  ☆19Updated 8 months ago
• rchardx / cuda-gemm
  ☆23Updated 2 months ago
• Linestro / GRACE
  Artifact of ASPLOS'23 paper entitled: GRACE: A Scalable Graph-Based Approach to Accelerating Recommendation Model Inference
  ☆18Updated 2 years ago
• getianao / ngAP
  ngAP's artifact for ASPLOS'24
  ☆23Updated last week
• abcdabcd987 / libfabric-efa-demo
  ☆39Updated 5 months ago
• thustorage / Medusa
  Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]
  ☆23Updated last month
• shenh10 / DeepSeek_Simulator
  ☆73Updated 2 months ago
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆52Updated last year
• Nelson-Cheung / yatsenos-riscv
  Rebuild YatSenOS On RISC-V 64.
  ☆20Updated 3 years ago
• xxyux / SpInfer
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆48Updated 3 months ago
• NEO-MLSys25 / NEO
  NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading
  ☆39Updated last week
• parasailteam / coconet
  ☆79Updated 2 years ago
• Lin-Mao / DrGPUM
  A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.
  ☆25Updated 8 months ago