Alternatives and similar repositories for libsmctrl

Users that are interested in libsmctrl are comparing it to the libraries listed below

• parasailteam / coconet
  ☆79Updated 2 years ago
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆58Updated last year
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆61Updated 11 months ago
• AlibabaResearch / mononn
  ☆28Updated 10 months ago
• shenh10 / DeepSeek_Simulator
  ☆65Updated 2 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆132Updated 3 weeks ago
• ColfaxResearch / cfx-article-src
  ☆109Updated 3 weeks ago
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆137Updated 4 months ago
• sunlex0717 / DissectingTensorCores
  ☆96Updated last year
• Raphael-Hao / brainstorm
  Compiler for Dynamic Neural Networks
  ☆46Updated last year
• casys-kaist / HUVM
  ☆23Updated 2 years ago
• LoongServe / LoongServe
  ☆99Updated 6 months ago
• yifuwang / symm-mem-recipes
  ☆86Updated 5 months ago
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆37Updated last year
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆94Updated 2 years ago
• SJTU-IPADS / ugache
  ☆22Updated last year
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆51Updated last year
• reed-lau / cute-gemm
  ☆121Updated 5 months ago
• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆100Updated last year
• sitar-lab / NeuSight
  ☆36Updated last month
• abhibambhaniya / GenZ-LLM-Analyzer
  LLM Inference analyzer for different hardware platforms
  ☆69Updated this week
• Sys-KU / DeepPlan
  [ACM EuroSys '23] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access
  ☆56Updated last year
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆124Updated 4 months ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆135Updated 11 months ago
• CalebDu / Awesome-Cute
  ☆71Updated 2 weeks ago
• microsoft / ConvStencil
  ☆27Updated last year
• hao-ai-lab / MuxServe
  ☆62Updated 11 months ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆171Updated 7 months ago
• uchuhimo / amanda
  ☆18Updated last year
• ParCIS / Magicube
  Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.
  ☆88Updated 2 years ago