Alternatives and similar repositories for inference_profiler

Users that are interested in inference_profiler are comparing it to the libraries listed below

• arcs-skku / EMDC_llvm
  Intel staging area for llvm.org contribution. Home for Intel LLVM-based projects.
  ☆38Updated last week
• EMDC-OS / mg-lru
  ☆9Updated last week
• EMDC-OS / CorePartitioning
  ☆14Updated last week
• EMDC-OS / remote-swap
  ☆10Updated last week
• EMDC-OS / power-aware-triton
  Know Your Enemy To Save Cloud Energy: Energy-Performance Characterization of Machine Learning Serving (HPCA '23)
  ☆13Updated last week
• s3yonsei / blocked_samples
  ☆26Updated 4 months ago
• fredrickang / LaLaRAND
  LaLaRAND: Flexible Layer-by-Layer CPU/GPU Scheduling for Real-Time DNN Tasks
  ☆15Updated 3 years ago
• unist-ssl / IIDP
  ☆12Updated 2 months ago
• casys-kaist / glet
  ☆49Updated 6 months ago
• Sys-KU / DeepPlan
  [ACM EuroSys '23] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access
  ☆56Updated last year
• junstar92 / nvidia-libraries-study
  ☆54Updated 7 months ago
• boringlee24 / socc22-miso
  MISO: Exploiting Multi-Instance GPU Capability on Multi-Tenant GPU Clusters
  ☆19Updated 2 years ago
• ai-computing / aicomp
  ☆17Updated 2 weeks ago
• casys-kaist / LLMServingSim
  LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale
  ☆120Updated last week
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆140Updated 5 months ago
• msr-fiddle / philly-traces
  ☆191Updated 5 years ago
• ldos-project / KernMLOps
  ☆10Updated 2 weeks ago
• pkusys / TGS
  Artifacts for our NSDI'23 paper TGS
  ☆78Updated last year
• Raphael-Hao / Abacus
  ☆37Updated last week
• SAITPublic / PIMSimulator
  Processing-In-Memory (PIM) Simulator
  ☆171Updated 6 months ago
• scale-snu / mcsim_public
  ☆21Updated 2 years ago
• platformxlab / G10
  ☆36Updated last year
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆94Updated 2 years ago
• oslab-ewha / memtrace
  Memory access traces of 5 Linux X applications
  ☆11Updated 4 years ago
• kooyunmo / cuda-uvm-gpt2
  PyTorch-UVM on super-large language models.
  ☆16Updated 4 years ago
• huijjj / Architecture
  POSTECH CSED311 Computer Architecture
  ☆13Updated 2 years ago
• stanford-futuredata / gavel
  Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020
  ☆128Updated 11 months ago
• vhive-serverless / invitro
  Load generator and trace sampler for serverless computing
  ☆24Updated last week
• unist-ssl / JABAS
  "JABAS: Joint Adaptive Batching and Automatic Scaling for DNN Training on Heterogeneous GPUs" (EuroSys '25)
  ☆13Updated 2 months ago
• utcs-scea / altis
  A benchmarking suite for heterogeneous systems. The primary goal of this project is to improve and update aspects of existing benchmarkin…
  ☆42Updated last year