Alternatives and similar repositories for inference_profiler

Users that are interested in inference_profiler are comparing it to the libraries listed below

• arcs-skku / EMDC_llvm
  Intel staging area for llvm.org contribution. Home for Intel LLVM-based projects.
  ☆38Updated 4 months ago
• EMDC-OS / mg-lru
  ☆9Updated 4 months ago
• EMDC-OS / CorePartitioning
  ☆14Updated 4 months ago
• EMDC-OS / remote-swap
  ☆10Updated 7 months ago
• EMDC-OS / power-aware-triton
  Know Your Enemy To Save Cloud Energy: Energy-Performance Characterization of Machine Learning Serving (HPCA '23)
  ☆13Updated 4 months ago
• s3yonsei / blocked_samples
  ☆25Updated 3 months ago
• casys-kaist / glet
  ☆48Updated 4 months ago
• unist-ssl / IIDP
  ☆12Updated last month
• fredrickang / LaLaRAND
  LaLaRAND: Flexible Layer-by-Layer CPU/GPU Scheduling for Real-Time DNN Tasks
  ☆13Updated 3 years ago
• msr-fiddle / philly-traces
  ☆188Updated 5 years ago
• pkusys / TGS
  Artifacts for our NSDI'23 paper TGS
  ☆75Updated 11 months ago
• casys-kaist / LLMServingSim
  LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale
  ☆113Updated 2 months ago
• S-Lab-System-Group / HeliosData
  Helios Traces from SenseTime
  ☆54Updated 2 years ago
• boringlee24 / socc22-miso
  MISO: Exploiting Multi-Instance GPU Capability on Multi-Tenant GPU Clusters
  ☆18Updated 2 years ago
• S-Lab-System-Group / Awesome-DL-Scheduling-Papers
  ☆288Updated last year
• utcs-scea / altis
  A benchmarking suite for heterogeneous systems. The primary goal of this project is to improve and update aspects of existing benchmarkin…
  ☆42Updated last year
• vhive-serverless / invitro
  Load generator and trace sampler for serverless computing
  ☆23Updated this week
• stanford-futuredata / gavel
  Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020
  ☆128Updated 9 months ago
• microsoft / taccl
  TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches
  ☆73Updated last year
• Sys-KU / DeepPlan
  [ACM EuroSys '23] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access
  ☆56Updated last year
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆106Updated last year
• unist-ssl / JABAS
  "JABAS: Joint Adaptive Batching and Automatic Scaling for DNN Training on Heterogeneous GPUs" (EuroSys '25)
  ☆13Updated last month
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆193Updated last month
• Mellanox / gpu_direct_rdma_access
  example code for using DC QP for providing RDMA READ and WRITE operations to remote GPU memory
  ☆130Updated 9 months ago
• msr-fiddle / blox
  ☆42Updated 10 months ago
• NVlabs / NVBit
  ☆246Updated 3 months ago
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆133Updated 3 months ago
• gsyang33 / Driple
  🚨 Prediction of the Resource Consumption of Distributed Deep Learning Systems
  ☆15Updated 2 years ago
• spcl / muliticast-based-allgather
  ☆16Updated 3 months ago
• mrsnu / band
  Multi-DNN Inference Engine for Heterogeneous Mobile Processors
  ☆33Updated 9 months ago