Alternatives and similar repositories for zTT:

Users that are interested in zTT are comparing it to the libraries listed below

• mrsnu / band
  Multi-DNN Inference Engine for Heterogeneous Mobile Processors
  ☆29Updated 7 months ago
• Kyrie-Zhao / awesome-real-time-AI
  This is a list of awesome edgeAI inference related papers.
  ☆95Updated last year
• casys-kaist / Edge-scheduler
  ☆14Updated 3 years ago
• Soroosh129 / NeuOS
  Source code for the paper: "A Latency-Predictable Multi-Dimensional Optimization Framework forDNN-driven Autonomous Systems"
  ☆22Updated 4 years ago
• csu-eis / CoDL
  ☆77Updated last year
• casys-kaist / EnvPipe
  ☆24Updated last year
• qipengwang / Melon
  MobiSys#114
  ☆21Updated last year
• XRBench / XRBench-MLSys2023
  A version of XRBench-MAESTRO used for MLSys 2023 publication
  ☆23Updated last year
• eis-lab / sage
  Experimental deep learning framework written in Rust
  ☆14Updated 2 years ago
• cakeng / ASPEN
  This is the proof-of-concept CPU implementation of ASPEN used for the NeurIPS'23 paper ASPEN: Breaking Operator Barriers for Efficient Pa…
  ☆11Updated 11 months ago
• casys-kaist / LLMServingSim
  LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale
  ☆94Updated 3 weeks ago
• xumengwei / Edge-AI-Paper-List
  ☆199Updated last year
• msr-fiddle / synergy
  ☆49Updated 2 years ago
• Sys-KU / DeepPlan
  Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access (ACM EuroSys '23)
  ☆57Updated 11 months ago
• Raphael-Hao / Abacus
  ☆37Updated 3 years ago
• wenh18 / AdaptiveNet
  ☆17Updated last year
• casys-kaist / glet
  ☆46Updated 2 months ago
• zoranzhao / DeepThings
  A Portable C Library for Distributed CNN Inference on IoT Edge Clusters
  ☆83Updated 5 years ago
• SamsungLabs / FastFlow
  FastFlow is a system that automatically detects CPU bottlenecks in deep learning training pipelines and resolves the bottlenecks with dat…
  ☆27Updated last year
• Mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆93Updated 10 months ago
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆35Updated 2 years ago
• fredrickang / LaLaRAND
  LaLaRAND: Flexible Layer-by-Layer CPU/GPU Scheduling for Real-Time DNN Tasks
  ☆12Updated 2 years ago
• Rivendile / Muri
  Artifacts for our SIGCOMM'22 paper Muri
  ☆41Updated last year
• jashwantraj92 / cocktail
  ☆14Updated 7 months ago
• HuaizhengZhang / MIGProfiler
  Multi-Instance-GPU profiling tool
  ☆57Updated last year
• uw-mad-dash / shockwave
  Code for "Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning" [NSDI '23]
  ☆39Updated 2 years ago
• jaywonchung / ShadowTutor
  (ICPP '20) ShadowTutor: Distributed Partial Distillation for Mobile Video DNN Inference
  ☆12Updated 4 years ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆85Updated last year
• boringlee24 / socc22-miso
  MISO: Exploiting Multi-Instance GPU Capability on Multi-Tenant GPU Clusters
  ☆18Updated last year
• PatrickGuo / Mistify
  ☆10Updated 3 years ago