Alternatives and similar repositories for zTT

Users that are interested in zTT are comparing it to the libraries listed below

• Kyrie-Zhao / awesome-real-time-AI
  This is a list of awesome edgeAI inference related papers.
  ☆98Updated last year
• mrsnu / band
  Multi-DNN Inference Engine for Heterogeneous Mobile Processors
  ☆35Updated last year
• jeho-lee / Awesome-On-Device-AI-Systems
  ☆87Updated 3 weeks ago
• xumengwei / Edge-AI-Paper-List
  ☆209Updated last year
• casys-kaist / Edge-scheduler
  ☆14Updated 4 years ago
• XRBench / XRBench-MLSys2023
  A version of XRBench-MAESTRO used for MLSys 2023 publication
  ☆25Updated 2 years ago
• csu-eis / CoDL
  ☆78Updated 2 years ago
• eis-lab / sage
  Experimental deep learning framework written in Rust
  ☆15Updated 3 years ago
• Soroosh129 / NeuOS
  Source code for the paper: "A Latency-Predictable Multi-Dimensional Optimization Framework forDNN-driven Autonomous Systems"
  ☆22Updated 4 years ago
• qipengwang / Melon
  MobiSys#114
  ☆22Updated 2 years ago
• casys-kaist / LLMServingSim
  LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale
  ☆146Updated 3 months ago
• cakeng / ASPEN
  This is the proof-of-concept CPU implementation of ASPEN used for the NeurIPS'23 paper ASPEN: Breaking Operator Barriers for Efficient Pa…
  ☆13Updated last year
• ysyisyourbrother / awesome-on-device-AI
  A curated list of awesome projects and papers for AI on Mobile/IoT/Edge devices. Everything is continuously updating. Welcome contributio…
  ☆44Updated 2 years ago
• fredrickang / LaLaRAND
  LaLaRAND: Flexible Layer-by-Layer CPU/GPU Scheduling for Real-Time DNN Tasks
  ☆15Updated 3 years ago
• wenh18 / AdaptiveNet
  ☆16Updated 2 years ago
• reducto-sigcomm-2020 / reducto
  ☆45Updated 2 years ago
• UMass-LIDS / Proteus
  Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling
  ☆13Updated last year
• SophiaLi06 / BytePS_THC
  THC: Accelerating Distributed Deep Learning Using Tensor Homomorphic Compression
  ☆20Updated last year
• casys-kaist / EnvPipe
  ☆25Updated 2 years ago
• learning1234embed / NeuralWeightVirtualization
  [MobiSys 2020] Fast and Scalable In-memory Deep Multitask Learning via Neural Weight Virtualization
  ☆15Updated 5 years ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆92Updated 2 years ago
• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆116Updated last year
• wuyangzhang / elf
  ☆58Updated 3 years ago
• HuaizhengZhang / MIGProfiler
  Multi-Instance-GPU profiling tool
  ☆60Updated 2 years ago
• VIA-Research / vTrain
  ☆73Updated 5 months ago
• xumengwei / DeepCache
  Cache design for CNN on mobile
  ☆34Updated 7 years ago
• Sys-KU / DeepPlan
  [ACM EuroSys 2023] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access
  ☆57Updated 2 months ago
• usc-isi / PipeEdge
  PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices
  ☆35Updated last year
• sitar-lab / NeuSight
  ☆53Updated 4 months ago
• pie-project / pie
  Pie: Programmable LLM Serving
  ☆51Updated this week