Alternatives and similar repositories for nnPerf

Users that are interested in nnPerf are comparing it to the libraries listed below

• jeho-lee / Awesome-On-Device-AI-Systems
  ☆120Updated this week
• csu-eis / CoDL
  ☆78Updated 2 years ago
• JackonYang / hands-on-tvm
  hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.
  ☆49Updated 2 years ago
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆283Updated 11 months ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆115Updated 7 months ago
• xudoong / EdgeVisionTransformer
  To deploy Transformer models in CV to mobile devices.
  ☆18Updated 4 years ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆173Updated 2 months ago
• UbiquitousLearning / Mandheling-DSP-Training
  The open-source project for "Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading"[MobiCom'2022]
  ☆19Updated 3 years ago
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆347Updated 2 months ago
• Kyrie-Zhao / awesome-real-time-AI
  This is a list of awesome edgeAI inference related papers.
  ☆99Updated 2 years ago
• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆102Updated 2 years ago
• weishengying / tiny-flash-attention
  使用 cutlass 实现 flash-attention 精简版，具有教学意义
  ☆56Updated last year
• bytedance / xpu-perf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆298Updated this week
• mlc-ai / notebooks
  ☆222Updated last year
• microsoft / nn-Meter
  A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.
  ☆363Updated last year
• hahnyuan / LLM-Viewer
  Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…
  ☆617Updated last year
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆136Updated 2 years ago
• Shenggan / awesome-distributed-ml
  A curated list of awesome projects and papers for distributed training or inference
  ☆265Updated last year
• DicardoX / Research-Space
  This repository is established to store personal notes and annotated papers during daily research.
  ☆180Updated 3 weeks ago
• byungsoo-oh / ml-systems-papers
  Curated collection of papers in machine learning systems
  ☆507Updated this week
• mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆135Updated last year
• HuaizhengZhang / MIGProfiler
  Multi-Instance-GPU profiling tool
  ☆58Updated 2 years ago
• xumengwei / Edge-AI-Paper-List
  ☆212Updated 2 years ago
• infinigence / SpecEE
  Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)
  ☆70Updated 9 months ago
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆147Updated 3 years ago
• abhibambhaniya / GenZ-LLM-Analyzer
  LLM Inference analyzer for different hardware platforms
  ☆100Updated 2 months ago
• AmadeusChan / Awesome-LLM-System-Papers
  ☆628Updated 3 weeks ago
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆192Updated 2 years ago
• UbiquitousLearning / MobileDLFrameworksBenchmark
  ☆19Updated 3 years ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆94Updated 2 years ago