Alternatives and similar repositories for llm-infer-bench

Users that are interested in llm-infer-bench are comparing it to the libraries listed below

• AlbertiPot / nar

  View on GitHub
  codes for Neural Architecture Ranker and detailed cell information datasets based on NAS-Bench series
  ☆12Jul 11, 2022Updated 3 years ago
• BBuf / oneflow-cifar

  View on GitHub
  ☆13Mar 27, 2023Updated 2 years ago
• HubHop / vit-attention-benchmark

  View on GitHub
  Benchmarking Attention Mechanism in Vision Transformers.
  ☆20Oct 10, 2022Updated 3 years ago
• mlc-ai / llm-perf-bench

  View on GitHub
  ☆120Apr 22, 2024Updated last year
• yester31 / Cutlass_EX

  View on GitHub
  study of cutlass
  ☆22Nov 10, 2024Updated last year
• Dominic789654 / LongGenBench

  View on GitHub
  Source code for the paper "LongGenBench: Long-context Generation Benchmark"
  ☆24Oct 8, 2024Updated last year
• pprp / CVPR2022-NAS-competition-Track1-3th-solution

  View on GitHub
  Implementation of PGONAS for CVPR22W and RD-NAS for ICASSP23
  ☆23Apr 25, 2023Updated 2 years ago
• OpenBMB / cpm_kernels

  View on GitHub
  ☆26Oct 2, 2023Updated 2 years ago
• pprp / Vision-Mamba-CIFAR10

  View on GitHub
  ☆23Jan 21, 2024Updated 2 years ago
• ahennequ / pytorch-custom-mma

  View on GitHub
  ☆29Oct 3, 2022Updated 3 years ago
• yitu-opensource / MobileNeXt

  View on GitHub
  ☆149Oct 19, 2022Updated 3 years ago
• octoml / deformable-attention-kernel

  View on GitHub
  TVMScript kernel for deformable attention
  ☆25Dec 15, 2021Updated 4 years ago
• speedinghzl / ShuffleTransformer

  View on GitHub
  ☆25Jun 24, 2021Updated 4 years ago
• Owen718 / LongPrompt-LLamaGen

  View on GitHub
  This repository provides an improved LLamaGen Model, fine-tuned on 500,000 high-quality images, each accompanied by over 300 token prompt…
  ☆30Oct 21, 2024Updated last year
• inclusionAI / AWorld-RL

  View on GitHub
  Agentic Learning Powered by AWorld
  ☆88Feb 7, 2026Updated last week
• lliai / EMQ-series

  View on GitHub
  [ICCV-2023] EMQ: Evolving Training-free Proxies for Automated Mixed Precision Quantization
  ☆28Dec 6, 2023Updated 2 years ago
• OpenPPL / ppl.kernel.cuda

  View on GitHub
  ☆38Oct 12, 2024Updated last year
• shaoshitong / diffusion-model-learning

  View on GitHub
  Document the demo and a series of documents for learning the diffusion model.
  ☆42Jun 29, 2023Updated 2 years ago
• ChenMnZ / PrefixQuant

  View on GitHub
  An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization
  ☆172Nov 26, 2025Updated 2 months ago
• pprp / Pruner-Zero

  View on GitHub
  [ICML24] Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆98Nov 25, 2024Updated last year
• smpanaro / apple-silicon-4bit-quant

  View on GitHub
  Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"
  ☆11Mar 31, 2024Updated last year
• guolinke / fused_ops

  View on GitHub
  ☆10Aug 15, 2022Updated 3 years ago
• GinsengHoney / Nerf_study

  View on GitHub
  ☆10Jul 16, 2023Updated 2 years ago
• tlc-pack / cutlass_fpA_intB_gemm

  View on GitHub
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆96Sep 13, 2025Updated 5 months ago
• TianjinYellow / EdgeDeviceLLMCompetition-Starting-Kit

  View on GitHub
  ☆43Oct 31, 2024Updated last year
• waketzheng / fastapi-cdn-host

  View on GitHub
  Auto choose the fastest CDN host for swagger-ui in /docs.
  ☆19Jan 12, 2026Updated last month
• Sphere-AI-Lab / SGP-RL

  View on GitHub
  Symbolic Graphics Programming with Large Language Models
  ☆37Sep 14, 2025Updated 5 months ago
• Oneflow-Inc / conda-env

  View on GitHub
  ☆12Mar 13, 2023Updated 2 years ago
• leolee99 / Online-CNCLIP

  View on GitHub
  ChineseCLIP using online learning
  ☆13Nov 7, 2022Updated 3 years ago
• dcato98 / fastsparse

  View on GitHub
  Fastai+PyTorch implementation of sparse model training methods (SET, SNFS, RigL) + customize-your-own.
  ☆10Oct 20, 2022Updated 3 years ago
• gouxiangchen / DRL-grasp

  View on GitHub
  deep-reinforcement-learning-for-grasp
  ☆11Jun 20, 2019Updated 6 years ago
• Hadisalman / trajectory-optimized-active-search

  View on GitHub
  Code for the ICRA2018 paper "Trajectory-Optimized Sensing for Active Search of Tissue Abnormalities in Robotic Surgery"
  ☆11May 22, 2018Updated 7 years ago
• FaspDevTeam / OpenCAEPoro

  View on GitHub
  Open source simulator for porous media flow
  ☆14Oct 15, 2022Updated 3 years ago
• TencentARC / common_trainer

  View on GitHub
  Common template for pytorch project. Easy to extent and modify for new project.
  ☆13Dec 13, 2022Updated 3 years ago
• wu-kan / wuk_cupti_wrapper

  View on GitHub
  a simple API to use CUPTI
  ☆11Aug 19, 2025Updated 5 months ago
• wangitu / unpadded-AutoGPTQ

  View on GitHub
  Enhanced version of original AutoGPTQ (https://github.com/PanQiWei/AutoGPTQ).
  ☆10Nov 2, 2023Updated 2 years ago
• simveit / persistent_dense_gemm

  View on GitHub
  Persistent dense gemm for Hopper in `CuTeDSL`
  ☆15Aug 9, 2025Updated 6 months ago
• okigan / nano-vllm

  View on GitHub
  Nano vLLM
  ☆12Jun 26, 2025Updated 7 months ago
• ITERATOR-ACM-TEAM / VIPainter

  View on GitHub
  Vectorgraph Image Painter
  ☆12Mar 24, 2019Updated 6 years ago