Alternatives and similar repositories for llmbenchmark:

Users that are interested in llmbenchmark are comparing it to the libraries listed below

• DataXujing / Bert_TensorRT
  Bert TensorRT模型加速部署
  ☆9Updated 2 years ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆41Updated last year
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆49Updated last year
• DataXujing / DeepSeek-R1-Android
  安卓手机部署DeepSeek-R1 蒸馏的1.5B模型
  ☆19Updated last month
• DataXujing / TensorRT-LLM-ChatGLM3
  大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM
  ☆26Updated last year
• AXERA-TECH / CLIP-ONNX-AX650-CPP
  ☆24Updated 3 months ago
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated 10 months ago
• zejunwang1 / fastMatch
  Large-scale exact string matching tool
  ☆15Updated 3 weeks ago
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆24Updated last year
• triple-Mu / Stable-Diffusion-TensorRT
  Stable Diffusion in TensorRT 8.5+
  ☆14Updated 2 years ago
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆43Updated 9 months ago
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated 11 months ago
• lework / llm-benchmark
  LLM 并发性能测试工具，支持自动化压力测试和性能报告生成。
  ☆19Updated this week
• 1694439208 / GOT-OCR-Inference
  研究GOT-OCR-项目落地加速，不限语言
  ☆59Updated 5 months ago
• isLinXu / paper-read-notes
  paper-read-notes
  ☆10Updated 6 months ago
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated 9 months ago
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• 360AILABNLP / 360LayoutAnalysis
  ☆26Updated 5 months ago
• lin-honghui / data-competition-calendar
  国内外数据竞赛资讯整理
  ☆18Updated 3 years ago
• ArtificialZeng / baichuan-speedup
  纯c++的全平台llm加速库，支持python调用，支持baichuan, glm, llama, moss基座，手机端流畅运行chatglm-6B级模型单卡可达10000+token / s，
  ☆45Updated last year
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆46Updated last year
• hpc203 / pp-yoloe-onnxrun-cpp-py
  使用ONNXRuntime部署PP-YOLOE目标检测，支持PP-YOLOE-s、PP-YOLOE-m、PP-YOLOE-l、PP-YOLOE-x四种结构，包含C++和Python两个版本的程序
  ☆18Updated 2 years ago
• BaofengZan / mnn-llm-GOT-OCR2.0
  使用mnn-llm对GOT-OCR2.0进行推理
  ☆15Updated 5 months ago
• xiaozhi-agi / qwen_1_8chat_finetune
  基于lora微调Qwen1.8chat的实战教程
  ☆26Updated 5 months ago
• richjjj / cuvid-tensorrt-multi
  ffmpeg+cuvid+tensorrt+multicamera
  ☆12Updated 2 months ago
• lovemefan / ggml-learning-notes
  ggml学习笔记，ggml是一个机器学习的推理框架
  ☆14Updated last year
• GuoYiFantastic / IMelodist
  Music large model based on InternLM2-chat.
  ☆22Updated 3 months ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• hpc203 / Real-Time-Frame-Interpolation-onnxrun
  使用onnxruntime部署实时视频帧插值，包含C++和Python两个版本的程序
  ☆25Updated last year