Alternatives and similar repositories for llmbenchmark:

Users that are interested in llmbenchmark are comparing it to the libraries listed below

• DataXujing / Bert_TensorRT
  Bert TensorRT模型加速部署
  ☆9Updated 3 years ago
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆49Updated last year
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• DataXujing / DeepSeek-R1-Android
  安卓手机部署DeepSeek-R1 蒸馏的1.5B模型
  ☆21Updated 3 months ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated 11 months ago
• reilxlx / llava-Qwen2-7B-Instruct-Chinese-CLIP
  模型 llava-Qwen2-7B-Instruct-Chinese-CLIP 增强中文文字识别能力和表情包内涵识别能力，接近gpt4o、claude-3.5-sonnet的识别水平！
  ☆23Updated 9 months ago
• isLinXu / paper-read-notes
  paper-read-notes
  ☆11Updated 7 months ago
• 1694439208 / GOT-OCR-Inference
  研究GOT-OCR-项目落地加速，不限语言
  ☆60Updated 6 months ago
• BaofengZan / mnn-llm-GOT-OCR2.0
  使用mnn-llm对GOT-OCR2.0进行推理
  ☆15Updated 7 months ago
• Xiaolong-RRL / qwen2_5_vllm_fastapi
  使用FastAPI+vLLM部署Qwen2.5
  ☆14Updated 7 months ago
• ironartisan / awesome-compression1
  模型压缩的小白入门教程
  ☆22Updated 10 months ago
• AXERA-TECH / CLIP-ONNX-AX650-CPP
  ☆25Updated 4 months ago
• MonolithFoundation / Bumblebee
  A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.
  ☆37Updated 8 months ago
• lin-honghui / data-competition-calendar
  国内外数据竞赛资讯整理
  ☆18Updated 3 years ago
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆44Updated 11 months ago
• GuoYiFantastic / IMelodist
  Music large model based on InternLM2-chat.
  ☆22Updated 4 months ago
• DataXujing / TensorRT-LLM-ChatGLM3
  大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM
  ☆26Updated last year
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 2 years ago
• lutongyv / Textin_Tester
  如需体验textin文档解析，请点击https://cc.co/16YSIy
  ☆22Updated 10 months ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆47Updated last year
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• ArtificialZeng / baichuan-speedup
  纯c++的全平台llm加速库，支持python调用，支持baichuan, glm, llama, moss基座，手机端流畅运行chatglm-6B级模型单卡可达10000+token / s，
  ☆45Updated last year
• shuyhere / all-about-llm
  大语言模型训练和服务调研
  ☆37Updated last year
• 360AILABNLP / 360LayoutAnalysis
  ☆27Updated 6 months ago
• wjc852456 / ONNX-TensorRT-LibTorch
  deploy onnx models with TensorRT and LibTorch
  ☆17Updated 3 years ago
• zejunwang1 / fastMatch
  Large-scale exact string matching tool
  ☆17Updated 2 months ago
• 2404589803 / hf-daily-paper-newsletter-chinese
  🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…
  ☆51Updated this week
• ArtificialZeng / llama3_explained
  the newest version of llama3，source code explained line by line using Chinese
  ☆22Updated last year
• sherlockchou86 / PyLangPipe
  a simple lightweight large language model pipeline framework.
  ☆24Updated 2 weeks ago