Alternatives and similar repositories for llmbenchmark

Users that are interested in llmbenchmark are comparing it to the libraries listed below

• DataXujing / Bert_TensorRT
  Bert TensorRT模型加速部署
  ☆9Updated 3 years ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• DataXujing / YOLOv12-TensorRT
  YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现
  ☆11Updated 2 months ago
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆49Updated last year
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• DataXujing / DeepSeek-R1-Android
  安卓手机部署DeepSeek-R1 蒸馏的1.5B模型
  ☆21Updated 4 months ago
• zejunwang1 / fastMatch
  Large-scale exact string matching tool
  ☆17Updated 2 months ago
• lin-honghui / data-competition-calendar
  国内外数据竞赛资讯整理
  ☆18Updated 3 years ago
• wjc852456 / ONNX-TensorRT-LibTorch
  deploy onnx models with TensorRT and LibTorch
  ☆17Updated 3 years ago
• chineseocr / ai-medical
  陆续开源医疗行业的深度学习模型及数据集
  ☆13Updated 3 years ago
• Xiaolong-RRL / qwen2_5_vllm_fastapi
  使用FastAPI+vLLM部署Qwen2.5
  ☆17Updated 8 months ago
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆44Updated 11 months ago
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated last year
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated last year
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆24Updated last year
• hpc203 / TableDetection
  使用opencv部署yolo11表格检测，它是百度网盘AI大赛-表格检测的第2名方案，方案里包含表格框检测，表格角点检测，表格方向分类，一共三个模块。我依然是编写了C++和Python两个版本的程序
  ☆10Updated 5 months ago
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated last year
• WalkerMitty / PDFparser
  Here is a demo for PDF parser (Including OCR, object detection tools)
  ☆35Updated 7 months ago
• hpc203 / Real-Time-Frame-Interpolation-onnxrun
  使用onnxruntime部署实时视频帧插值，包含C++和Python两个版本的程序
  ☆25Updated last year
• ziwang-com / AGM
  AGM阿格姆：AI基因图谱模型，从token-weight权重微粒角度，探索AI模型，GPT\LLM大模型的内在运作机制。
  ☆28Updated last year
• BaofengZan / mnn-llm-GOT-OCR2.0
  使用mnn-llm对GOT-OCR2.0进行推理
  ☆15Updated 8 months ago
• isLinXu / paper-read-notes
  paper-read-notes
  ☆11Updated 8 months ago
• 360AILABNLP / 360LayoutAnalysis
  ☆27Updated 7 months ago
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• hpc203 / CoupledTPS-opencv-dnn
  使用OpenCV部署CoupledTPS，包含了肖像矫正，不规则边界的图像矩形化，旋转图像矫正，三个模型。依然是包含C++和Python两个版本的程序
  ☆19Updated 11 months ago
• ArtificialZeng / transformers-Explained
  官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系统，其他都是运行在其上面的软件。
  ☆15Updated last year
• CyberCommy / baidu-qa-100w
  百度QA100万数据集
  ☆47Updated last year
• yann168 / boshi-sample-solution
  ☆14Updated last year
• 1694439208 / GOT-OCR-Inference
  研究GOT-OCR-项目落地加速，不限语言
  ☆60Updated 7 months ago
• sherlockchou86 / PyLangPipe
  a simple lightweight large language model pipeline framework.
  ☆25Updated last month