morsoli / llmbenchmarkLinks
大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
☆19Updated last year
Alternatives and similar repositories for llmbenchmark
Users that are interested in llmbenchmark are comparing it to the libraries listed below
Sorting:
- Bert TensorRT模型加速部署☆10Updated 3 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Updated 2 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型 搭建及优化☆42Updated last year
- 安卓手机部署DeepSeek-R1 蒸馏的1.5B模型☆22Updated 7 months ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆13Updated 6 months ago
- deploy onnx models with TensorRT and LibTorch☆17Updated 3 years ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- ☆27Updated 2 months ago
- Whisper in TensorRT-LLM☆16Updated 2 years ago
- a simple lightweight large language model pipeline framework.☆27Updated 4 months ago
- 使用FastAPI+vLLM部署Qwen2.5☆22Updated 11 months ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated last year
- ☆17Updated last year
- 🔨🔨🔨Tool for making model training data set☆20Updated 10 months ago
- 这是一个使用opencv读取视频并使用socket进行传输视频画面的脚本文件,相较于调用ffmpeg传输节约了90%的数据量☆11Updated last year
- paper-read-notes☆12Updated 11 months ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Updated 8 months ago
- 使用mnn-llm对GOT-OCR2.0进行推理☆15Updated 11 months ago
- Wanwu models release, code will be released soon☆24Updated 3 years ago
- HunyuanDiT with TensorRT and libtorch☆18Updated last year
- 手摸手 美团 YOLOv6模型训练和TensorRT端到端部署方案教程☆33Updated 3 years ago
- 高效部署:YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀☆50Updated 2 years ago
- 国内外数据竞赛资讯整理☆18Updated 3 years ago
- 使用OpenCV部署L2CS-Net人脸朝向估计,包含C++和Python两个版本的程序,只依赖opencv库就可以运行☆20Updated 2 years ago
- 大模型部署实战:TensorRT-LLM, Triton Inference Server, vLLM☆26Updated last year
- This project provides simple code and demonstrates how to use the TensorRT C++ API and ONNX to deploy PaddleOCR text recognition model.☆48Updated 3 years ago
- 基于rknn的yolov5的cpp实现,包含各种依赖库,是一个完整工程,可直接编译运行☆21Updated 3 years ago
- 用于学习GOT/Qwen/OnnxLLm☆53Updated 11 months ago
- ☆27Updated 11 months ago
- Chinese license plate recognition☆29Updated 3 years ago