morsoli / llmbenchmarkLinks
大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
☆17Updated 8 months ago
Alternatives and similar repositories for llmbenchmark
Users that are interested in llmbenchmark are comparing it to the libraries listed below
Sorting:
- Bert TensorRT模型加速部署☆9Updated 3 years ago
- Whisper in TensorRT-LLM☆15Updated last year
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆11Updated 2 months ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆49Updated last year
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- 安卓手机部署DeepSeek-R1 蒸馏的1.5B模型☆21Updated 4 months ago
- Large-scale exact string matching tool☆17Updated 2 months ago
- 国内外数据竞赛资讯整理☆18Updated 3 years ago
- deploy onnx models with TensorRT and LibTorch☆17Updated 3 years ago
- 陆续开源医疗行业的深度学习模型及数据集☆13Updated 3 years ago
- 使用FastAPI+vLLM部署Qwen2.5☆17Updated 8 months ago
- qwen2 and llama3 cpp implementation☆44Updated 11 months ago
- Inference deployment of the llama3☆11Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated last year
- Inference TinyLlama models on ncnn☆24Updated last year
- 使用opencv部署yolo11表格检测,它是百度网盘AI大赛-表格检测的第2名方案,方案里包含表格框检测,表格角点检测,表格方向分类,一共三个模块。我依然是编写了C++和Python两个版本的程序☆10Updated 5 months ago
- HunyuanDiT with TensorRT and libtorch☆17Updated last year
- Here is a demo for PDF parser (Including OCR, object detection tools)☆35Updated 7 months ago
- 使用onnxruntime部署实时视频帧插值,包含C++和Python两个版本的程序☆25Updated last year
- AGM阿格姆:AI基因图谱模型,从token-weight权重微粒角度,探索AI模型,GPT\LLM大模型的内在运作机制。☆28Updated last year
- 使用mnn-llm对GOT-OCR2.0进行推理☆15Updated 8 months ago
- paper-read-notes☆11Updated 8 months ago
- ☆27Updated 7 months ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- 使用OpenCV部署CoupledTPS,包含了肖像矫正,不规则边界的图像矩形化,旋转图像矫正,三个模型。依然是包含C++和Python两个版本的程序☆19Updated 11 months ago
- 官方transformers源码解析。AI大模型时代,pytorch、transformer是新操作系统,其他都是运行在其上面的软件。☆15Updated last year
- 百度QA100万数据集☆47Updated last year
- ☆14Updated last year
- 研究GOT-OCR-项目落地加速,不限语言☆60Updated 7 months ago
- a simple lightweight large language model pipeline framework.☆25Updated last month